A data transmission method, device and storage medium

Abstract

A data transmission method, device and storage medium. The data transmission method is used for a data source end to perform data transmission with a data sink end. The method comprises the following steps: acquiring capability information of the data sink end, wherein the capability information comprises a capability parameter of the data sink end related to a variable partition variable refresh rate (VPVRR); configuring a transmission link based on the capability information of the data sink end; acquiring control information returned by the data sink end, and transmitting a data stream to the data sink end through the transmission link according to the control information returned by the data sink end, wherein the data stream comprises a VPVRR data block and image data of an image to be displayed. The data transmission method writes the related parameters of the VPVRR into the data block for transmission, and realizes the variable partition variable refresh rate, that is, the technology of variable area and variable refresh rate is realized in the process of cooperation between the two parties, that is, the specific area of the screen is displayed at a high refresh rate, and the specific area is displayed at a low refresh rate.

Description

Technical Field

[0001] The embodiments of this disclosure relate to the field of data processing technology, and more specifically, to a data transmission method, a data transmission apparatus, and a storage medium. Background Technology

[0002] Variable Refresh Rate (VRR) technology is a communication mechanism between display devices and graphics processing units (GPUs) designed to optimize the visual experience, especially in games and other highly dynamic content. VRR technology allows the monitor's refresh rate to dynamically adjust based on the content of the graphics output, thereby reducing screen tearing, stuttering, and input lag, providing a smoother and more fluid visual experience. Summary of the Invention

[0003] At least one embodiment of this disclosure provides a data transmission method for a source end that transmits data with a data aggregation end. The method includes: acquiring capability information of the data aggregation end, wherein the capability information includes capability parameters of the data aggregation end related to the variable partition variable refresh rate (VPVRR); configuring a transmission link based on the capability information of the data aggregation end; and transmitting a data stream to the data aggregation end through the configured transmission link, wherein the data stream includes VPVRR data blocks and image data of an image to be displayed.

[0004] For example, in the data transmission method provided in at least one embodiment of this disclosure, the capability parameters include: whether the data aggregation end supports the variable partition variable refresh rate, whether the variable partition variable refresh rate is enabled by default, whether the variable partition variable refresh rate is initiated from the data aggregation end, whether the gaze point of the variable partition variable refresh rate is supported, or whether multi-viewpoint images and the arrangement transmission of the multi-viewpoint images are supported.

[0005] For example, in at least one embodiment of the data transmission method provided in this disclosure, the transmission link is configured based on the capability parameters of the data aggregation terminal, including: configuring the transmission link based on the capability information of the data aggregation terminal as follows: whether it is necessary to listen to subsequent data aggregation port configuration data (DPCD) information, whether it is necessary to perform the VPVRR transmission or perform full high frame rate transmission, or whether it is necessary to arrange and transmit the multi-view image in the transmission stage of the data stream.

[0006] For example, in the data transmission method provided in at least one embodiment of this disclosure, configuring the transmission link based on the capability parameters of the data aggregation end further includes: determining the transmission capability of the transmission link by accessing the DPCD register, so as to establish information communication between the source end and the data aggregation end, and to determine the transmission mode of the transmission link.

[0007] For example, in the data transmission method provided in at least one embodiment of this disclosure, the transmission mode of the transmission link is determined by defining DPCD configuration information and DPCD status information. The DPCD configuration information includes at least one of the following: the VPVRR support identifier, the VPVRR minimum frame rate, the VPVRR default enabling mode, or whether the VPVRR allows the data aggregation end to actively initiate it. The DPCD status information includes at least one of the following: refresh saturation identifier, VPVRR actively enabled or disabled, intended minimum frame rate, intended maximum frame rate, intended frame rate multiplier, display area update interval time, or the coordinates of the variable partition VP in the VPVRR.

[0008] For example, at least one embodiment of the data transmission method provided in this disclosure further includes: acquiring control information returned by the data aggregation terminal, and transmitting a data stream to the data aggregation terminal through the configured transmission link according to the control information returned by the data aggregation terminal, wherein transmitting the data stream to the data aggregation terminal through the transmission link according to the control information returned by the data aggregation terminal includes: determining data block information, wherein the data block information includes DPCD configuration information, DPCD status information and the VPVRR data block, wherein the VPVRR data block includes a VPVRR control data block and a VPVRR layer data block; encoding the VPVRR layer data block of the data block information with the image data of the image to be displayed to obtain the data stream.

[0009] For example, in the data transmission method provided in at least one embodiment of this disclosure, the VPVRR control data block is information sent from the data aggregation end to the information source end, used to indicate the control information of the data aggregation end, the capability information of the data aggregation end, the information requesting the VPVRR layer data block to be transmitted, and requesting the information source end to provide feedback. The control information of the data aggregation end includes changes in the gaze area and changes in refresh capability.

[0010] For example, in the data transmission method provided in at least one embodiment of this disclosure, the VPVRR layer data block is information sent from the source end to the data aggregation end, used to indicate the content definition of the data stream, the capabilities of the source end, and to provide feedback from the source end in response to the information transmitted by the VPVRR control data block.

[0011] For example, at least one embodiment of the data transmission method provided in this disclosure further includes: when it is determined that the VPVRR will be used for data transmission, determining the current gaze region based on the VPVRR control data block of the data collection end; and defining the current gaze region and the screen refresh region surrounding the current gaze region in the VPVRR layer data block based on the current gaze region.

[0012] For example, in at least one embodiment of the data transmission method provided in this disclosure, defining a screen refresh area around the current gaze region in the VPVRR layer data block based on the current gaze region includes: determining whether VPVRR is enabled, whether the VPVRR mode is fixed, and whether the image to be displayed is in an evenly divided grid mode; based on the VPVRR being enabled, the VPVRR mode being fixed, and the image to be displayed being in an evenly divided grid mode, determining the number of equal divisions of the image to be displayed and the label of the screen refresh area to obtain the screen refresh area around the gaze region.

[0013] For example, at least one embodiment of the data transmission method provided in this disclosure further includes: when it is determined that the VPVRR is used for data transmission, obtaining the gaze region defined by the data collection terminal in the VPVRR control data block, as well as the optimal viewing distance, viewing freedom, and offset crosstalk information of the gaze region.

[0014] For example, in the data transmission method provided in at least one embodiment of this disclosure, obtaining the gaze region defined by the data collection terminal in the VPVRR control data block, as well as the optimal viewing distance, viewing freedom, and offset crosstalk information of the gaze region, includes: determining whether the VPVRR is enabled, whether the VPVRR mode is fixed, and whether the image to be displayed is in an evenly divided grid mode; based on the VPVRR being enabled, the VPVRR mode being fixed, and the image to be displayed being in an evenly divided grid mode, determining the number of equal divisions of the image to be displayed and whether the gaze point identifier is enabled; when the gaze point identifier is enabled, obtaining the gaze region of the data collection terminal, as well as the optimal viewing distance, viewing freedom, and offset crosstalk information of the gaze region.

[0015] At least one embodiment of this disclosure also provides a data transmission method for a data aggregation terminal that transmits data with a source end. The method includes: sending capability information of the data aggregation terminal to the source end, wherein the capability information includes capability parameters of the data aggregation terminal related to the Variable Partition Variable Refresh Rate (VPVRR); sending control information back to the source end; receiving a data stream transmitted by the source end according to the control information, wherein the data stream includes VPVRR data blocks and image data of an image to be displayed; and decoding the data stream to display the image to be displayed.

[0016] For example, in the data transmission method provided in at least one embodiment of this disclosure, the capability information of the data aggregation end includes: whether it supports the variable partition variable refresh rate, whether the variable partition variable refresh rate is enabled by default, whether the variable partition variable refresh rate is initiated from the data aggregation end, whether it supports the gaze point of the variable partition variable refresh rate, or whether it supports multi-view images and the arrangement transmission of the multi-view images.

[0017] For example, in the data transmission method provided in at least one embodiment of this disclosure, if the data aggregation end supports the VPVRR, the capability information is defined in the display identifier; if the data aggregation end supports a specific format of the VPVRR, the format supported by the data aggregation end is defined in the display identifier to infer the capability information; if the data aggregation end does not support the VPVRR or does not support a specific format of the VPVRR, the capability information is defined in the Legacy EDID; or the capability information of a specific supplier or a specific display transmission interface is defined.

[0018] For example, at least one embodiment of the data transmission method provided in this disclosure further includes: sending a VPVRR control data block to the source end, used to indicate the control information of the data aggregation end, the capability information of the data aggregation end, requesting the VPVRR layer data block transmission information sent by the source end and requesting feedback, wherein the control information of the data aggregation end includes changes in the gaze area and changes in refresh capability.

[0019] At least one embodiment of this disclosure also provides a data transmission method for data transmission between a data aggregation end and a source end. The method includes: the data aggregation end sending capability information of the data aggregation end to the source end, wherein the capability information includes capability parameters of the data aggregation end related to the Variable Partition Variable Refresh Rate (VPVRR); the source end configuring a transmission link based on the capability information of the data aggregation end; the data aggregation end transmitting control information back to the source end; the source end transmitting a data stream to the data aggregation end through the transmission link according to the control information transmitted back by the data aggregation end, wherein the data stream includes VPVRR data blocks and image data of an image to be displayed; and the data aggregation end decoding the received data stream to display the image to be displayed.

[0020] At least one embodiment of this disclosure also provides a data transmission apparatus for a source end that transmits data with a data aggregation end, comprising: an acquisition unit configured to acquire capability information of the data aggregation end, wherein the capability information includes capability parameters of the data aggregation end related to the Variable Partition Variable Refresh Rate (VPVRR); a configuration unit configured to configure a transmission link based on the capability information of the data aggregation end; and a transmission unit configured to acquire control information returned by the data aggregation end and transmit a data stream to the data aggregation end through the transmission link according to the control information returned by the data aggregation end, wherein the data stream includes VPVRR data blocks and image data of an image to be displayed.

[0021] At least one embodiment of this disclosure also provides a data transmission apparatus, including: a processor; a memory; and one or more computer program modules, wherein the one or more computer program modules are stored in the memory and configured to be executed by the processor, and the one or more computer program modules include instructions for executing instructions to implement the data transmission method provided in any embodiment of this disclosure.

[0022] At least one embodiment of this disclosure also provides a storage medium for non-temporarily storing computer-readable instructions that, when executed by a computer, perform the data transmission method provided in any embodiment of this disclosure. Attached Figure Description

[0023] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings of the embodiments will be briefly described below. Obviously, the drawings described below only relate to some embodiments of this disclosure and are not intended to limit this disclosure.

[0024] Figure 1A An overall architecture diagram of a data transmission method provided in at least one embodiment of this disclosure is shown.

[0025] Figure 1B A flowchart illustrating data transmission between a source and a data aggregation point provided in at least one embodiment of this disclosure is shown.

[0026] Figure 1C This diagram illustrates the overall framework for data transmission between a source and a data aggregation point, as provided in at least one embodiment of this disclosure.

[0027] Figure 2 A schematic diagram of a data transmission method provided in at least one embodiment of the present disclosure is shown.

[0028] Figure 3A This is a schematic diagram of DPCD configuration information provided for at least one embodiment of the present disclosure.

[0029] Figure 3BThis is a schematic diagram of DPCD status information provided in at least one embodiment of the present disclosure.

[0030] Figures 4A-4F This is a schematic diagram illustrating parameter transfer between a source and a data collection point, provided for at least one embodiment of this disclosure.

[0031] Figure 5A and Figure 5B This is a schematic diagram illustrating the transmission of VPVRR data blocks from a source end to a data aggregation end, provided for at least one embodiment of this disclosure.

[0032] Figure 6 This is a schematic diagram of the transmission of a control data block provided for at least one embodiment of the present disclosure.

[0033] Figure 7 This is a schematic block diagram of a data transmission apparatus provided for at least one embodiment of the present disclosure.

[0034] Figure 8 This is a schematic block diagram of another data transmission apparatus provided for at least one embodiment of the present disclosure.

[0035] Figure 9 This is a schematic block diagram of an electronic device provided for at least one embodiment of the present disclosure.

[0036] Figure 10 This is a schematic diagram of a storage medium provided for at least one embodiment of the present disclosure. Detailed Implementation

[0037] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the described embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0038] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, the terms “an,” “a,” or “the,” and similar terms do not indicate a quantity limitation, but rather indicate the presence of at least one. The terms “including,” “comprising,” or “containing,” and similar terms mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. The terms “connected,” “linked,” or similar terms are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. The terms “upper,” “lower,” “left,” and “right,” etc., are used only to indicate relative positional relationships, and these relative positional relationships may change accordingly when the absolute position of the described objects changes.

[0039] The inventors noted that current variable refresh rate technologies (such as VRR technology in High Definition Multimedia Interface, HDMI) for ultra-high-definition transmission are insufficient because they only provide refresh rate changes for the entire screen and do not support refresh rate changes for specific screen areas. Considering the multi-view information transmission of future light field display technologies and the ultra-high pixel backplane refresh rate, Variable Partition Variable Refresh Rate (VPVRR) technology is the future direction.

[0040] The inventors discovered that improvements can be made to the current display standard (DisplayPort 2.1, or DP2.1 for short) in the following aspects:

[0041] (1) A bidirectional auxiliary channel, which allows control information to be transmitted between the data collection end and the source end;

[0042] (2) The low-latency AUX channel, with a maximum transmission delay of 500 microseconds, allows the binocular camera data of the light field sensor to be quickly transmitted back to the source.

[0043] A detailed analysis of the physical hardware requirements for each scheme can be found in Table 1 below:

[0044] Table 1

[0045]

[0046]

[0047]

[0048] Based on the analysis in Table 1 above, it can be seen that:

[0049] (1) Using VPVRR technology (e.g., high refresh rate and low refresh rate each occupy 50% of the area), compared to a fixed high refresh rate, the required bandwidth ratio is 3:4, which can save up to 25% of bandwidth consumption, while the corresponding viewing experience is similar.

[0050] (2) Using VPVRR technology (e.g., high refresh rate and low refresh rate each occupy 50% of the area), the required bandwidth ratio is 3:2 compared to the normal refresh rate. Only 50% extra bandwidth is needed to achieve the same effect as 100% extra bandwidth high refresh.

[0051] (3) Using VPVRR technology can improve the efficiency of product design in different product forms. For example, compared with Scheme No. 5 in Table 1, Scheme No. 6 can save one transmission cable without using Display Stream Compression (DSC) technology. The corresponding data collection end saves one DP interface and DP chip, which can effectively reduce costs.

[0052] Therefore, how to implement VPVRR display transmission technology is an urgent problem to be solved in the current market.

[0053] At least one embodiment of this disclosure provides a data transmission method for a source end that transmits data with a data aggregation end. The method includes: acquiring capability information of the data aggregation end, wherein the capability information includes capability parameters of the data aggregation end related to Variable Partition Variable Refresh Rate (VPVRR); configuring a transmission link based on the capability information of the data aggregation end; acquiring control information returned by the data aggregation end, and transmitting a data stream to the data aggregation end through the transmission link according to the control information returned by the data aggregation end, wherein the data stream includes VPVRR data blocks and image data of an image to be displayed.

[0054] At least one embodiment of this disclosure also provides a data transmission apparatus and a storage medium.

[0055] The data transmission method provided in the above embodiments of this disclosure achieves variable partition and variable refresh rate by writing the relevant parameters of VPVRR into data blocks for transmission. That is, during the collaboration between the two parties, a certain area of ​​the screen is displayed at a high refresh rate and a certain area is displayed at a low refresh rate. At the same time, the corresponding area and refresh rate are variable.

[0056] The embodiments and some examples of this disclosure will now be described in detail with reference to the accompanying drawings.

[0057] Figure 1A An overall architecture diagram of a data transmission method provided in at least one embodiment of this disclosure is shown. For example, as... Figure 1A As shown, this data transmission method is applied to data transmission between a source (A) and a sink (B). For example, source A includes an encoding module for transmitting the image / video data to be transmitted, along with related parameters, to the decoding module of sink B via a data transmission medium (e.g., a data link). For instance, the link policy maker of the encoding module in source A transmits corresponding information to the link policy maker of the decoding module in sink B, and the stream policy maker of the encoding module in source A transmits corresponding information to the stream policy maker of the decoding module in sink B. For example, sink B decodes the image / video data and stores it in, for example, a register. A driver chip then drives sink B to perform corresponding variable-refresh-rate display with variable partitions. For example, a specific area of ​​the screen can be displayed at a high refresh rate, while a different area can be displayed at a low refresh rate, and the corresponding area can be variable. For example, the data sink can be a display terminal; this embodiment of the present disclosure does not limit this.

[0058] Figure 1B A flowchart illustrating data transmission between a source and a data aggregation point provided in at least one embodiment of this disclosure is shown.

[0059] For example, such as Figure 1B As shown, a hot-plug signal is used to establish a connection between source A and data aggregation B. For example, source A reads the DisplayID or Legacy EDID (Extended Display Identification Data) from the data aggregation end. Through this DisplayID and LegacyEDID, the source end can determine whether the data aggregation end supports VPVRR and the extent of its VPVRR capability.

[0060] For example, data aggregation terminal B reads the DisplayPort Configuration Data (DPCD) information from source terminal A to know the link configuration of source terminal A, that is, what the bitstream configuration will be when source terminal A transmits to data aggregation terminal B. For example, the bitstream configuration can be configured as follows: the current available bandwidth of the transmission link is 50Gbps (gigabits per second), and the expected transmission of images will occupy 47.5Gbps, so the bandwidth is sufficient; and it is known that the data aggregation terminal supports VPVRR, but it is disabled by default, so VPVRR link configuration is not performed during link configuration.

[0061] For example, source B performs link training based on the capabilities of data aggregator, that is, configures the link to transmit the image (i.e., data stream); data aggregator decodes the received image accordingly.

[0062] For example, data aggregation terminal B provides feedback to source terminal A regarding dynamic information from the display side (e.g., a control data block), requesting it to transmit images back according to relevant parameters. For instance, when source terminal A receives information from data aggregation terminal B's binocular camera that the viewer's gaze area has changed or that data aggregation terminal B's refresh rate is limited, requiring the activation of VPVRR mode for transmission, it transmits the image using VPVRR according to the data aggregation terminal's requirements. Then, the data aggregation terminal decodes the received image accordingly for display. This achieves variable partitioning and variable refresh rate by defining the data transmission method between the data aggregation terminal and the source terminal. Specifically, during the collaboration between the two parties, specific areas of the screen can be displayed at high refresh rates (e.g., high refresh rate display), while specific areas can be displayed at low refresh rates (e.g., low refresh rate display), thus realizing a technology where the corresponding area and refresh rate are variable.

[0063] Figure 1C This diagram illustrates the overall framework for data transmission between a source and a data aggregation point, as provided in at least one embodiment of this disclosure.

[0064] For example, such as Figure 1C As shown, the transmission conditions are first established: the data aggregation end B and the source end A establish an ultra-high-definition data transmission channel (e.g., a data aggregation port (DisplayPort) cable connection, with no limitation on the transmission protocol during connection), and the two parties communicate their capabilities; that is, the source end A knows whether the data aggregation end B has the ability to display in partitions, refresh rate capability, resolution capability, etc., and the data aggregation end B knows whether the source end A can support VPVRR function, etc.

[0065] When the VPVRR function is enabled, source A notifies data aggregator B (e.g., data aggregator B encounters a refresh bottleneck and sends a refresh bottleneck message to source A), or data aggregator B notifies source A (e.g., data aggregator B detects a bandwidth bottleneck / rendering bottleneck and sends a stream with the VPVRR function applied to source A).

[0066] For example, after the VPVRR function is enabled, the data collection terminal B has the eyetracking function and generates generalized exponential (GE) distribution parameters and skew exponential (SE) distribution parameters. Using control information feedback signaling, the control source terminal A renders and generates a high-frequency refresh area location image according to the feedback parameters and transmits it to the data collection terminal A for refresh display.

[0067] Figure 2 A schematic diagram of a data transmission method provided in at least one embodiment of this disclosure is shown. For example, this data transmission method is used as a source end for data transmission with a data aggregation end. Figure 2 As shown, the data transmission method includes steps S110 to S130.

[0068] Step S110: Obtain the capability information of the data aggregation end.

[0069] Step S120: Configure the transmission link based on the capability information of the data aggregation end.

[0070] Step S130: Obtain the control information returned by the data aggregation terminal, and transmit the data stream to the data aggregation terminal through the transmission link according to the control information returned by the data aggregation terminal.

[0071] For step S110, for example, in some examples, the capability information includes capability parameters of the data aggregation end related to Variable Partition Variable Refresh Rate (VPVRR). For example, these capability parameters include: whether the data aggregation end supports Variable Partition Variable Refresh Rate, whether Variable Partition Variable Refresh Rate is enabled by default, whether Variable Partition Variable Refresh Rate is initiated from the data aggregation end, whether it supports gaze points of Variable Partition Variable Refresh Rate, or whether it supports multi-view images and the arrangement and transmission of multi-view images.

[0072] For step S120, for example, in some examples, this step includes: based on the capability information of the data aggregation end, the source end configures the transmission link as follows: whether it is necessary to listen to subsequent data aggregation port configuration data (DPCD) information, whether it is necessary to perform VPVRR transmission or full high frame rate transmission, or whether it is necessary to arrange and transmit multi-view images in the transmission stage of the data stream.

[0073] For example, steps S110 and S120 involve capability communication between the information source A and the data aggregation point B. For example, step S110 informs the information source A of the capabilities of the data aggregation point B.

[0074] It is important to note that the definitions in this section are flexibly configured within the machine based on the usage scenario. For example, the data aggregation end B indicates that it supports VPVRR multi-view displays. However, if the transmission bandwidth allows, the display can initially support high refresh rates. VPVRR will only be enabled when the displayed content is refreshed frequently and the internal refresh capability is insufficient.

[0075] For example, in some examples, the capability parameters of the data aggregation end characterize that the data aggregation end B may have the following capabilities: support VPVRR, not enabled by default, must be initiated from the data aggregation end (i.e., please receive the status of the data aggregation end at any time), support VPVRR gaze points (please receive the status of the data aggregation end at any time), support multiple viewpoints, support multi-viewpoint arrangement transmission, etc.

[0076] For example, the above capabilities can be demonstrated through the following settings for DisplayID in Table 2:

[0077] Table 2

[0078]

[0079] For example, as shown in Table 2, each of the eight bits in this field represents a different meaning. For instance, when bit 0 = 1, it indicates that the data aggregator supports VPVRR multi-viewpoint arrangement; when bit 1 = 1, it indicates that the data aggregator supports VPVRR multi-viewpoint; when bit 2 = 1, it indicates that the VPVRR gaze point of the data aggregator can be obtained; when bits 3-4 = 0-1, it indicates that VPVRR is not enabled by default on the data aggregator and is initiated by the data aggregator; when bits 5-6 = 0-1, it indicates that VPVRR is supported and the timing should always be displayed in stereo; when bit 7 = 1, it indicates that detailed timing is preferred.

[0080] Based on the above settings for each bit in the fields of Table 2, the above capabilities of the data aggregation end B can be restricted in the data stream and transmitted to the source end A to inform the source end A of its capabilities. The source end A can then perform the corresponding link configuration to cooperate with its capabilities to transmit the corresponding data stream.

[0081] For example, source A, based on the capabilities transmitted from data aggregation point B, parses and configures accordingly: For instance, regarding the data aggregation point's support for VPVRR, source A configures the transmission link to listen for subsequent DPCD information; regarding the data aggregation point's default setting to not enable VPVRR, source A configures the transmission link to perform full high-frame-rate transmission without VPVRR transmission during link configuration; regarding the data aggregation point's setting to initiate VPVRR from the data aggregation point, source A configures the transmission link to listen for subsequent DPCD information; regarding the data aggregation point's support for VPVRR gaze points, source A configures the transmission link to listen for subsequent DPCD information; regarding the data aggregation point's support for multi-viewpoint and multi-viewpoint arranged transmission, source A configures the transmission link to arrange the multi-viewpoint images for transmission during data stream transmission.

[0082] For example, after establishing a connection, the source and data aggregator need to communicate their capabilities through the transmission of information. This information is typically transmitted in different ways depending on the manufacturer and application scenario, requiring multiple methods of information transmission. For instance, in the embodiments of this disclosure, communication can be conducted in the following ways.

[0083] For example, in some cases, if the data aggregation end supports VPVRR, the capability information is defined in the Display ID; if the data aggregation end supports a specific VPVRR format, the format supported by the data aggregation end is defined in the Display ID to infer the capability information; if the data aggregation end does not support VPVRR or does not support a specific VPVRR format, the capability information is defined in the Legacy EDID; or the capability information is defined for a specific vendor or a specific interface of the display transmission.

[0084] For example, when VPVRR is supported at the data aggregation end, capability information can be defined in the fields. For instance, device capabilities can be described by parsing the Timing Options field of the Type VII Detailed Timing datablock in the DisplayID. Specific device capability information can be defined in Table 3 below:

[0085] Table 3

[0086]

[0087] For example, as shown in Table 3, the value in the 3rd and 4th bits of this field can be used to determine whether it is enabled by default and whether it is initiated by the data aggregation end. For example, 00 represents enabled by default; 01 represents disabled by default and initiated by the data aggregation end; 10 represents disabled by default and determined by the bandwidth of the data aggregation end; 11 represents that all other values ​​except certain specific values ​​are reserved. Thus, the device capabilities can be determined based on the values ​​in the 3rd and 4th bits of this field. Similar settings are applied to the capabilities represented by other bits, and the explanation in Table 2 can be referred to, so it will not be repeated here.

[0088] For example, when a specific format like VPVRR is supported at the data aggregation terminal, the supported formats are defined to infer the capability information. That is, by describing what video formats are supported, the capabilities of the data aggregation terminal can be inferred. For example, specific capability information can be specified in Table 4 below (where h indicates that the following value is in hexadecimal format):

[0089] Table 4

[0090]

[0091] For example, Table 4 sets the formatting for each digit of each field, so that the capabilities of the data collection end can be obtained based on this field.

[0092] For example, in cases where the data aggregation end does not support VPVRR or a specific format that does not support VPVRR, capability information is defined in the Legacy EDID (Extended Display Identification Data). This definition might be located in a field of LegacyEDID and consist of 8 bits. For instance, specific capability information can be defined in Table 5 below:

[0093] Table 5

[0094]

[0095]

[0096] For example, as shown in Table 5, the value in the 3rd and 4th positions of this field can be used to determine whether it is enabled by default and whether it is initiated by the data aggregation end. For example, 00 represents enabled by default; 01 represents disabled by default and initiated by the data aggregation end; 10 represents disabled by default and determined by the bandwidth of the data aggregation end; 11 represents that all other values ​​except certain specific values ​​are reserved. Thus, the device capabilities can be determined based on the values ​​in the 3rd and 4th positions of the field. Similar settings can be made in other positions for whether multi-view images are supported, which will not be elaborated on in the embodiments of this disclosure.

[0097] For example, in other examples, information about the ability to display specific interfaces or vendors can be defined, which will not be described in detail here.

[0098] For example, in step S120, source A informs data aggregation B of the configuration performed by source A on the transmission link. For example, in an embodiment of this disclosure, the transmission capability of the transmission link is determined by accessing the DPCD register through an auxiliary channel (AUX) to establish communication between the source and the data aggregation end, thereby determining the transmission mode of the transmission link.

[0099] For example, this section defines communication for link configuration. The source (e.g., a DisplayPort source device) accesses the receiver's DPCD register block via the AUX channel to determine the receiver's functionality and status and initiate link training commands. For instance, when using the AUX channel, it determines the link transmission capability of the data aggregation port by reading the DPCD register block. Therefore, by establishing communication between the source and data aggregation ends during the transmission link establishment phase, the transmission method can be determined. For example, in some examples, the transmission method of the transmission link can be determined by defining DPCD configuration information and DPCD status information.

[0100] For example, in the DPCD field address mapping, the definitions of DPCD configuration information and DPCD status information are as follows:

[0101] 0318Ah through 5FFFFh RESERVED(use to be defined)

[0102] 0318Ah through 031FFh RESERVED(use to be defined)

[0103] 03200h through 032FFh VPVRR Configuration-specific

[0104] 03300h through 033FFh VPVRR Status-specific

[0105] 03400h through 5FFFFh RESERVED(use to be defined)

[0106] As can be seen from the above definitions, the DPCD configuration information of VPVRR is defined in fields 03200h-032FFh, and the DPCD status information of VPVRR is defined in fields 03300h-033FFh.

[0107] Figure 3A This is a schematic diagram illustrating DPCD configuration information provided for at least one embodiment of this disclosure. For example, such as Figure 3A As shown, the data aggregation end B can read DPCD configuration information from the source end A. For example, the DPCD configuration information may include: VP support flag, VRR support flag, VPVRR support flag, supported single-stream format type, supported multi-stream format type, VP function type, VP region type, VPVRR minimum frame rate, default enabling mode, whether the data aggregation end is allowed to initiate, etc. It may also include more or less information, and the embodiments of this disclosure do not limit this.

[0108] For example, the definition of DPCD configuration information is shown in Table 6:

[0109] Table 6

[0110]

[0111]

[0112] Based on the settings in Table 6, DPCD configuration information can be defined using fields 03200h-032FFh. For example, as shown in Table 6, the DPCD configuration information defines information such as VPVRR identifier, VPVRR default settings, dynamic or fixed mode support, viewpoint support, reverse view support, viewpoint distance capability, multi-viewpoint support, and multi-viewpoint arrangement.

[0113] Figure 3B This is a schematic diagram illustrating DPCD status information provided in at least one embodiment of this disclosure. For example, such as... Figure 3B As shown, for example, the DPCD status information may include: refresh saturation flag, VPVRR active on / off, intended minimum frame rate, intended maximum frame rate, intended frame rate multiplier, display area update interval, VP coordinates, etc., and may also include more or less information. The embodiments disclosed herein do not limit this.

[0114] For example, the definition of DPCD status information is shown in Table 7:

[0115] Table 7

[0116]

[0117]

[0118] Based on the settings in Table 7, DPCD status information can be defined using fields 03300h-033FFh. For example, as shown in Table 7, the DPCD status information defines information such as VPVRR identifier, VPVRR default settings, whether dynamic or fixed mode is supported, viewpoint support, reverse view support, viewpoint distance capability, multi-viewpoint support, and multi-viewpoint arrangement.

[0119] For example, based on the above configuration, after the source A and the data collection B communicated their capabilities in steps S110 and S120, a communication channel was established between the source A and the display B.

[0120] After the communication between the two parties is completed, in step S130, the source end A obtains the control information returned by the data aggregation end B, and transmits the data stream to the data aggregation end B through the transmission link according to the control information returned by the data aggregation end B. For example, the data stream includes VPVRR data blocks and image data of the image to be displayed.

[0121] For example, in the embodiments of this disclosure, after the source end and the data aggregation end establish a connection, video data is continuously transmitted from the source end to the data aggregation end. At this time, because the data aggregation end contains information such as the gaze range captured by the binocular camera, it needs to send this control information back to the source end. After receiving this information, the source end can adjust the corresponding video data to meet the following requirements of the data aggregation end.

[0122] (1) Due to insufficient refresh capability, the data collection end needs to send this message back to the source end, and the source end outputs the video mixing information of the combination of high refresh area and low refresh area to the data collection end.

[0123] (2) As the binocular camera components capture changes in the viewing range of the viewer, the data collection end sends back parameters to control the size of the high refresh rate area and the low refresh rate area, forming a mixed code that is sent from the source end to the data collection end.

[0124] Figures 4A-4F This is a schematic diagram illustrating parameter transfer between a source and a data collection point, provided for at least one embodiment of this disclosure.

[0125] For example, such as Figure 4A As shown, first, it is determined whether the current data aggregation terminal supports partitioned refresh capability. If it does, the system is adjusted to a partitioned refresh mode based on the data aggregation terminal's requirements and the mode is fixed, with the fixed regions being labeled. For example, the image to be displayed is set to an evenly divided grid mode, with the even division coefficient div-eq-coef set to 4, meaning the number of blocks is 2 to the power of 4, or 16, thus dividing the image into... Figure 4AThe 16-grid diagram shown is numbered 1-16, and it is encoded using a z-scan method.

[0126] For example, such as Figure 4B As shown, after calibrating fixed regions 1-16, the data aggregation end transmits the gaze region parameters to the source end. For example, the gaze region is 10, which is the 10th block out of 16 blocks. The attached figure only shows an example setting of 10, and the specific setting can be determined according to the actual situation. For example, when the gaze region is 10, the source end can return a bitstream (i.e., a VPVRR bitstream) containing information about high refresh regions 5, 7, 11, and 15 to the data aggregation end according to the actual situation and parallax changes. The specific returned blocks are parsed according to the bitstream transmitted to the data aggregation end.

[0127] For example, such as Figure 4C As shown, after determining the viewing area, the refresh area can be based on the Unity rendering engine output. For example, it can extract the following information returned from the data collection end as input: optimal viewing distance, viewing freedom, and offset crosstalk information, and render the corresponding model for image output. Furthermore, using the viewing area as a criterion, it can calculate the changes in image frames near the viewing area and output the areas with larger changes (e.g., ...). Figure 5A The regions shown (5, 7, 11, 15) form the VPVRR code stream, which is transmitted from the source end to the data collection end.

[0128] Figure 4D This is a schematic diagram illustrating the transmission of parameters for the reflex function. For example, as shown... Figure 4D As shown, the parameters Reverse_view_ability and Reverse_view_action are passed from the data collection end to the information source end, and Reverse_view_status is passed from the information source end to the data collection end to correct the display of the image at the data collection end.

[0129] For example, such as Figure 4E As shown, after the parallax function parameters are transmitted, the data aggregation end transmits the parallax capability parameters to the source end for rendering, generating a parallax image suitable for the data aggregation end. The parallax magnitude is controlled within a certain range. For example, these parallax capability parameters include optimal viewing distance, viewing degrees of freedom, and offset crosstalk information. For instance, if the crosstalk of the display device at the data aggregation end is low, the parallax it can support is greater, and the stereoscopic effect perceived by the left and right eyes, as well as the in-screen and out-of-screen effects, will be better. Conversely, if the crosstalk of the display device is high, the parallax it can support is smaller, and images with excessive parallax received by the left and right eyes are prone to ghosting, making it difficult to support a very stereoscopic effect.

[0130] For example, such as Figure 4F After determining the refresh area based on the parallax capability parameter, multi-view images are stitched together in each returned area. For example, z-scan encoding is used for the arrangement, and M*N is used. The number of viewpoints L can be less than M*N, where M and N are integers greater than or equal to 1, and L is an integer greater than or equal to 1 and less than or equal to M*N. Redundant content can be blacked out. For details, please refer to the relevant technology in this field, which will not be elaborated here.

[0131] For example, the above parameters can be transmitted between the data aggregation end and the information source end through the VPVRR control data block, the VPVRR layer data block, and other data. This will be described in detail below.

[0132] For example, in some examples, step S130 includes: determining data block information, wherein the data block information includes DPCD configuration information, DPCD status information and VPVRR data blocks, wherein the VPVRR data blocks include VPVRR control data blocks and VPVRR layer data blocks; and encoding the data block information with the image data of the image to be displayed to obtain a data stream.

[0133] For example, the specific definition format of DPCD configuration information is shown in Table 6 above, and the specific definition format of DPCD status information is shown in Table 7 above.

[0134] For example, in some examples, VPVRR control data blocks are information sent from the data aggregation end to the information source end, used to indicate the control information of the data aggregation end, the capability information of the data aggregation end, request the transmission of information by the VPVRR layer data blocks and request feedback. Among them, the control information of the data aggregation end includes changes in the gaze area and changes in refresh capability.

[0135] For example, the specific structure definition of the VPVRR control data block is shown in Table 8 below:

[0136] Table 8

[0137]

[0138]

[0139]

[0140]

[0141]

[0142] Figure 6 This is a schematic diagram illustrating the transmission of a control data block according to at least one embodiment of the present disclosure. For example, in some examples, such as Figure 6As shown, the current transmission is at a high bit rate, and the refresh capability of the data aggregation end is limited. It actively requests to adopt VPVRR output for the bitstream. The data aggregation end has a fixed area division and certain technical parameter specifications. For example, the viewer's gaze area is detected as 10 through visual tracking. This information is defined in the VPVRR control data block and sent to the source end so that the source end can make corresponding adjustments, changing the previous continuous bitstream into a VPVRR bitstream, and then sending the VPVRR bitstream to the data aggregation end.

[0143] For example, in this example, when it is determined that VPVRR will be used for data transmission, the current gaze region is determined based on the control information returned by the data aggregation end; the gaze region defined by the data aggregation end in the VPVRR control data block, as well as the optimal viewing distance, viewing freedom, and offset crosstalk information of the gaze region, are obtained to change the data stream, changing it from the previous continuous stream to a VPVRR stream (e.g., ...). Figure 6 (As shown).

[0144] For example, the gaze region and its optimal viewing distance, viewing freedom, and offset crosstalk information are defined in the VPVRR control data block, including: determining whether VPVRR is enabled, whether the VPVRR mode is fixed, and whether the image to be displayed is in a grid pattern; based on the VPVRR being enabled, the VPVRR mode being fixed, and the image to be displayed being in a grid pattern, determining the number of equal divisions of the image to be displayed and whether the gaze point is enabled; when the gaze point identifier is enabled, determining the gaze region and its optimal viewing distance, viewing freedom, and offset crosstalk information at the data collection end and sending them to the source end; after parsing the gaze region and its optimal viewing distance, viewing freedom, and offset crosstalk information, the source end determines the screen refresh area based on this information, for example, determining it as... Figure 5A Blocks 5, 7, 11, and 15 are shown in the diagram and are defined in the VPVRR layer data blocks for resending to the data aggregation end.

[0145] For example, the specific definition of the VPVRR control data block can be seen from Table 8 above. For example, the 0th bit of the 3rd field is used to define whether VPVRR is enabled (bit 0 = 1 indicates enabled, bit 0 = 0 indicates disabled); the 3rd bit of the 3rd field is used to indicate whether the VPVRR mode is fixed (bit 3 = 0 indicates fixed; bit 3 = 1 indicates not fixed); the 4th and 5th bits of the 3rd field indicate whether it is a grid pattern (for example, bits 4th and 5th can be 00, 01, 10, 11, where 00 indicates a grid pattern; 01 indicates a single fixed high-division block; 10 indicates multiple fixed high-division blocks; and 11 indicates others). Therefore, based on the definition of the 3rd field in the VPVRR layer data block data structure, information such as whether VPVRR is enabled, whether the VPVRR mode is fixed, and whether it is a grid pattern can be obtained.

[0146] For example, based on the VPVRR control data block data structure, the third field defines VPVRR enabled (bit 0 = 1), VPVRR mode fixed (bit 3 = 0), and the image to be displayed is in evenly divided grid mode (bits 4-5 can be 00), and the fourth field is then used to determine the display.

[0147] For example, setting bits 0-3 of the 4th field in the VPVRR control data block data structure to 4 indicates that the screen is divided into 16 equal parts.

[0148] For example, based on Table 8, it can be seen that fields 37-38 are used to define viewpoint support for VPVRR, and bits 0-7 are used to indicate whether the gaze flag is on (as shown in Table 8, 0 means off and 1 means on), bits 8-15 are used to indicate the current gaze region, and when bits 8-15 are set to 10, it indicates that the current gaze region is 10.

[0149] For example, if the gaze flag is determined to be on based on bits 0-7 (i.e., bits 0-7 = 1b), bits 8-15 are further parsed to obtain the gaze region label (e.g., if it equals 10, then the gaze region is 10), thus obtaining the current gaze region 10 at the data collection end; if the gaze flag is determined to be off based on bits 0-7 (i.e., bits 0-7 = 0b), no further parsing is performed.

[0150] For example, setting bits 16-23 in fields 40-47 to 56 indicates a maximum left crosstalk of 56% between the two views; setting bits 0-7 in fields 51-53 to 600 indicates an optimal viewing distance of 600 cm; setting bits 8-15 in fields 51-53 to 48 indicates a viewing degree of freedom of 48%; and setting bits 16-23 in fields 51-53 to 23 indicates an offset crosstalk information of 23%. This structure transmits the gaze area, optimal viewing distance, viewing degree of freedom, and offset crosstalk information from the data aggregation end to the source end. The source end obtains this information by parsing this structure and makes corresponding bitstream adjustments. For example, from... Figure 6 The original continuous bitstream was adjusted to a VPVRR bitstream.

[0151] For example, in some examples, VPVRR layer data blocks are information sent from the source to the data aggregation end to indicate the content definition of the data stream (e.g., how many streams and layers are in the data stream, which stream and which layer this is), the capabilities of the source, and to provide feedback to the source in response to the information passed in response to the VPVRR control data blocks.

[0152] For example, the specific structure definition of the VPVRR layer data block is shown in Table 9 below:

[0153] Table 9

[0154]

[0155]

[0156]

[0157]

[0158]

[0159] For example, in some instances, when VPVRR is used for data transmission, the current gaze region is determined based on control information returned from the data aggregation end. Based on this current gaze region, a screen refresh region surrounding the gaze region is defined in the VPVRR layer data block (e.g., the screen refresh region surrounding the gaze region is the block with the largest parallax during gaze region transformation), and sent to the data aggregation end for parsing and display. For example, the screen refresh region surrounding the gaze region can be output based on the Unity rendering engine. For instance, the following information returned from the data aggregation end can be extracted as input: optimal viewing distance, viewing freedom, and offset crosstalk information. The corresponding model is then rendered for image output. Using the gaze region as a criterion, the changes in image frames near the gaze region are calculated, and areas with significant changes (e.g., Figure 5A The regions shown (5, 7, 11, and 15) form a VPVRR bitstream for transmission. The specific process can be found in relevant technical descriptions in this field and will not be elaborated upon here.

[0160] Figure 5A and Figure 5B This is a schematic diagram illustrating the transmission of VPVRR data blocks from a source to a data aggregation point, provided for at least one embodiment of this disclosure. For example, as... Figure 5A and Figure 5B As shown, the example is taken with a gaze area of ​​10 and areas with relatively large image changes of 5, 7, 11, and 15. Of course, the embodiments disclosed herein are not limited to this, and the specific implementation can be determined according to the actual situation.

[0161] For example, areas with significant image changes are more sensitive to human perception, so VPVRR will be used to transmit images with significant changes in areas 5, 7, 11, and 15.

[0162] For example, when it was determined in the previous step that VPVRR would be used for data transmission, the source end, based on the control information returned by the data aggregation end, knows that the gaze region is 10, and determines that VPVRR transmission regions 5, 7, 11, and 15 will be used based on the rendering output of the source end (see the bitstream diagram). Figure 5A (As shown).

[0163] For example, such as Figure 5B As shown, at time t0, a full-resolution image is transmitted, and the corresponding screen refresh area is the entire area; at time t1, four partitioned smaller images are transmitted (for example, ...). Figure 5AThe purpose of the VPVRR layer data blocks (areas 5, 7, 11, and 15) is to allow the data collection end to parse the positions of these small images to obtain the corresponding screen refresh areas, which are blocks 5, 7, 11, and 15, and thus perform the corresponding VPVRR display.

[0164] For example, in some examples, the screen refresh area around the current gaze region is defined in the VPVRR layer data block based on the current gaze region, including: determining whether VPVRR is enabled, whether the VPVRR mode is fixed, and whether the image to be displayed is in an evenly divided grid mode; based on VPVRR being enabled, the VPVRR mode being fixed, and the image to be displayed being in an evenly divided grid mode, the number of equal divisions of the image to be displayed and the label of the screen refresh area are determined to obtain the screen refresh area around the gaze region.

[0165] For example, the specific definition of the VPVRR layer data block can be seen from Table 9 above. For example, the 0th bit of the 3rd field is used to define whether VPVRR is enabled (0th bit = 1 indicates enabled, 0th bit = 0 indicates disabled); the 3rd bit of the 3rd field is used to indicate whether the VPVRR mode is fixed (3rd bit = 0 indicates fixed; 3rd bit = 1 indicates not fixed); the 4th and 5th bits of the 3rd field indicate whether it is a grid pattern (for example, the 4th and 5th bits can be 00, 01, 10, 11, 00 indicates a grid pattern; 01 indicates a single fixed high partition block; 10 indicates multiple fixed high partition blocks; 11 indicates others). Therefore, according to the definition of the 3rd field in the VPVRR layer data block data structure, information such as whether VPVRR is enabled, whether the VPVRR mode is fixed, and whether it is a grid pattern can be obtained.

[0166] For example, based on the VPVRR layer data block data structure, the third field defines VPVRR enabled (bit 0 = 1), VPVRR mode fixed (bit 3 = 0), and the image to be displayed is in evenly divided grid mode (bits 4-5 can be 00), and the fourth field is then used to determine the display.

[0167] For example, setting bits 0-3 of field 4 to 4 indicates that the screen is divided into 16 equal parts; setting bits 4-7 to 7 indicates that this is the 7th block in the zscan method. Therefore, based on field 4 in the VPVRR layer data block data structure, we can determine which zscan block this is, and thus obtain the screen refresh area surrounding the gaze region. Figure 5A The regions 5, 7, 11, and 15 shown are used to display the corresponding VPVRR at the data aggregation end.

[0168] At least one embodiment of this disclosure also provides a data transmission method for a data aggregation terminal that transmits data with a source end. The method includes: sending capability information of the data aggregation terminal to the source end, wherein the capability information includes capability parameters of the data aggregation terminal related to Variable Partition Variable Refresh Rate (VPVRR); sending control information back to the source end; receiving a data stream transmitted by the source end according to the control information, wherein the data stream includes VPVRR data blocks and image data of an image to be displayed; and decoding the data stream to display the image to be displayed.

[0169] For example, the capability information of the data aggregation terminal includes: whether it supports the variable partition variable refresh rate, whether the variable partition variable refresh rate is enabled by default, whether the variable partition variable refresh rate is initiated from the data aggregation terminal, whether it supports the gaze point of the variable partition variable refresh rate, or whether it supports multi-view images and the arrangement and transmission of the multi-view images.

[0170] For example, if the data aggregation terminal supports the VPVRR, the capability information is defined in the field; if the data aggregation terminal supports a specific format of the VPVRR, the format supported by the data aggregation terminal is defined to infer the capability information; if the data aggregation terminal does not support the VPVRR or does not support a specific format of the VPVRR, the capability information is defined in the Legacy EDID; or the capability information of a specific vendor or display transmission specific interface is defined.

[0171] For example, the data transmission method further includes: sending a VPVRR control data block to the source end, which is used to indicate the control information of the data aggregation end, the capability information of the data aggregation end, request the transmission information of the VPVRR layer data block sent by the source end and request feedback, wherein the control information of the data aggregation end includes changes in the gaze area and changes in refresh capability.

[0172] For a detailed description of the data transmission method in this embodiment, please refer to [reference needed]. Figure 1A-6 The descriptions shown will not be repeated here.

[0173] At least one embodiment of this disclosure also provides a data transmission method for data transmission between a data aggregation end and a source end. The method includes: the data aggregation end sending capability information of the data aggregation end to the source end, wherein the capability information includes capability parameters of the data aggregation end related to Variable Partition Variable Refresh Rate (VPVRR); the source end configuring a transmission link based on the capability information of the data aggregation end; the data aggregation end transmitting control information back to the source end; the source end transmitting a data stream to the data aggregation end through the transmission link according to the control information transmitted back by the data aggregation end, wherein the data stream includes VPVRR data blocks and image data of an image to be displayed; and the data aggregation end decoding the received data stream to display the image to be displayed.

[0174] For a detailed description of the data transmission method in this embodiment, please refer to [reference needed]. Figure 1A-6 The descriptions shown will not be repeated here.

[0175] It should be noted that the information in the table above is exemplary and may include more or less information as needed, and the embodiments disclosed herein do not limit this.

[0176] It should be noted that, in the embodiments of this disclosure, the data transmission method provided in the above embodiments may include more or fewer operations, which may be executed sequentially or in parallel. Although the data transmission method described above includes multiple operations appearing in a specific order, it should be clearly understood that the order of the multiple operations is not limited. The data transmission method described above may be executed once or multiple times according to predetermined conditions.

[0177] The data transmission method disclosed herein establishes a new generation of partitioned variable refresh rate display data transmission standard by writing relevant parameters of VPVRR into data blocks for transmission. This establishes a communication channel between the display end and the source end, realizing variable partitioning and variable refresh rate. That is, during the collaboration between the two parties, specific areas of the screen can be displayed at a high refresh rate, while specific areas can be displayed at a low refresh rate, with the corresponding areas and refresh rates being variable. On the other hand, by establishing an information transmission mechanism between the display end and the source end, the source end can communicate with the display end and output a data stream that meets the display requirements of the display end. The display end can parse the data in the data stream according to the standard, thereby realizing variable partitioning and variable refresh rate display.

[0178] Figure 7 This is a schematic block diagram of a data transmission apparatus provided for at least one embodiment of the present disclosure. For example, in Figure 7In the example shown, the data transmission device 100 includes an acquisition unit 110, a configuration unit 120, and a transmission unit 130. These units can be implemented, for example, through hardware (e.g., circuit) modules or software modules; the following embodiments are similar and will not be repeated. For example, these units can be implemented using a central processing unit (CPU), a general-purpose graphics processor (GPGPU), a graphics processing unit (GPU), a tensor processor (TPU), a field-programmable gate array (FPGA), or other forms of processing units with data processing capabilities and / or instruction execution capabilities, along with corresponding computer instructions.

[0179] The acquisition unit 110 is configured to acquire capability information of the data aggregation terminal, wherein the capability information includes capability parameters of the data aggregation terminal related to the Variable Partition Variable Refresh Rate (VPVRR). For example, the acquisition unit 110 can implement step S110, and its specific implementation method can be referred to the relevant description of step S110, which will not be repeated here.

[0180] Configuration unit 120 is configured to configure the transmission link based on the capability information of the data aggregation terminal. For example, configuration unit 120 can implement step S120, and its specific implementation method can be found in the relevant description of step S120, which will not be repeated here.

[0181] The transmission unit 130 is configured to acquire control information returned by the data aggregation terminal, and transmit a data stream to the data aggregation terminal via the transmission link according to the control information returned by the data aggregation terminal. The data stream includes VPVRR data blocks and image data of the image to be displayed. For example, the transmission unit 130 can implement step S130; the specific implementation method can be found in the relevant description of step S130, and will not be repeated here.

[0182] Figure 8 This is a schematic block diagram of another data transmission apparatus provided for at least one embodiment of the present disclosure. For example, such as... Figure 8 As shown, the data transmission device 200 includes a processor 210, a memory 220, and one or more computer program modules 221.

[0183] For example, processor 210 is connected to memory 220 via bus system 230. For example, one or more computer program modules 221 are stored in memory 220. For example, one or more computer program modules 221 include instructions for performing the data transmission method provided in any embodiment of this disclosure. For example, the instructions in one or more computer program modules 221 can be executed by processor 210. For example, bus system 230 can be a commonly used serial or parallel communication bus, etc., and the embodiments of this disclosure are not limited thereto.

[0184] For example, the processor 210 may be a central processing unit (CPU), a digital signal processor (DSP), a graphics processing unit (GPU), a general-purpose graphics processing unit (GPGPU), or other processing units with data processing capabilities and / or instruction execution capabilities. It may be a general-purpose processor or a dedicated processor, and may control other components in the data transmission device 100 to perform desired functions. Embodiments of this disclosure are described using a general-purpose graphics processing unit (GPGPU) as an example.

[0185] The memory 220 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, which the processor 210 may execute to implement the functions (implemented by the processor 210) in this embodiment of the disclosure and / or other desired functions, such as data transfer methods. Various application programs and various data, such as capability parameters, control information, and various data used and / or generated by the application programs, may also be stored in the computer-readable storage medium.

[0186] It should be noted that, for clarity and brevity, this disclosure does not show all the constituent units of the data transmission device 200. To achieve the necessary functions of the data transmission device 200, those skilled in the art can provide and set other constituent units (not shown) according to specific needs, and this disclosure does not limit this.

[0187] The data transmission method or apparatus according to the embodiments of this disclosure can also be used by means of, for example Figure 9 The architecture of the exemplary electronic device 3000 shown is implemented as follows. Figure 9As shown, the electronic device 3000 may include a bus 3010, one or more central processing units (CPUs), graphics processing units (GPUs), or GPGPUs 3020, read-only memory (ROM) 3030, random access memory (RAM) 3040, a communication port connected to a network 3050, input / output components 3060, a hard disk 3070, etc. The storage devices in the electronic device 3000, such as the ROM 3030, the hard disk 3070, or the RAM (i.e., video memory) inside the GPGPU itself, can store various data or files required for the processing and / or communication of the methods provided in this disclosure, as well as program instructions executed by the CPU, GPU, or GPGPU. The electronic device 3000 may also include a user interface 3080. Of course, Figure 7 The architecture shown is merely exemplary and can be omitted as needed when implementing different devices. Figure 7 One or more components in the electronic device shown.

[0188] At least one embodiment of this disclosure also provides a storage medium. Figure 10 This is a schematic diagram of a storage medium provided for at least one embodiment of the present disclosure. For example, such as Figure 10 As shown, the storage medium 400 non-transitory stores computer-readable instructions 401, which can execute the data transmission method provided in any embodiment of this disclosure when executed by a computer (including a processor).

[0189] For example, the storage medium can be any combination of one or more computer-readable storage media. For instance, one computer-readable storage medium may contain computer-readable program code that acquires capability information of the data aggregation terminal; another computer-readable storage medium may contain computer-readable program code that configures the transmission link based on the capability information of the data aggregation terminal; and yet another computer-readable storage medium may contain computer-readable program code that acquires control information returned by the data aggregation terminal and transmits a data stream to the data aggregation terminal via the transmission link according to the control information returned by the data aggregation terminal. For example, when this program code is read by a computer, the computer can execute the program code stored in the computer storage medium to perform, for example, the data transmission method provided in any embodiment of this disclosure.

[0190] For example, the storage medium may include a memory card for a smartphone, a storage component for a tablet computer, a hard disk for a personal computer, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), portable compact disc read-only memory (CD-ROM), flash memory, or any combination of the above storage media, or other suitable storage media.

[0191] Regarding the aforementioned publicly disclosed information, the following points need to be clarified:

[0192] (1) The accompanying drawings of the embodiments of this disclosure only involve the structures involved in the embodiments of this disclosure. Other structures can be referred to the general design.

[0193] (2) Where there is no conflict, the embodiments of this disclosure and the features in the embodiments can be combined with each other to obtain new embodiments.

[0194] The above description is merely a specific embodiment of this disclosure, but the scope of protection of this disclosure is not limited thereto. The scope of protection of this disclosure should be determined by the scope of protection of the claims.

Claims

1. A data transmission method for a source end that transmits data with a data aggregation end, the method comprising: Obtain the capability information of the data aggregation terminal, wherein the capability information includes the capability parameters of the data aggregation terminal related to the variable partition variable refresh rate (VPVRR); Configure the transmission link based on the capability information of the data aggregation terminal; The data stream is transmitted to the data aggregation terminal via the configured transmission link, wherein the data stream includes VPVRR data blocks and image data of the image to be displayed.

2. The data transmission method according to claim 1, wherein, The capability parameters include: Whether the data aggregation terminal supports the variable partition variable refresh rate, whether the variable partition variable refresh rate is enabled by default, whether the variable partition variable refresh rate is initiated from the data aggregation terminal, whether the gaze point of the variable partition variable refresh rate is supported, or whether multi-viewpoint images and the arrangement and transmission of the multi-viewpoint images are supported.

3. The data transmission method according to claim 2, wherein, Configure the transmission link based on the capability parameters of the data aggregation terminal, including: Based on the capability information of the data aggregation terminal, the transmission link is configured as follows: Whether it is necessary to listen to subsequent data aggregation port configuration data (DPCD) information, whether it is necessary to perform the VPVRR transmission or the full high frame rate transmission, or whether it is necessary to arrange and transmit the multi-view images in the transmission stage of the data stream.

4. The data transmission method according to claim 3, wherein, Configuring the transmission link based on the capability parameters of the data aggregation terminal also includes: The transmission capability of the transmission link is determined by accessing the DPCD register, thereby establishing information communication between the source end and the data aggregation end, and determining the transmission mode of the transmission link.

5. The data transmission method according to claim 4, wherein, The transmission mode of the transmission link is determined by defining DPCD configuration information and DPCD status information. The DPCD configuration information includes at least one of the following: the VPVRR support identifier, the VPVRR minimum frame rate, the default VPVRR enabling mode, or whether the VPVRR allows the data aggregation end to initiate it actively. The DPCD status information includes at least one of the following: refresh saturation flag, whether the VPVRR is actively enabled or disabled, intended minimum frame rate, intended maximum frame rate, intended frame rate multiplier, display area update interval, or coordinates of the variable partition in the VPVRR.

6. The data transmission method according to any one of claims 1-5, further comprising: The system acquires the control information returned by the data aggregation terminal, and transmits the data stream to the data aggregation terminal through the configured transmission link according to the control information returned by the data aggregation terminal. Specifically, transmitting a data stream to the data aggregation terminal via the transmission link based on the control information returned by the data aggregation terminal includes: Determine data block information, wherein the data block information includes DPCD configuration information, DPCD status information, and the VPVRR data block, wherein the VPVRR data block includes VPVRR control data block and VPVRR layer data block; The data stream is obtained by encoding the VPVRR layer data blocks of the data block information with the image data of the image to be displayed.

7. The data transmission method according to claim 6, wherein, The VPVRR control data block is information sent from the data aggregation end to the information source end. It is used to indicate the control information of the data aggregation end, the capability information of the data aggregation end, the information requested from the VPVRR layer data block, and to request feedback from the information source end. The control information of the data aggregation end includes changes in the gaze area and changes in refresh capability.

8. The data transmission method according to claim 6, wherein, The VPVRR layer data block is information sent from the source end to the data aggregation end, used to indicate the content definition of the data stream, the capabilities of the source end, and to provide feedback to the source end in response to the information transmitted by the VPVRR control data block.

9. The data transmission method according to claim 8, further comprising: If it is determined that the VPVRR will be used for data transmission... The current gaze region is determined based on the VPVRR control data block at the data aggregation end; Based on the current gaze region, the current gaze region and the screen refresh area surrounding the current gaze region are defined in the VPVRR layer data block.

10. The data transmission method according to claim 9, wherein, Based on the current gaze region, a screen refresh area surrounding the gaze region is defined in the VPVRR layer data block, including: Determine whether the VPVRR is enabled, whether the VPVRR mode is fixed, and whether the image to be displayed is in an evenly divided grid mode; Based on the VPVRR being enabled, the VPVRR mode being fixed, the image to be displayed being in an evenly divided grid mode, and based on the current gaze area, the number of equal divisions of the image to be displayed and the label of the screen refresh area are determined to obtain the screen refresh area surrounding the gaze area.

11. The data transmission method according to claim 7, further comprising: If it is determined that the VPVRR will be used for data transmission... The data collection terminal acquires the gaze region defined in the VPVRR control data block, as well as the optimal viewing distance, viewing freedom, and offset crosstalk information of the gaze region.

12. The data transmission method according to claim 11, wherein, The data collection terminal obtains the gaze region defined in the VPVRR control data block, as well as the optimal viewing distance, viewing freedom, and offset crosstalk information of the gaze region, including: Determine whether the VPVRR is enabled, whether the VPVRR mode is fixed, and whether the image to be displayed is in an evenly divided grid mode; Based on the VPVRR being enabled, the VPVRR mode being fixed, and the image to be displayed being in an evenly divided grid mode, the number of equal divisions of the image to be displayed and whether the gaze point identifier is enabled are determined. When the gaze point identifier is enabled, the gaze area, optimal viewing distance, viewing degree of freedom, and offset crosstalk information of the gaze area are obtained from the data collection terminal.

13. A data transmission method, used as a data aggregation terminal for transmitting data with a source end, the method comprising: Send the capability information of the data aggregation terminal to the source terminal, wherein the capability information includes the capability parameters of the data aggregation terminal related to the variable partition variable refresh rate (VPVRR); Control information is transmitted back to the source end; Receive the data stream transmitted by the source end according to the control information, wherein the data stream includes VPVRR data blocks and image data of the image to be displayed; The data stream is decoded to display the image to be displayed.

14. The data transmission method according to claim 13, wherein, The capability information of the data aggregation terminal includes: Whether the variable partition variable refresh rate is supported, whether the variable partition variable refresh rate is enabled by default, whether the variable partition variable refresh rate is initiated from the data aggregation end, whether the gaze point of the variable partition variable refresh rate is supported, or whether multi-viewpoint images and the arrangement and transmission of the multi-viewpoint images are supported.

15. The data transmission method according to claim 14, wherein, If the data aggregation terminal supports the VPVRR, the capability information is defined in the display identifier; If the data aggregation terminal supports a specific format of the VPVRR, the display identifier defines the format supported by the data aggregation terminal to infer the capability information. If the data aggregation terminal does not support the VPVRR or does not support the specific format of the VPVRR, the capability information is defined in the conventional extended display identification data; or Define the capabilities of a specific supplier or display to transmit specific interfaces.

16. The data transmission method according to claim 13, further comprising: A VPVRR control data block is sent to the source end to indicate the control information of the data aggregation end, the capability information of the data aggregation end, request the transmission information of the VPVRR layer data block sent by the source end, and request feedback. The control information of the data aggregation end includes changes in the gaze area and changes in refresh capability.

17. A data transmission method for data transmission between a data aggregation end and a source end, the method comprising: The data aggregation end sends its capability information to the information source end, wherein the capability information includes the capability parameters of the data aggregation end related to the variable partition variable refresh rate (VPVRR). The source end configures the transmission link based on the capability information of the data aggregation end; The data aggregation end transmits control information back to the information source end; The source end transmits a data stream to the data aggregation end through the transmission link according to the control information returned by the data aggregation end. The data stream includes VPVRR data blocks and image data of the image to be displayed. The data aggregation terminal decodes the received data stream to display the image to be displayed.

18. A data transmission apparatus, a source end for transmitting data with a data aggregation end, comprising: The acquisition unit is configured to acquire the capability information of the data aggregation terminal, wherein the capability information includes capability parameters of the data aggregation terminal related to the variable partition variable refresh rate (VPVRR); The configuration unit is configured to configure the transmission link based on the capability information of the data aggregation terminal; The transmission unit is configured to acquire control information returned by the data aggregation terminal, and transmit a data stream to the data aggregation terminal through the transmission link according to the control information returned by the data aggregation terminal, wherein the data stream includes VPVRR data blocks and image data of the image to be displayed.

19. A data transmission apparatus, comprising: processor; Memory; One or more computer program modules, the one or more computer program modules being stored in the memory and configured to be executed by the processor, the one or more computer program modules including instructions for performing the data transmission method according to any one of claims 1-17.

20. A storage medium for non-transitory storage of computer-readable instructions that, when executed by a computer, can perform the data transmission method according to any one of claims 1-17.

Images