Information transmission method and device, related equipment, storage medium and computer program product

Abstract

The application discloses an information transmission method and device, a terminal, a network platform, a storage medium and a computer program product. The method comprises the following steps: a terminal receives first information sent by a network platform, the first information comprises related information of a plurality of first blocks, the plurality of first blocks are obtained by dividing a first frame of a digital person; second information is sent to the network platform, the second information is used for indicating the number of first blocks that can be received by the terminal, the second information is associated with the capability of the terminal; one or more first blocks sent by the network platform are received, the one or more first blocks are sent by the network platform based on the second information and / or third information, and the third information represents the transmission network quality between the terminal and the network platform.

Description

Technical Field

[0001] This application relates to the field of digital human technology, and in particular to an information transmission method, apparatus, related equipment, storage medium and computer program product. Background Technology

[0002] Digital human technology can be applied to various online and offline scenarios, such as live streaming, shopping guides, video customer service, online identity verification, business consultation, and employee training. Through digital human technology, any text and / or voice content displayed on a screen can be given a lifelike human persona. For businesses, digital humans help reduce service and content production costs, improve marketing efficiency, and provide a better user experience. Many current text and voice chatbot scenarios could potentially be replaced by digital humans in the future.

[0003] However, in certain specific scenarios, the relevant technologies may not be able to effectively guarantee the real-time performance, stability, and user experience of digital human services. Summary of the Invention

[0004] To address the related technical problems, embodiments of this application provide an information transmission method, apparatus, related equipment, storage medium, and computer program product.

[0005] The technical solution of this application embodiment is implemented as follows:

[0006] This application provides an information transmission method applied to a terminal, including:

[0007] The system receives first information sent by a network platform. The first information contains information related to multiple first blocks, which are obtained by dividing the first frame of the digital human.

[0008] Send a second message to the network platform, the second message indicating the number of first blocks that the terminal can receive, the second message being associated with the terminal's capabilities;

[0009] The terminal receives one or more first blocks sent by the network platform, the one or more first blocks being sent by the network platform based on the second information and / or the third information, the third information representing the transmission network quality between the terminal and the network platform.

[0010] In the above scheme, the first information includes one or more of the following:

[0011] The spatial relationship between the plurality of first blocks;

[0012] The temporal positional relationship between the plurality of first blocks;

[0013] The fourth information for each first block, wherein the fourth information represents the importance of the corresponding first block;

[0014] The fifth information of each first block, the fifth information being used to drive the corresponding first block;

[0015] The identifier for each first block.

[0016] In the above scheme, receiving one or more first blocks sent by the network platform includes:

[0017] The network platform receives one or more first blocks and fifth information for each first block, the fifth information being used to drive the corresponding first block. The one or more first blocks and the fifth information for each first block are sent by the network platform in descending order of importance based on the multiple first blocks.

[0018] The method in the above scheme further includes:

[0019] For each received first block, the third information associated with the corresponding first block is sent to the network platform, the third information including one or more of the following:

[0020] The corresponding reception delay of the first block;

[0021] The sixth piece of information indicates whether there was packet loss in the corresponding first block;

[0022] The packet loss rate of the first block.

[0023] In the above scheme, if the third information includes the packet loss rate of the corresponding first block, the method further includes:

[0024] When the packet loss rate of the corresponding first block is greater than the first threshold, the corresponding first block repeatedly sent by the network platform is received.

[0025] This application also provides an information transmission method applied to a network platform, including:

[0026] Send first information to the terminal, the first information containing information related to multiple first blocks, the multiple first blocks being obtained by dividing the first frame of the digital human;

[0027] The terminal receives second information, which indicates the number of first blocks that the terminal can receive, and the second information is associated with the terminal's capabilities.

[0028] Based on the second information and / or the third information, one or more first blocks are sent to the terminal, wherein the third information characterizes the transmission network quality between the terminal and the network platform.

[0029] In the above scheme, the first information includes one or more of the following:

[0030] The spatial relationship between the plurality of first blocks;

[0031] The temporal positional relationship between the plurality of first blocks;

[0032] The fourth information for each first block, wherein the fourth information represents the importance of the corresponding first block;

[0033] The fifth information of each first block, the fifth information being used to drive the corresponding first block;

[0034] The identifier for each first block.

[0035] In the above scheme, sending one or more first blocks to the terminal based on the second information and / or the third information includes:

[0036] Based on the order of importance of the multiple first blocks from high to low, one or more first blocks and fifth information for each first block are sent to the terminal, wherein the fifth information is used to drive the corresponding first block; wherein,

[0037] If the first condition and / or the second condition are met, the transmission of the first block to the terminal is stopped. The first condition is met if the number of first blocks sent by the network platform is equal to the number of first blocks indicated by the second information. The second condition is met if the third information indicates that jitter has occurred in the transmission network between the terminal and the network platform.

[0038] The method in the above scheme further includes:

[0039] For each first block sent, the terminal receives the third information associated with the corresponding first block, the third information comprising one or more of the following:

[0040] The corresponding reception delay of the first block;

[0041] The sixth piece of information indicates whether there was packet loss in the corresponding first block;

[0042] The packet loss rate of the first block.

[0043] In the above scheme, if the third information includes the packet loss rate of the corresponding first block, the method further includes:

[0044] When the packet loss rate of the corresponding first block is greater than the first threshold, the corresponding first block is repeatedly sent to the terminal.

[0045] The above scheme, the method further includes one or more of the following:

[0046] Each of the plurality of first blocks is stored independently;

[0047] The fifth information of each of the plurality of first blocks is stored independently, and the fifth information is used to drive the corresponding first block;

[0048] The first information is stored independently.

[0049] This application also provides an information transmission device, including:

[0050] The first receiving unit is used to receive first information sent by the network platform. The first information includes information related to multiple first blocks, which are obtained by dividing the first frame of the digital human.

[0051] A first sending unit is configured to send second information to the network platform, the second information being used to indicate the number of first blocks that the terminal can receive, and the second information being associated with the capabilities of the terminal.

[0052] The second receiving unit is configured to receive one or more first blocks sent by the network platform, wherein the one or more first blocks are sent by the network platform based on the second information and / or the third information, wherein the third information characterizes the transmission network quality between the terminal and the network platform.

[0053] This application also provides an information transmission device, including:

[0054] The third sending unit is used to send first information to the terminal. The first information includes information related to multiple first blocks, which are obtained by dividing the first frame of the digital human.

[0055] The third receiving unit is configured to receive second information sent by the terminal, the second information being used to indicate the number of first blocks that the terminal can receive, and the second information being associated with the capabilities of the terminal.

[0056] The fourth sending unit is configured to send one or more first blocks to the terminal based on the second information and / or the third information, wherein the third information characterizes the transmission network quality between the terminal and the network platform.

[0057] This application embodiment also provides a terminal, including: a first communication interface and a first processor; wherein,

[0058] The first communication interface is used for:

[0059] The system receives first information sent by a network platform. The first information contains information related to multiple first blocks, which are obtained by dividing the first frame of the digital human.

[0060] Send a second message to the network platform, the second message indicating the number of first blocks that the terminal can receive, the second message being associated with the terminal's capabilities;

[0061] The terminal receives one or more first blocks sent by the network platform, the one or more first blocks being sent by the network platform based on the second information and / or the third information, the third information representing the transmission network quality between the terminal and the network platform.

[0062] This application embodiment also provides a network platform, including: a second communication interface and a second processor; wherein,

[0063] The second communication interface is used for:

[0064] Send first information to the terminal, the first information containing information related to multiple first blocks, the multiple first blocks being obtained by dividing the first frame of the digital human;

[0065] The terminal receives second information, which indicates the number of first blocks that the terminal can receive, and the second information is associated with the terminal's capabilities.

[0066] Based on the second information and / or the third information, one or more first blocks are sent to the terminal, wherein the third information characterizes the transmission network quality between the terminal and the network platform.

[0067] This application also provides a terminal, including: a first processor and a first memory for storing a computer program capable of running on the processor.

[0068] Wherein, when the first processor is used to run the computer program, it executes the steps of any of the above-described terminal-side methods.

[0069] This application also provides a network platform, including: a second processor and a second memory for storing computer programs capable of running on the processor.

[0070] Wherein, when the second processor is running the computer program, it executes the steps of any of the methods described above on the network platform side.

[0071] This application also provides a storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of any of the methods described above on the terminal side, or implements the steps of any of the methods described above on the network platform side.

[0072] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of any of the above-described terminal-side methods or the steps of any of the above-described network platform-side methods.

[0073] The information transmission method, apparatus, related devices, storage medium, and computer program products provided in this application embodiment include: a terminal receiving first information sent by a network platform, the first information containing related information of multiple first blocks, the multiple first blocks being obtained by dividing the first frame of a digital human; sending second information to the network platform, the second information indicating the number of first blocks that the terminal can receive, the second information being associated with the terminal's capabilities; and receiving one or more first blocks sent by the network platform, the one or more first blocks being sent by the network platform based on the second information and / or third information, the third information representing the transmission network quality between the terminal and the network platform. The solution provided in this application involves a network platform dividing each frame of the digital human (i.e., the first frame) into multiple local blocks (i.e., the first block) and sending relevant information about these local blocks (i.e., the first information) to the terminal. The terminal then reports back to the network platform the number of local blocks it supports (i.e., the number of local blocks the terminal can receive). Based on the terminal's capabilities (i.e., the number of local blocks the terminal can receive) and / or the transmission network quality between the terminal and the network platform, the network platform sends one or more local blocks to the terminal, i.e., sends some or all of the local blocks. In this way, the transmission of some or all of the local blocks of each frame of the digital human can adapt to the terminal's capabilities and / or the transmission network quality. In other words, it can achieve the transmission of some or all of the digital human's content even when the terminal's capabilities are limited and / or the transmission network quality is poor (i.e., the transmission network experiences jitter), thereby effectively ensuring the real-time performance, stability, and user experience of the digital human service. Simultaneously, the terminal and / or the network platform can achieve a partial or overall representation of each frame of the digital human based on some or all of the local blocks, i.e., it can achieve a partial or overall presentation of the digital human. Attached Figure Description

[0074] Figure 1 This is a flowchart illustrating an information transmission method according to an embodiment of this application;

[0075] Figure 2 This is a flowchart illustrating another information transmission method according to an embodiment of this application;

[0076] Figure 3 This is a schematic diagram of the structure of a digital human representation and transmission system, which is an application example of this application.

[0077] Figure 4 This is a schematic diagram of local block partitioning for a digital human, an application example of this application.

[0078] Figure 5 This is a schematic diagram of an information transmission device according to an embodiment of this application;

[0079] Figure 6 This is a schematic diagram of another information transmission device structure according to an embodiment of this application;

[0080] Figure 7 This is a schematic diagram of the terminal structure according to an embodiment of this application;

[0081] Figure 8 This is a schematic diagram of the network platform structure according to an embodiment of this application;

[0082] Figure 9 This is a schematic diagram of the information transmission system structure according to an embodiment of this application. Detailed Implementation

[0083] The present application will now be described in further detail with reference to the accompanying drawings and embodiments.

[0084] Typically, network issues are a key factor affecting the performance and user experience of digital humans during transmission. Common network problems include bandwidth limitations, network latency, packet loss, and network congestion. Insufficient bandwidth can cause stuttering and increased latency in digital humans, affecting the real-time interaction between the terminal and the network platform; network latency can increase the reaction time of digital humans, reducing the smoothness of interaction; packet loss can cause video and audio desynchronization in digital humans, impacting user experience; and network congestion can reduce data transmission speed, affecting the continuity and consistency of digital humans.

[0085] Meanwhile, digital humans may face not only network issues during transmission but also terminal compatibility problems. Specifically, due to the diverse types of devices used by users, such as smartphones, tablets, and personal computers, these devices may differ in processing power, display quality, and network connectivity, making it difficult to standardize the transmission and display effects of digital humans. In particular, differences in display effects can impact user experience; for example, high-resolution, high-frame-rate videos may display smoothly on high-performance devices but may experience stuttering and latency on low-performance devices. Furthermore, different screen sizes and resolutions of devices can also affect the visual effect of digital humans, resulting in unclear or disproportionate displays on some devices.

[0086] As can be seen from the above description, network fluctuations and terminal capabilities are key issues that need to be addressed in digital human applications, as they can directly affect the real-time performance, stability, and user experience of digital human services.

[0087] In related technologies, to improve the user experience of digital human services, multi-view videos can be generated based on multiple real-world perspectives and multiple intermediate perspectives at multiple time points. These multi-view videos are then compressed and encoded before being transmitted to the client. The client then matches the multi-view videos to a pre-defined virtual 3D space scene model, providing content where the dynamic digital human avatar displays target clothing within the virtual 3D space scene, and offering interactive effects to simulate continuous perspective switching. Alternatively, the digital human terminal can receive instruction information from a digital human display device; based on the instruction information, a real-time transmission rate can be determined; where the real-time transmission rate is the ratio of the time from data production to data transmission to the duration of the data itself; and based on the real-time transmission rate, digital human audio and video data can be transmitted.

[0088] However, the above solution may have the following problems:

[0089] Question 1: The solution based on adjusting the real-time transmission rate of the terminal takes into account the impact of the terminal display refresh rate and adjusts the transmission rate on the network side to match the terminal. However, it does not take into account the terminal's display resolution, computing power and other terminal requirements, and it cannot adapt to network fluctuation scenarios.

[0090] Question 2: Although the multi-view generation solution provides interactive effects for switching perspectives, it is still unable to adapt to network fluctuation scenarios and does not take into account the terminal capability requirements.

[0091] Question 3: The above solution focuses on the presentation of digital humans but does not consider the protection of interactive information between the terminal and the network platform. When the network fluctuates, it may not only affect the playback of digital humans but also cause the interaction between the terminal and the network platform to fail, thus making it impossible to carry out digital human services.

[0092] In summary, in certain specific scenarios, such as when terminal capabilities are limited and / or network fluctuations occur, how to ensure the interaction between the terminal and the network platform, i.e., how to effectively guarantee the real-time performance, stability, and user experience of digital human services, is an urgent problem to be solved.

[0093] Based on this, in various embodiments of this application, the network platform divides each frame of the digital human into multiple local blocks and sends relevant information of multiple local blocks to the terminal. The terminal reports back to the network platform the number of local blocks it supports (i.e., the number of local blocks the terminal can receive). Based on the terminal's capabilities (i.e., the number of local blocks the terminal can receive) and / or the transmission network quality between the terminal and the network platform, the network platform sends one or more local blocks to the terminal, i.e., sends some or all local blocks. In this way, the transmission of some or all local blocks of each frame of the digital human can adapt to the terminal's capabilities and / or the transmission network quality. In other words, it can achieve the transmission of some or all of the digital human's content even when the terminal's capabilities are limited and / or the transmission network quality is poor (i.e., the transmission network experiences jitter, which can also be understood as network fluctuation), thereby effectively ensuring the real-time performance, stability, and user experience of the digital human service. At the same time, the terminal and / or the network platform can realize the partial or overall representation of each frame of the digital human based on some or all local blocks of each frame, i.e., it can realize the partial or overall presentation of the digital human.

[0094] Specifically, embodiments of this application provide an information transmission method applied to a terminal, such as... Figure 1 As shown, the method includes:

[0095] Step 101: Receive first information sent by the network platform. The first information contains information related to multiple first blocks, which are obtained by dividing the first frame of the digital human.

[0096] Step 102: Send second information to the network platform, the second information being used to indicate the number of first blocks that the terminal can receive, and the second information being associated with the capabilities of the terminal;

[0097] Step 103: Receive one or more first blocks sent by the network platform, wherein the one or more first blocks are sent by the network platform based on the second information and / or the third information, wherein the third information characterizes the transmission network quality between the terminal and the network platform.

[0098] In practical applications, the terminal may specifically include a digital human terminal, such as a smartphone, tablet computer, or personal computer. Alternatively, the terminal may also be referred to as user equipment (UE) or simply as a user. It is understood that this application does not limit the specific type or name of the terminal, as long as its functionality is achieved.

[0099] In practical applications, the network platform can also be referred to as a network node, etc. Furthermore, the network platform can specifically include a cloud platform, an edge platform, etc. The cloud platform can also be referred to as a digital human platform, a cloud node, etc., and the edge platform can also be referred to as a digital human edge platform, an edge node, etc. It is understood that this application embodiment does not limit the specific name and type of the network platform, as long as its functionality is achieved.

[0100] In practical applications, the first frame can be understood as any frame of the digital human, or as each frame of the digital human. Additionally, the first frame can also be called a video frame, etc. This application does not limit the specific name of the first frame in its embodiments, as long as its function is achieved.

[0101] In practical applications, the network platform can divide the first frame to obtain the multiple first blocks, i.e., at least two first blocks. It can be understood that the multiple first blocks can form a complete first frame. Furthermore, the first block can also be called a local block, etc. This application embodiment does not limit the specific name of the first block, as long as its function is implemented. Here, the specific method by which the network platform divides the first frame can also be set as needed, and this application embodiment does not limit this. For example, the network platform can divide the first frame in two-dimensional (2D) space or 3D space to obtain the multiple first blocks. Simultaneously, the network platform can use a four-screen, nine-grid, pyramid, or other arbitrary shape division method to divide the first frame.

[0102] In practical applications, after the network platform divides the first frame to obtain the plurality of first blocks, it can generate relevant information about the plurality of first blocks to determine the first information.

[0103] The first information may include one or more of the following (i.e., the first information may include at least one of the following):

[0104] The spatial relationship between the plurality of first blocks;

[0105] The temporal positional relationship between the plurality of first blocks;

[0106] The fourth information for each first block, wherein the fourth information represents the importance of the corresponding first block;

[0107] The fifth information of each first block, the fifth information being used to drive the corresponding first block;

[0108] The identifier (such as ID) for each first block.

[0109] In practical applications, the spatial positional relationship may include the coordinate information of each first block, such as the 2D coordinates and 3D coordinates of at least one specific endpoint (i.e., one or more specific endpoints) of each first block. Additionally, the spatial positional relationship may also include the shape information of each first block, such as one or more of the length, width, and height values ​​of each first block (i.e., at least one of length, width, and height values). It can be understood that, based on the spatial positional relationship between the multiple first blocks, the terminal and / or network platform can combine the multiple first blocks to obtain the first frame. Furthermore, the specific manifestation of the spatial positional relationship can be associated with the specific method by which the network platform divides the first frame. For example, when the network platform divides the first frame in 2D space using a nine-grid method, it can obtain 9 first blocks. The spatial positional relationship between these 9 first blocks can specifically include the coordinates of the upper left corner of each first block on the X-axis, as well as the length and width of each first block. When the network platform divides the first frame in 3D space using a four-screen method, it can obtain 8 first blocks. The spatial positional relationship between these 8 first blocks can specifically include the coordinates of the upper left corner of each first block on the X-axis, as well as the length, width, and height of each first block.

[0110] In practical applications, the temporal positional relationship between the multiple first blocks can include frame information corresponding to each first block, such as the identifier of the first frame (e.g., ID). It can be understood that, based on the temporal positional relationship between the multiple first blocks, the terminal and / or network platform can determine which frame of the digital human each first block belongs to, that is, determine the first frame corresponding to each first block.

[0111] In practical applications, during the process of determining the first information, the network platform can encode the plurality of first blocks, that is, determine the identifier of each first block, and establish the association between the identifier of each first block, the spatial positional relationship between the plurality of first blocks, and the temporal positional relationship between the plurality of first blocks. Thus, the identifier of each first block can be used to characterize the spatial and temporal positional relationships between the plurality of first blocks. For example, the terminal and / or the network platform can determine the spatial and temporal positional relationships between the plurality of first blocks based on the arrangement order of the identifiers of each first block. Furthermore, the specific method by which the network platform encodes the plurality of first blocks can be set as needed, and this application embodiment does not limit this. For example, after dividing the first frame to obtain the plurality of first blocks, the network platform can use zigzag scanning encoding or undirected graph encoding, etc., to encode the plurality of first blocks to obtain the identifier of each first block, for example, determining that the encoding of 5 first blocks is 1 to 5.

[0112] In practical applications, the specific form of the fourth information can be set as needed, and this application embodiment does not limit this. For example, the importance of the corresponding first block can be represented by an integer within a specific range. The larger the integer, the higher the importance of the corresponding first block; the smaller the integer, the lower the importance of the corresponding first block. For instance, for five first blocks, the importance can be determined from high to low as 100, 90, 80, 60, and 50. Furthermore, the importance of each first block can be manually set based on experience, business scenarios, etc., or set by the network platform using a specific algorithm. For example, the importance of the first block used to present the digital human's head can be higher than the importance of the first block used to present the digital human's feet; furthermore, in a business scenario of teaching users to play the piano, the importance of the first block used to present the digital human's hands can be the highest.

[0113] In practical applications, the fifth information can also be called driving information, driving data, etc. This application embodiment does not limit the specific name of the fifth information, as long as its function is achieved. It can be understood that by utilizing the fifth information of each first block, the terminal and / or network platform can independently drive the corresponding first block, that is, achieve independent representation of the first block, or independently present the first block.

[0114] In practical applications, the first information can also be understood as the encoded data structure of the plurality of first blocks. The network platform can store the first information independently, that is, the network platform can store the first information as an independent file. The specific format of this file can be set as needed, and this embodiment does not limit this. Furthermore, the network platform can store each of the plurality of first blocks independently, that is, the network platform can store each first block as an independent file. The specific format of this file can be set as needed, and this embodiment does not limit this. The network platform can also store the fifth information of each of the plurality of first blocks independently, that is, the network platform can store the fifth information of each first block as an independent file. The specific format of this file can be set as needed, and this embodiment does not limit this.

[0115] In practical applications, the network platform can transmit the first information in real time, meaning the network platform can send the first information for each first frame (i.e., each frame of the digital human) to the terminal individually. Alternatively, the network platform can transmit the first information periodically (which can also be understood as transmitting the first information in batches), meaning the network platform can send multiple pieces of first information corresponding to multiple first frames (i.e., multiple frames of the digital human) within a specific time range to the terminal at once.

[0116] In practical applications, the second information is associated with the capabilities of the terminal, meaning that the terminal can determine the number of first blocks it can receive based on its own capabilities, i.e., determine the number of first blocks the terminal can support. The specific algorithm corresponding to this process can be preset on the terminal as needed, and this application embodiment does not limit this. The capabilities of the terminal may include computing power (also understood as computing power or processing power), storage capacity, communication capabilities, etc., and may also include display effects (i.e., display capabilities) such as screen size, resolution, and frame rate.

[0117] In practical applications, "one or more first blocks" refers to at least one first block, and "multiple first blocks" refers to at least two first blocks. The terminal receiving one or more first blocks sent by the network platform can be understood as the terminal receiving some or all of the first blocks from multiple first blocks obtained by the network platform dividing the first frame. Specifically, when the terminal receives a portion of the first blocks, it can achieve a local representation of the first frame based on the portion of the first blocks, i.e., it can achieve a local presentation of the digital human; when the terminal receives all the first blocks, it can achieve a holistic representation of the first frame based on all the first blocks, i.e., it can achieve a holistic presentation of the digital human.

[0118] In practical applications, the network platform can send one or more first blocks to the terminal based on the second information and / or the third information. When sending each first block to the terminal, the network platform can also send the fifth information of each first block to the terminal.

[0119] Based on this, in one embodiment, receiving one or more first blocks sent by the network platform may include:

[0120] The network platform receives one or more first blocks and the fifth information of each first block, wherein the one or more first blocks and the fifth information of each first block are sent by the network platform in descending order of importance of the multiple first blocks.

[0121] Specifically, in practical applications, the network platform can send one or more first blocks and fifth information for each first block to the terminal based on the order of importance of the multiple first blocks from high to low; wherein, under the condition of satisfying a first condition and / or a second condition, the network platform can stop sending the first blocks to the terminal, the first condition being satisfied includes the number of first blocks sent by the network platform being equal to the number of first blocks indicated by the second information, and the second condition being satisfied includes the third information indicating that jitter has occurred in the transmission network between the terminal and the network platform.

[0122] Here, it can be understood that the network platform needs to determine whether the current digital human transmission satisfies the first and second conditions before sending each first block.

[0123] The process by which the network platform determines whether the current digital human transmission meets the first condition can also be understood as determining whether the transmission of the current frame's digital human content is complete based on the number of supportable first blocks (i.e., the second information) fed back by the terminal. In other words, when the number of first blocks sent by the network platform equals the number of first blocks indicated by the second information, the network platform can determine that the transmission of the current frame's digital human content is complete and can stop sending the first block to the terminal. The network platform stopping sending the first block to the terminal means stopping sending the first block of the current first frame to the terminal. That is, after the network platform stops sending the first block to the terminal, it can start sending the next frame to the terminal, i.e., sending the first information and / or the first block of the next first frame.

[0124] The process by which the network platform determines whether the current digital human transmission meets the second condition can also be understood as determining whether jitter has occurred in the transmission network between the terminal and the network platform. Jitter in the transmission network can also be understood as network fluctuations, specifically caused by factors such as bandwidth limitations, network latency, packet loss, and network congestion. The network platform can determine whether jitter has occurred in the transmission network based on some specific known information. Alternatively, to further ensure the real-time performance of the digital human service, the terminal can send the third information associated with each first block to the network platform after receiving it, such as reception latency, packet loss, and packet loss rate.

[0125] Based on this, in one embodiment, the method may further include:

[0126] For each received first block, the third information associated with the corresponding first block is sent to the network platform, the third information comprising one or more of the following (i.e., comprising at least one of the following):

[0127] The corresponding reception delay of the first block;

[0128] The sixth piece of information indicates whether there was packet loss in the corresponding first block;

[0129] The packet loss rate of the first block.

[0130] In practical applications, when the third information includes the reception delay of the corresponding first block, during the process of the network platform determining whether the current digital human transmission meets the second condition, the network platform can determine whether the cumulative delay of the current first frame transmission is too large based on the reception delay of each first block of the current first frame. For example, the cumulative delay can be compared with the delay corresponding to the digital human frame rate pre-set or calculated; or, the network platform can compare the reception delay of the corresponding first block with the average transmission delay of the first block pre-set or calculated. When the cumulative delay or the reception delay of the corresponding first block is greater than a specific threshold (this threshold can be denoted as the second threshold, and the specific size of the second threshold can be set as needed), the network platform can determine that the second condition is met, stop sending the first block to the terminal, that is, stop sending the first block of the current first frame to the terminal, and can start sending the first information and / or the first block of the next first frame to the terminal.

[0131] In practical applications, considering that the number of the first block indicated by the second information must be greater than 0, in order to improve the transmission efficiency of the digital human, the network platform can directly start sending the first block with the highest importance and the fifth information of the first block to the terminal before receiving the second information, at the same time as, before or after sending the first information to the terminal.

[0132] In practical applications, when the third information contains the packet loss rate of the corresponding first block, if the packet loss rate of the corresponding first block is greater than a preset specific threshold (which can be referred to as the first threshold in the following description), the network platform can repeatedly send the corresponding first block to the terminal.

[0133] Based on this, in one embodiment, if the third information contains the packet loss rate of the corresponding first block, the method may further include:

[0134] When the packet loss rate of the corresponding first block is greater than the first threshold, the corresponding first block repeatedly sent by the network platform is received.

[0135] In practical applications, the specific size of the first threshold can be preset as needed, and this application embodiment does not limit this.

[0136] Accordingly, embodiments of this application also provide an information transmission method applied to a network platform, such as... Figure 2 As shown, the method includes:

[0137] Step 201: Send first information to the terminal. The first information contains information related to multiple first blocks, which are obtained by dividing the first frame of the digital human.

[0138] Step 202: Receive second information sent by the terminal, the second information being used to indicate the number of first blocks that the terminal can receive, and the second information being associated with the capabilities of the terminal;

[0139] Step 203: Based on the second information and / or the third information, send one or more first blocks to the terminal, wherein the third information characterizes the transmission network quality between the terminal and the network platform.

[0140] In one embodiment, sending one or more first blocks to the terminal based on the second information and / or the third information may include:

[0141] Based on the order of importance of the multiple first blocks from high to low, one or more first blocks and fifth information for each first block are sent to the terminal, wherein the fifth information is used to drive the corresponding first block; wherein,

[0142] If the first condition and / or the second condition are met, the transmission of the first block to the terminal is stopped. The first condition is met if the number of first blocks sent by the network platform is equal to the number of first blocks indicated by the second information. The second condition is met if the third information indicates that jitter has occurred in the transmission network between the terminal and the network platform.

[0143] In one embodiment, the method may further include:

[0144] For each first block sent, the terminal receives the third information associated with the corresponding first block, the third information comprising one or more of the following:

[0145] The corresponding reception delay of the first block;

[0146] The sixth piece of information indicates whether there was packet loss in the corresponding first block;

[0147] The packet loss rate of the first block.

[0148] In one embodiment, if the third information contains the packet loss rate of the corresponding first block, the method may further include:

[0149] When the packet loss rate of the corresponding first block is greater than the first threshold, the corresponding first block is repeatedly sent to the terminal.

[0150] In one embodiment, the method may further include one or more of the following:

[0151] Each of the plurality of first blocks is stored independently;

[0152] The fifth information of each of the plurality of first blocks is stored independently, and the fifth information is used to drive the corresponding first block;

[0153] The first information is stored independently.

[0154] It should be noted that the specific processing procedures of the network platform have been detailed above and will not be repeated here.

[0155] The information transmission method provided in this application embodiment includes: a terminal receiving first information sent by a network platform, the first information containing related information of multiple first blocks, the multiple first blocks being obtained by dividing the first frame of a digital human; sending second information to the network platform, the second information indicating the number of first blocks that the terminal can receive, the second information being associated with the terminal's capabilities; and receiving one or more first blocks sent by the network platform, the one or more first blocks being sent by the network platform based on the second information and / or third information, the third information representing the transmission network quality between the terminal and the network platform. The solution provided in this application involves a network platform dividing each frame of the digital human (i.e., the first frame) into multiple local blocks (i.e., the first block) and sending relevant information about these local blocks (i.e., the first information) to the terminal. The terminal then reports back to the network platform the number of local blocks it supports (i.e., the number of local blocks the terminal can receive). Based on the terminal's capabilities (i.e., the number of local blocks the terminal can receive) and / or the transmission network quality between the terminal and the network platform, the network platform sends one or more local blocks to the terminal, i.e., sends some or all of the local blocks. In this way, the transmission of some or all of the local blocks of each frame of the digital human can adapt to the terminal's capabilities and / or the transmission network quality. In other words, it can achieve the transmission of some or all of the digital human's content even when the terminal's capabilities are limited and / or the transmission network quality is poor (i.e., the transmission network experiences jitter, which can also be understood as network fluctuations), thereby effectively ensuring the real-time performance, stability, and user experience of the digital human service. At the same time, the terminal and / or the network platform can realize the local or overall representation of each frame of the digital human based on some or all of the local blocks of each frame, i.e., it can realize the local or overall presentation of the digital human.

[0156] Furthermore, the solution provided in this application embodiment can adapt to terminals with different capabilities and networks with different conditions because the transmission of part or all local blocks of each frame of the digital human can be adapted to the terminal capabilities and / or transmission network quality. It can also realize flexible transmission of the digital human between the network platform and the terminal.

[0157] The following section provides a more detailed description of this application with reference to application examples.

[0158] This application example provides a digital human representation and transmission system that supports both local and global representations, such as... Figure 3 As shown, the system may include modules such as digital human local block partitioning, local block encoding, local block file generation, information transmission interaction and discrimination, encoding and local block transmission, and information feedback.

[0159] Based on the above system, this application example also provides a digital human representation method, including the following steps:

[0160] Step 1: The digital human local block partitioning module in the digital human cloud platform / edge platform (i.e., the network platform mentioned above) divides the digital human into multiple local blocks (i.e., the first block mentioned above) and sets the importance of each local block;

[0161] Here, the division can be carried out in 2D space or 3D space, and can adopt a division method of four-screen, nine-square grid, pyramid or other arbitrary shape;

[0162] Step 2: The local block encoding module in the digital human cloud platform / edge platform encodes the local blocks;

[0163] Here, the encoding (i.e., the identifier of the first block mentioned above) can represent the spatial and temporal positional relationship between local blocks. The encoding method can include zigzag scanning encoding or undirected graph encoding, etc.

[0164] Step 3: The local block file generation module in the digital human cloud platform / edge platform independently stores the digital human content of the local blocks;

[0165] Step 4: The local block file generation module in the digital human cloud platform / edge platform independently stores the driving information (i.e., the fifth information mentioned above) corresponding to the digital human in the local block;

[0166] Step 5: The encoding and local block transmission module in the digital human cloud platform / edge platform generates the encoded data structure (i.e., the first information mentioned above);

[0167] Here, the encoded data structure may include the encoding order (i.e., the order in which the identifiers of each first block are arranged) and the importance of the corresponding local block (i.e., the fourth information mentioned above), driving information (i.e., the fifth information mentioned above), etc.; in addition, the encoding and local block transmission module can store the encoded data structure independently.

[0168] In practical applications, steps 2, 3, and 4 in the digital human representation method provided in this application example may not have a sequential execution relationship.

[0169] Based on the above system, this application example also provides a digital human transmission method, including the following steps:

[0170] Step 1: The encoding and local block transmission module in the digital human cloud platform / edge platform reads the digital human encoding data structure (i.e., the first information mentioned above) and sends the digital human encoding data structure to the terminal;

[0171] Step 2: Based on the importance of local blocks, the encoding and local block transmission module sends the digital human local block with the highest importance, along with the corresponding driving information, to the terminal;

[0172] Step 3: After receiving the digital human encoding data structure, the terminal, based on its own capabilities, feeds back the number of digital human local blocks that the terminal can support to the transmission information interaction judgment module in the digital human cloud platform / edge platform, that is, feeds back the second information mentioned above.

[0173] Step 4: After receiving the digital human partial block, the terminal feeds back information such as reception delay, whether there is packet loss in the partial block, and packet loss rate to the transmission information interaction judgment module, that is, feeds back the third information mentioned above.

[0174] Step 5: The information transmission interaction judgment module determines whether to continue sending partial blocks based on the terminal's feedback information such as latency and packet loss (i.e., the third information mentioned above);

[0175] Here, if the delay is too large (for example, comparing the cumulative delay of the local block with the delay corresponding to the digital human frame rate, or comparing the current local block delay with the average transmission delay of the local blocks), the encoding and local block transmission module stops transmitting the digital human content of the current frame and jumps to the next frame content, that is, it transmits the encoded data structure of the next frame (i.e., the first information mentioned above) and / or the local block; if the packet loss is too large (the digital human cloud platform / edge platform can set a threshold as needed), the encoding and local block transmission module repeatedly transmits the current digital human local block;

[0176] Step 6: The information transmission interaction judgment module determines whether the transmission of the digital human content of the current frame has been completed based on the number of supportable digital human local blocks fed back by the terminal (i.e., the second information mentioned above).

[0177] In practical applications, steps 4, 5, and 6 of the digital human transmission method provided in this application example can be executed after each digital human local block transmission, and steps 5 and 6 can be executed in parallel.

[0178] The following is combined with Figure 4 A frame of the digital human shown describes in detail the digital human representation method provided in this application example, which may include:

[0179] Step 1: As Figure 4As shown, a frame of the digital human (i.e., the first frame mentioned above) is divided into 5 local blocks (i.e., the first block mentioned above). The importance of the local blocks (i.e., the fourth information mentioned above) is set to 100, 90, 80, 60 and 50 respectively, resulting in 5 rectangular local blocks.

[0180] Step 2: Encode the local block;

[0181] Specifically, the encoding of the five local blocks (i.e., the identifier of the first block mentioned above) can be from 1 to 5. The encoding order can represent the spatial and temporal positional relationship between the local blocks. The spatial positional relationship can include the top-left corner coordinates of the local block, such as (0, 0, 250, 100), and can also include the length and width values ​​of the local block. For 3D images, the spatial positional relationship can include the 3D coordinates of the top-left corner and the length, width, and height values ​​of the local block. In addition, the encoding can adopt a zigzag scanning method, that is, encoding from top to bottom and from left to right.

[0182] Step 3: Store the digital human content of each local block independently;

[0183] Specifically, the five local blocks of the digital human can be stored as five separate digital human files, and there are no special requirements for the file format.

[0184] Step 4: Store the driving information (i.e., the fifth information mentioned above) corresponding to the digital human in the local block independently;

[0185] Specifically, the driving information of the five local blocks of the digital human can be stored as five digital human driving files, and there are no special requirements for the file format.

[0186] Step 5: Generate the encoded data structure (i.e., the first information mentioned above);

[0187] Here, the digital human cloud platform / edge platform can write digital human local block 1 "1, (0, 0, 250, 100), 100" to digital human local block 5 "5, (0, 250, 250, 250), 50" into an encoded data structure and store the encoded data structure as an independent file. There are no special requirements for the file format.

[0188] The following is combined with Figure 4 A frame of the digital human shown in this application example provides a detailed description of the digital human transmission method, which may include:

[0189] Step 1: The digital human cloud platform / edge platform reads the digital human encoded data structure (i.e., the first information mentioned above), that is, reads digital human local block 1 "1, (0, 0, 250, 100), 100" to digital human local block 5 "5, (0, 250, 250, 250), 50", and sends the encoded data structure to the terminal.

[0190] Step 2: Based on the importance of the local block, the digital human cloud platform / edge platform sends the digital human local block with the highest importance to the terminal, that is, sends digital human local block 1 "1, (0, 0, 250, 100), 100", and the corresponding driving information (i.e. the fifth information mentioned above).

[0191] Step 3: After receiving the digital human coding data structure, the terminal, based on its own capabilities, feeds back to the digital human cloud platform / edge platform the number of digital human local blocks that the terminal can support (i.e., the second information mentioned above);

[0192] Here, we assume that the terminal screen size is limited and can only receive 1 to 4 local blocks, that is, the number of digital human local blocks that the terminal can support is 4.

[0193] Step 4: After receiving the digital human partial block 1, the terminal sends information to the platform, such as the reception delay, whether there is packet loss in the partial block, and the packet loss rate (i.e., the third information mentioned above).

[0194] Here, it is assumed that the transmission network quality of local block 1 is good, the delay is 5 milliseconds (ms), and the packet loss is 0;

[0195] Step 5: The digital human cloud platform / edge platform receives the number of receptive local blocks from the terminal, which is 4.

[0196] Step 6: The digital human cloud platform / edge platform receives the latency and packet loss rate of partial block 1 from the terminal and determines whether 4 partial blocks have been sent. If not, it continues to send partial blocks. Meanwhile, assuming the latency of partial block 1 is 5ms and the average local block latency is 5ms, the estimated latency for sending the next data block is 5ms, which is less than the remaining latency margin of 35ms corresponding to the digital human frame rate of 25. At the same time, it determines that the packet loss of partial block 1 is 0, which is less than the threshold (i.e., the first threshold mentioned above). Then, it continues to send the second partial block.

[0197] Step 7: After receiving the digital human partial block 2, the terminal sends back information to the platform, such as the reception delay, whether there is packet loss in the partial block, and the packet loss rate (i.e., the third information mentioned above).

[0198] Here, it is assumed that the transmission network of local block 2 experiences jitter, with a delay of 7ms and a packet loss rate of 60%.

[0199] Step 8: The digital human cloud platform / edge platform receives the latency and packet loss rate of partial block 2 from the terminal and determines whether 4 partial blocks have been sent. If not, it continues to send partial blocks. Meanwhile, assuming the latency of partial block 2 is 7ms, the cumulative latency is 12ms, the average local block latency is 6ms, and the expected latency of sending the data block is 6ms, which is less than the remaining latency margin of 28ms corresponding to the digital human frame rate of 25. At the same time, it is determined that the packet loss of partial block 2 is 60%, which is greater than the threshold (i.e., the first threshold mentioned above), indicating that there is a problem with the playback of partial block 2 on the terminal. Therefore, the second partial block is sent repeatedly.

[0200] Step 9: After the terminal receives the digital human partial block 2 again, it sends information to the platform such as reception delay, whether there is packet loss in the partial block, and packet loss rate (i.e., the third information mentioned above).

[0201] Here, we assume that the delay for local block 2 to be received again is 10ms and the packet loss rate is 3%;

[0202] Step 10: The digital human cloud platform / edge platform receives the latency and packet loss rate of retransmitting partial block 2 from the terminal and determines whether 4 partial blocks have been transmitted. If not, it continues to transmit partial blocks. Meanwhile, assuming the latency of retransmitting partial block 2 is 10ms, the cumulative latency is 22ms, the average partial block latency is about 7ms, and the expected latency of continuing to transmit data blocks is 7ms, which is less than the remaining latency margin of 18ms corresponding to the digital human frame rate of 25. At the same time, it is determined that the packet loss of retransmitting partial block 2 is 3%, which is less than the threshold (i.e., the first threshold mentioned above), so it continues to transmit the 3rd partial block.

[0203] Step 11: After receiving the digital human partial block 3, the terminal sends back information to the platform, such as the reception delay, whether there is packet loss in the partial block, and the packet loss rate (i.e., the third information mentioned above).

[0204] Here, we assume that the delay of receiving local block 3 is 15ms and the packet loss rate is 5%;

[0205] Step 12: The digital human cloud platform / edge platform receives the latency and packet loss rate of local block 3 from the terminal and determines whether 4 local blocks have been sent. If not, it continues to send local blocks. Meanwhile, assuming the latency of local block 3 is 15ms, the cumulative latency is 37ms, the average local block latency is 9ms, and the expected latency of continuing to send data blocks is 9ms, which is greater than the remaining latency margin of 3ms corresponding to the digital human frame rate of 25, the current frame transmission is stopped, and the transmission is moved to the next frame of the digital human, that is, the encoded data structure and / or local blocks of the next frame are sent.

[0206] The solution provided in this application example can independently represent and transmit each key part of the digital human model, and can also independently represent and transmit digital human driving information. This enables flexible transmission of digital humans between the digital human cloud platform / edge platform and the terminal, while adapting to different network conditions and terminals with different capabilities. In other words, it can achieve digital human content transmission even under network fluctuations or terminal limitations, effectively ensuring the real-time performance, stability, and user experience of digital human services.

[0207] To implement the terminal-side method of this application embodiment, this application embodiment also provides an information transmission device, which is installed on the terminal, such as... Figure 5 As shown, the device includes:

[0208] The first receiving unit 501 is used to receive first information sent by the network platform. The first information includes information related to a plurality of first blocks, which are obtained by dividing the first frame of the digital human.

[0209] The first sending unit 502 is used to send second information to the network platform, the second information being used to indicate the number of first blocks that the terminal can receive, and the second information being associated with the capabilities of the terminal.

[0210] The second receiving unit 503 is configured to receive one or more first blocks sent by the network platform, wherein the one or more first blocks are sent by the network platform based on the second information and / or the third information, wherein the third information characterizes the transmission network quality between the terminal and the network platform.

[0211] In one embodiment, the second receiving unit 503 is specifically used to receive the one or more first blocks and the fifth information of each first block sent by the network platform. The fifth information is used to drive the corresponding first block. The one or more first blocks and the fifth information of each first block are sent by the network platform based on the order of importance of the multiple first blocks from high to low.

[0212] In one embodiment, such as Figure 5 As shown, the device may further include:

[0213] The second sending unit 504 is configured to send the third information associated with the corresponding first block to the network platform for each received first block, the third information including one or more of the following:

[0214] The corresponding reception delay of the first block;

[0215] The sixth piece of information indicates whether there was packet loss in the corresponding first block;

[0216] The packet loss rate of the first block.

[0217] In one embodiment, when the third information includes the packet loss rate of the corresponding first block, the second receiving unit 503 is further configured to receive the corresponding first block repeatedly sent by the network platform when the packet loss rate of the corresponding first block is greater than a first threshold.

[0218] The functions of the first receiving unit 501, the first sending unit 502, the second receiving unit 503, and the second sending unit 504 are equivalent to the functions of the information transmission feedback module in the above application example.

[0219] In practical applications, the first receiving unit 501, the first sending unit 502, the second receiving unit 503, and the second sending unit 504 can be implemented by the communication interface in the information transmission device.

[0220] To implement the network platform-side method of this application embodiment, this application embodiment also provides an information transmission device, which is set on the network platform, such as... Figure 6 As shown, the device includes:

[0221] The third sending unit 601 is used to send first information to the terminal. The first information includes information related to a plurality of first blocks, which are obtained by dividing the first frame of the digital human.

[0222] The third receiving unit 602 is configured to receive second information sent by the terminal, the second information being used to indicate the number of first blocks that the terminal can receive, and the second information being associated with the capabilities of the terminal.

[0223] The fourth sending unit 603 is used to send one or more first blocks to the terminal based on the second information and / or the third information, wherein the third information characterizes the transmission network quality between the terminal and the network platform.

[0224] In one embodiment, the fourth sending unit 603 is specifically used to send one or more first blocks and fifth information for each first block to the terminal based on the order of importance of the plurality of first blocks from high to low. The fifth information is used to drive the corresponding first block.

[0225] The fourth sending unit 603 stops sending the first block to the terminal when the first condition and / or the second condition are met. The first condition is met when the number of first blocks sent by the network platform is equal to the number of first blocks indicated by the second information. The second condition is met when the third information indicates that jitter has occurred in the transmission network between the terminal and the network platform.

[0226] In one embodiment, such as Figure 6 As shown, the device may further include:

[0227] The fourth receiving unit 604 is configured to receive, for each transmitted first block, the third information associated with the corresponding first block sent by the terminal, wherein the third information includes one or more of the following:

[0228] The corresponding reception delay of the first block;

[0229] The sixth piece of information indicates whether there was packet loss in the corresponding first block;

[0230] The packet loss rate of the first block.

[0231] In one embodiment, if the third information contains the packet loss rate of the corresponding first block, the fourth sending unit 603 is further configured to repeatedly send the corresponding first block to the terminal when the packet loss rate of the corresponding first block is greater than a first threshold.

[0232] In one embodiment, such as Figure 6 As shown, the device may further include:

[0233] Storage unit 605 is used to perform one or more of the following operations:

[0234] Each of the plurality of first blocks is stored independently;

[0235] The fifth information of each of the plurality of first blocks is stored independently, and the fifth information is used to drive the corresponding first block;

[0236] The first information is stored independently.

[0237] The functions of the third sending unit 601, the third receiving unit 602, the fourth sending unit 603, and the fourth receiving unit 604 are equivalent to some of the functions of the encoding and local block transmission module in the above application example; the functions of the storage unit 605 are equivalent to some of the functions of the local block encoding module, the local block file generation module, and the encoding and local block transmission module in the above application example.

[0238] In practical applications, the third sending unit 601, the third receiving unit 602, the fourth sending unit 603, and the fourth receiving unit 604 can be implemented by the communication interface in the information transmission device; the storage unit 605 can be implemented by the processor in the information transmission device.

[0239] It should be noted that the information transmission device provided in the above embodiments is only illustrated by the division of the above program modules. In actual applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the device can be divided into different program modules (such as the information transmission feedback module in the above application example, or the local block encoding module, local block file generation module, encoding and local block transmission module in the above application example) to complete all or part of the processing described above. In addition, the information transmission device and information transmission method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0240] Based on the hardware implementation of the above program modules, and in order to implement the terminal-side method of the embodiments of this application, the embodiments of this application also provide a terminal, such as... Figure 7 As shown, the terminal 700 includes:

[0241] The first communication interface 701 is capable of exchanging information with a network platform and / or other terminals;

[0242] The first processor 702 is connected to the first communication interface 701 to enable information interaction with the network platform and / or other terminals, and to execute the methods provided by one or more of the above-mentioned terminal-side technical solutions when running computer programs;

[0243] The computer program is stored in the first memory 703.

[0244] Specifically, the first communication interface 701 is used for:

[0245] The system receives first information sent by a network platform. The first information contains information related to multiple first blocks, which are obtained by dividing the first frame of the digital human.

[0246] Send a second message to the network platform, the second message being used to indicate the number of first blocks that the terminal 700 can receive, the second message being associated with the capabilities of the terminal 700;

[0247] The terminal 700 receives one or more first blocks sent by the network platform, the one or more first blocks being sent by the network platform based on the second information and / or the third information, the third information representing the transmission network quality between the terminal 700 and the network platform.

[0248] In one embodiment, the first communication interface 701 is further configured to receive one or more first blocks and fifth information of each first block sent by the network platform, wherein the fifth information is used to drive the corresponding first block, and the one or more first blocks and the fifth information of each first block are sent by the network platform in descending order of importance of the multiple first blocks.

[0249] In one embodiment, the first communication interface 701 is further configured to send, for each received first block, the third information associated with the corresponding first block to the network platform, the third information including one or more of the following:

[0250] The corresponding reception delay of the first block;

[0251] The sixth piece of information indicates whether there was packet loss in the corresponding first block;

[0252] The packet loss rate of the first block.

[0253] In one embodiment, when the third information includes the packet loss rate of the corresponding first block, the first communication interface 701 is further configured to receive the corresponding first block repeatedly sent by the network platform when the packet loss rate of the corresponding first block is greater than a first threshold.

[0254] It should be noted that the specific processing procedure of the first communication interface 701 can be understood by referring to the above method, and will not be repeated here.

[0255] Of course, in practical applications, the various components in terminal 700 are coupled together through bus system 704. It can be understood that bus system 704 is used to implement communication between these components. In addition to a data bus, bus system 704 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 7 The general designated all buses as Bus System 704.

[0256] The first memory 703 in this embodiment is used to store various types of data to support the operation of the terminal 700. Examples of such data include any computer program used to operate on the terminal 700.

[0257] The methods disclosed in the above embodiments of this application can be applied to the first processor 702, or implemented by the first processor 702. The first processor 702 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware or by instructions in the form of software in the first processor 702. The first processor 702 may be a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The first processor 702 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the methods disclosed in the embodiments of this application can be directly manifested as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium, which is located in the first memory 703. The first processor 702 reads the information in the first memory 703 and completes the steps of the aforementioned method in combination with its hardware.

[0258] In an exemplary embodiment, terminal 700 may be implemented by one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic components to perform the aforementioned method.

[0259] Based on the hardware implementation of the above program modules, and in order to implement the method on the network platform side of this application embodiment, this application embodiment also provides a network platform, such as... Figure 8 As shown, the network platform 800 includes:

[0260] The second communication interface 801 is capable of exchanging information with terminals and / or other network platforms;

[0261] The second processor 802 is connected to the second communication interface 801 to enable information interaction with the terminal and / or other network platforms, and to execute the methods provided by one or more technical solutions on the network platform side when running computer programs;

[0262] The computer program is stored in the second memory 803.

[0263] Specifically, the second communication interface 801 is used for:

[0264] Send first information to the terminal, the first information containing information related to multiple first blocks, the multiple first blocks being obtained by dividing the first frame of the digital human;

[0265] The terminal receives second information, which indicates the number of first blocks that the terminal can receive, and the second information is associated with the terminal's capabilities.

[0266] Based on the second information and / or the third information, one or more first blocks are sent to the terminal, wherein the third information characterizes the transmission network quality between the terminal and the network platform 800.

[0267] In one embodiment, the second communication interface 801 is further configured to send one or more first blocks and fifth information for each first block to the terminal based on a descending order of importance, wherein the fifth information is used to drive the corresponding first block; wherein,

[0268] The second communication interface 801 stops sending the first block to the terminal when the first condition and / or the second condition are met. The first condition is met when the number of first blocks sent by the network platform 800 is equal to the number of first blocks indicated by the second information. The second condition is met when the third information indicates that jitter has occurred in the transmission network between the terminal and the network platform 800.

[0269] In one embodiment, the second communication interface 801 is further configured to receive, for each first block sent, the third information sent by the terminal associated with the corresponding first block, the third information comprising one or more of the following:

[0270] The corresponding reception delay of the first block;

[0271] The sixth piece of information indicates whether there was packet loss in the corresponding first block;

[0272] The packet loss rate of the first block.

[0273] In one embodiment, if the third information includes the packet loss rate of the corresponding first block, the second communication interface 801 is further configured to repeatedly send the corresponding first block to the terminal when the packet loss rate of the corresponding first block is greater than a first threshold.

[0274] In one embodiment, the second processor 802 may be used to perform one or more of the following:

[0275] Each of the plurality of first blocks is stored independently in the second memory 803;

[0276] The fifth information of each of the plurality of first blocks is stored independently in the second memory 803, and the fifth information is used to drive the corresponding first block;

[0277] The first information is stored independently in the second memory 803.

[0278] It should be noted that the specific processing procedures of the second communication interface 801 and the second processor 802 can be understood by referring to the above method, and will not be repeated here.

[0279] Of course, in practical applications, the various components in the network platform 800 are coupled together through the bus system 804. It can be understood that the bus system 804 is used to implement communication between these components. In addition to the data bus, the bus system 804 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 8 The general labeled all buses as Bus System 804.

[0280] The second memory 803 in this embodiment is used to store various types of data to support the operation of the network platform 800. Examples of such data include any computer program used to operate on the network platform 800.

[0281] The methods disclosed in the embodiments of this application can be applied to the second processor 802, or implemented by the second processor 802. The second processor 802 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware or by instructions in the form of software in the second processor 802. The second processor 802 may be a general-purpose processor, a DSP, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The second processor 802 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the methods disclosed in the embodiments of this application can be directly manifested as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium, which is located in the second memory 803. The second processor 802 reads the information in the second memory 803 and completes the steps of the aforementioned method in combination with its hardware.

[0282] In an exemplary embodiment, the network platform 800 may be implemented by one or more ASICs, DSPs, PLDs, CPLDs, FPGAs, general-purpose processors, controllers, MCUs, microprocessors, or other electronic components to perform the aforementioned method.

[0283] It is understood that the memories (first memory 703, second memory 803) in the embodiments of this application can be volatile memories or non-volatile memories, or both. Non-volatile memories can be read-only memories (ROM), programmable read-only memories (PROM), erasable programmable read-only memories (EPROM), electrically erasable programmable read-only memories (EEPROM), magnetic random access memories (FRAM), flash memories, magnetic surface memories, optical discs, or compact disc read-only memories (CD-ROM); magnetic surface memories can be disk storage or magnetic tape storage. Volatile memories can be random access memories (RAM), which are used as external caches. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), SyncLink Dynamic Random Access Memory (SLDRAM), and Direct Rambus Random Access Memory (DRRAM).The memories described in the embodiments of this application are intended to include, but are not limited to, these and any other suitable types of memories.

[0284] To implement the method provided in the embodiments of this application, the embodiments of this application also provide an information transmission system, such as... Figure 9 As shown, the system includes: terminal 901 and network platform 902.

[0285] It should be noted that the specific processing procedures of the terminal 901 and the network platform 902 have been described in detail above and will not be repeated here.

[0286] In an exemplary embodiment, this application also provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, such as a first memory 703 storing a computer program, which can be executed by a first processor 702 of a terminal 700 to complete the steps described in any of the aforementioned terminal-side methods. Another example is a second memory 803 storing a computer program, which can be executed by a second processor 802 of a network platform 800 to complete the steps described in any of the aforementioned network platform-side methods. The computer-readable storage medium can be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disc, or CD-ROM.

[0287] In an exemplary embodiment, this application also provides a computer program product, including a computer program that can be executed by a first processor 702 of a terminal 700 to complete the steps of any of the aforementioned terminal-side methods; or, the computer program can be executed by a second processor 802 of a network platform 800 to complete the steps of any of the aforementioned network platform-side methods.

[0288] It should be noted that terms such as "first" and "second" are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0289] Furthermore, the technical solutions described in the embodiments of this application can be combined arbitrarily without conflict.

[0290] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application.

Claims

1. An information transmission method, characterized in that, Applied to terminals, including: The system receives first information sent by a network platform. The first information includes information related to multiple first blocks, which are obtained by dividing the first frame of the digital human in two-dimensional or three-dimensional space. The first information includes: the spatial positional relationship between the multiple first blocks, the temporal positional relationship between the multiple first blocks, fourth information for each first block, and fifth information for each first block. The fourth information represents the importance of the corresponding first block, and the fifth information is used to drive the corresponding first block. Send a second message to the network platform, the second message indicating the number of first blocks that the terminal can receive, the second message being associated with the terminal's capabilities; The terminal receives one or more first blocks sent by the network platform, the one or more first blocks being sent by the network platform based on the second information and / or the third information, the third information representing the transmission network quality between the terminal and the network platform; the transmission network quality corresponds to the network conditions.

2. The method according to claim 1, characterized in that, The first information also includes: The identifier for each first block.

3. The method according to claim 1, characterized in that, The receipt of one or more first blocks sent by the network platform includes: The network platform receives one or more first blocks and fifth information for each first block, the fifth information being used to drive the corresponding first block. The one or more first blocks and the fifth information for each first block are sent by the network platform in descending order of importance based on the multiple first blocks.

4. The method according to claim 3, characterized in that, The method further includes: For each received first block, the third information associated with the corresponding first block is sent to the network platform, the third information including one or more of the following: The corresponding reception delay of the first block; The sixth piece of information indicates whether there was packet loss in the corresponding first block; The packet loss rate of the first block.

5. The method according to claim 4, characterized in that, If the third information includes the packet loss rate of the corresponding first block, the method further includes: When the packet loss rate of the corresponding first block is greater than the first threshold, the corresponding first block repeatedly sent by the network platform is received.

6. An information transmission method, characterized in that, Applied to network platforms, including: Send first information to the terminal. The first information includes information related to multiple first blocks, which are obtained by dividing the first frame of the digital human in two-dimensional or three-dimensional space. The first information includes: the spatial positional relationship between the multiple first blocks, the temporal positional relationship between the multiple first blocks, the fourth information of each first block, and the fifth information of each first block. The fourth information represents the importance of the corresponding first block, and the fifth information is used to drive the corresponding first block. The terminal receives second information, which indicates the number of first blocks that the terminal can receive, and the second information is associated with the terminal's capabilities. Based on the second information and / or the third information, one or more first blocks are sent to the terminal, wherein the third information characterizes the transmission network quality between the terminal and the network platform; the transmission network quality corresponds to the network conditions.

7. The method according to claim 6, characterized in that, The first information also includes: The identifier for each first block.

8. The method according to claim 6, characterized in that, The step of sending one or more first blocks to the terminal based on the second information and / or the third information includes: Based on the order of importance of the multiple first blocks from high to low, one or more first blocks and fifth information for each first block are sent to the terminal, wherein the fifth information is used to drive the corresponding first block; wherein, If the first condition and / or the second condition are met, the transmission of the first block to the terminal is stopped. The first condition is met if the number of first blocks sent by the network platform is equal to the number of first blocks indicated by the second information. The second condition is met if the third information indicates that jitter has occurred in the transmission network between the terminal and the network platform.

9. The method according to claim 8, characterized in that, The method further includes: For each first block sent, the terminal receives the third information associated with the corresponding first block, the third information comprising one or more of the following: The corresponding reception delay of the first block; The sixth piece of information indicates whether there was packet loss in the corresponding first block; The packet loss rate of the first block.

10. The method according to claim 9, characterized in that, If the third information includes the packet loss rate of the corresponding first block, the method further includes: When the packet loss rate of the corresponding first block is greater than the first threshold, the corresponding first block is repeatedly sent to the terminal.

11. The method according to any one of claims 6 to 10, characterized in that, The method also includes one or more of the following: Each of the plurality of first blocks is stored independently; The fifth information of each of the plurality of first blocks is stored independently, and the fifth information is used to drive the corresponding first block; The first information is stored independently.

12. An information transmission device, characterized in that, include: A first receiving unit is configured to receive first information sent by a network platform. The first information includes information related to multiple first blocks, which are obtained by dividing the first frame of a digital human in two-dimensional or three-dimensional space. The first information includes: the spatial positional relationship between the multiple first blocks, the temporal positional relationship between the multiple first blocks, fourth information of each first block, and fifth information of each first block. The fourth information represents the importance of the corresponding first block, and the fifth information is used to drive the corresponding first block. A first sending unit is configured to send second information to the network platform, the second information being used to indicate the number of first blocks that the terminal can receive, and the second information being associated with the capabilities of the terminal. The second receiving unit is configured to receive one or more first blocks sent by the network platform, wherein the one or more first blocks are sent by the network platform based on the second information and / or the third information, wherein the third information characterizes the transmission network quality between the terminal and the network platform; The quality of the transmission network corresponds to the network conditions.

13. An information transmission device, characterized in that, include: The third sending unit is used to send first information to the terminal. The first information includes relevant information of multiple first blocks, which are obtained by dividing the first frame of the digital human in two-dimensional or three-dimensional space. The first information includes: the spatial positional relationship between the multiple first blocks, the temporal positional relationship between the multiple first blocks, the fourth information of each first block, and the fifth information of each first block. The fourth information represents the importance of the corresponding first block, and the fifth information is used to drive the corresponding first block. The third receiving unit is configured to receive second information sent by the terminal, the second information being used to indicate the number of first blocks that the terminal can receive, and the second information being associated with the capabilities of the terminal. The fourth sending unit is configured to send one or more first blocks to the terminal based on the second information and / or the third information, wherein the third information characterizes the transmission network quality between the terminal and the network platform; The quality of the transmission network corresponds to the network conditions.

14. A terminal, characterized in that, include: A first communication interface and a first processor; wherein... The first communication interface is used for: The system receives first information sent by a network platform. The first information includes information related to multiple first blocks, which are obtained by dividing the first frame of the digital human in two-dimensional or three-dimensional space. The first information includes: the spatial positional relationship between the multiple first blocks, the temporal positional relationship between the multiple first blocks, fourth information for each first block, and fifth information for each first block. The fourth information represents the importance of the corresponding first block, and the fifth information is used to drive the corresponding first block. Send a second message to the network platform, the second message indicating the number of first blocks that the terminal can receive, the second message being associated with the terminal's capabilities; The terminal receives one or more first blocks sent by the network platform, the one or more first blocks being sent by the network platform based on the second information and / or the third information, the third information representing the transmission network quality between the terminal and the network platform; the transmission network quality corresponds to the network conditions.

15. A network platform, characterized in that, include: The second communication interface and the second processor; wherein... The second communication interface is used for: Send first information to the terminal. The first information includes information related to multiple first blocks, which are obtained by dividing the first frame of the digital human in two-dimensional or three-dimensional space. The first information includes: the spatial positional relationship between the multiple first blocks, the temporal positional relationship between the multiple first blocks, the fourth information of each first block, and the fifth information of each first block. The fourth information represents the importance of the corresponding first block, and the fifth information is used to drive the corresponding first block. The terminal receives second information, which indicates the number of first blocks that the terminal can receive, and the second information is associated with the terminal's capabilities. Based on the second information and / or the third information, one or more first blocks are sent to the terminal, wherein the third information characterizes the transmission network quality between the terminal and the network platform; the transmission network quality corresponds to the network conditions.

16. A terminal, characterized in that, include: A first processor and a first memory for storing computer programs capable of running on the processor. Wherein, when the first processor is used to run the computer program, it performs the steps of the method according to any one of claims 1 to 5.

17. A network platform, characterized in that, include: A second processor and a second memory for storing computer programs that can run on the processor. Wherein, when the second processor is used to run the computer program, it performs the steps of the method according to any one of claims 6 to 11.

18. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 5, or the steps of the method according to any one of claims 6 to 11.

19. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 5, or the steps of the method according to any one of claims 6 to 11.

Images