Data communication method and device, communication equipment, readable storage medium and program product

Abstract

The invention relates to a data communication method and device, communication equipment, a readable storage medium and a program product. The method comprises the steps that a basic digital human image is sent to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on digital human metadata to obtain a digital human media stream, and the basic digital human image corresponds to a target digital human identifier. By adopting the method, the reliability of applying digital human communication to perform communication can be improved.

Description

Technical Field

[0001] The present application relates to the field of wireless communication technology, and in particular to a data communication method, apparatus, communication equipment, readable storage medium and program product. Background Art

[0002] Through the development of Internet Protocol (IP) Multimedia Subsystem (IMS) data channel technology, the fifth generation mobile communication technology (5G) calls have brought more innovative business experiences to users. Displaying the user's virtual digital human image during a call is a key scenario for future applications. Based on the user's own appearance features, a digital human image of different styles is customized. During the call, the terminal captures the information of voice, expression, and action to achieve real-time synchronization of the digital human image.

[0003] However, in traditional technologies, when users use digital humans for communication, they are limited by application scenarios, which reduces the reliability of digital human communication. Summary of the invention

[0004] Based on this, it is necessary to provide a data communication method, apparatus, communication equipment, readable storage medium and program product to address the above technical problems, so as to improve the reliability of communication using digital human communication.

[0005] A data communication method, the method being applied to a server, the method comprising:

[0006] The basic digital human image is sent to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, wherein the basic digital human image corresponds to the target digital human identifier.

[0007] In one embodiment, the terminal is a calling terminal, and the method further includes:

[0008] If the calling terminal meets the preset rendering conditions, a basic digital human image is sent to the calling terminal, so that the calling terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and sends the digital human media stream to the called terminal through a first communication channel for decoding processing to obtain a digital human image, and displays the digital human image on the called terminal. The first communication channel is a communication channel between the calling terminal and the called terminal.

[0009] In one embodiment, the terminal is a called terminal, and the method further includes:

[0010] If the called terminal meets the preset rendering conditions, a basic digital human image is sent to the called terminal, so that the called terminal renders the basic digital human image based on the digital human metadata, obtains a digital human media stream, determines the digital human media stream as a digital human image, and displays the digital human image. The digital human metadata is sent from the calling terminal to the called terminal through the first communication channel.

[0011] In one embodiment, the method further comprises:

[0012] If the network terminal meets the preset rendering conditions, a basic digital human image is sent to the network terminal, so that the network terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and sends the digital human media stream to the called terminal for decoding processing to obtain a digital human image, and displays the digital human image on the called terminal.

[0013] In one of the embodiments, the first communication channel is a real-time transport protocol RTP or an application data channel ADC.

[0014] In one embodiment, the method further comprises:

[0015] receiving a target request sent by the calling terminal, wherein the target request carries the target digital person identifier;

[0016] Based on the correspondence between the digital human identifier and the basic digital human image, the basic digital human image corresponding to the target digital human identifier is obtained.

[0017] In one of the embodiments, the target request is a rendering request or an animation request.

[0018] In one embodiment, the method further comprises:

[0019] Determine the rendering capabilities of the target communication device;

[0020] Determine the relationship between the rendering capability of the target communication device and the preset conditions, and determine the rendering capability negotiation result of the target communication device, wherein the rendering capability negotiation result represents whether the target communication device meets the preset rendering conditions, and the target communication device includes one or more of the calling terminal, the called terminal or the network terminal.

[0021] In one embodiment, the rendering request also carries a rendering capability identifier, and the method further includes:

[0022] Based on the rendering capability identifier, it is determined whether the calling terminal, the called terminal or the network terminal meets the preset rendering condition.

[0023] A data communication method, the method being applied to a terminal, the method comprising:

[0024] Receiving a basic digital human image sent by a server, wherein the basic digital human image corresponds to a target digital human identifier;

[0025] The basic digital human image is rendered based on the digital human metadata to obtain a digital human media stream.

[0026] In one embodiment, the terminal is a calling terminal, and the method further includes:

[0027] A first communication channel is established with the called terminal, and a target request is sent to the server, wherein the target request is used by the server to determine the basic digital human image.

[0028] In one of the embodiments, the target request is a rendering request or an animation request.

[0029] In one of the embodiments, the first communication channel is a real-time transport protocol RTP or an application data channel ADC.

[0030] In one embodiment, the method further comprises:

[0031] The digital human media stream is sent to the called terminal based on the first communication channel, so that the called terminal decodes the digital human media stream to obtain a digital human image, and displays the digital human image.

[0032] In one embodiment, the terminal is a called terminal, and the method further includes:

[0033] The digital human metadata is received, which is sent by the calling terminal through the first communication channel.

[0034] In one embodiment, the method further comprises:

[0035] The digital human media stream is determined as the digital human image, and the digital human image is displayed.

[0036] In one embodiment, the method further comprises:

[0037] The rendering capability is sent to the server, where the rendering capability is used by the server to determine whether the terminal meets a preset rendering condition.

[0038] In one of the embodiments, the rendering request carries the target digital human identifier, and the target digital human identifier is used by the server to obtain the basic digital human image corresponding to the target digital human identifier based on the correspondence between the digital human identifier and the basic digital human image.

[0039] In one of the embodiments, the rendering request carries a rendering capability identifier, and the rendering capability identifier is used by the server to determine whether the calling terminal, the called terminal or the network terminal meets a preset rendering condition.

[0040] A data communication method, the method being applied to a network end, the method comprising:

[0041] Receiving a basic digital human image sent by a server, wherein the basic digital human image corresponds to a target digital human identifier;

[0042] The basic digital human image is rendered based on the digital human metadata to obtain a digital human media stream.

[0043] In one embodiment, the rendering of the basic digital human image based on the digital human metadata to obtain the digital human media stream includes:

[0044] The digital human metadata sent by the calling terminal is received, and the basic digital human image is rendered based on the digital human metadata to obtain a digital human media stream.

[0045] In one embodiment, the method further comprises:

[0046] The digital human media stream is sent to the called terminal, so that the called terminal decodes the digital human media stream to obtain the digital human image, and displays the digital human image.

[0047] In one embodiment, the method further comprises:

[0048] A second communication channel is established with the called terminal, and a third communication channel is established with the calling terminal.

[0049] In one of the embodiments, the second communication channel is used to anchor the audio and video stream of the called terminal to the network end; the third communication channel is used to anchor the audio and video stream of the calling terminal to the network end.

[0050] In one embodiment, the second communication channel is RTP or ADC; the third communication channel is RTP or ADC.

[0051] In one embodiment, the receiving digital personal data sent by the calling terminal includes:

[0052] The digital personal data sent by the calling terminal is received through the third communication channel.

[0053] In one embodiment, the sending of the digital human media stream to the called terminal includes:

[0054] The digital human media stream is sent to the called terminal through the second communication channel.

[0055] In one embodiment, the method further comprises:

[0056] The rendering capability is sent to the server, where the rendering capability is used by the server to determine whether the network terminal meets a preset rendering condition.

[0057] In one embodiment, the method further comprises:

[0058] A fourth communication channel is established with the server, wherein the fourth communication channel is used to determine the network end.

[0059] A data communication device, the device is applied to a server, and the device comprises:

[0060] The sending module is used to send a basic digital human image to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and the basic digital human image corresponds to the target digital human identifier.

[0061] A data communication device, the device is applied to a terminal, and the device comprises:

[0062] A first receiving module, configured to receive a basic digital human image sent by a server, wherein the basic digital human image corresponds to a target digital human identifier;

[0063] The first rendering module is used to render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0064] A data communication device, the device is applied to a network end, the device comprises:

[0065] A second receiving module is used to receive a basic digital human image sent by the server, wherein the basic digital human image corresponds to the target digital human identifier;

[0066] The second rendering module is used to render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0067] A communication device, characterized in that it comprises: a transmitter;

[0068] The transmitter is used to send a basic digital human image to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and the basic digital human image corresponds to the target digital human identifier.

[0069] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the following steps:

[0070] The basic digital human image is sent to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, wherein the basic digital human image corresponds to the target digital human identifier.

[0071] A computer program product includes a computer program, wherein when the computer program is executed by a processor, the data communication method provided in the embodiment of the present application is implemented, and the method may be:

[0072] The basic digital human image is sent to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, wherein the basic digital human image corresponds to the target digital human identifier.

[0073] The above-mentioned data communication method, apparatus, communication equipment, storage medium and computer program product obtain a digital human media stream by sending the basic digital human image to a terminal or a network end for rendering. The basic digital human image can be rendered at the terminal or the network end, thereby realizing digital human communication in multiple rendering modes and improving the availability and reliability of digital human communication services. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0075] Figure 1 A diagram of an application environment of a digital communication method in one embodiment;

[0076] Figure 2 is a flow chart of a digital communication method in one embodiment;

[0077] Figure 3 is a flow chart of a digital communication method in one embodiment;

[0078] Figure 4 is a flow chart of a digital communication method in one embodiment;

[0079] Figure 5 is a signaling interaction flow chart of a data communication method in one embodiment;

[0080] Figure 6 is a signaling interaction flow chart of a data communication method in one embodiment;

[0081] Figure 7 is a signaling interaction flow chart of a data communication method in one embodiment;

[0082] Figure 8 is a signaling interaction flow chart of a data communication method in one embodiment;

[0083] Fig. 9 is a structural block diagram of a data communication device in one embodiment;

[0084] Fig.10 is a structural block diagram of a data communication device in one embodiment;

[0085] Fig.11 is a structural block diagram of a data communication device in one embodiment;

[0086] Fig.12 FIG. 4 is a diagram showing the internal structure of a communication device in one embodiment. DETAILED DESCRIPTION

[0087] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0088] Figure 1 A schematic diagram of an application scenario of a data communication method provided in an embodiment of the present application. Figure 1 As shown, in this scenario, there are a terminal 100, a server 200, and a network terminal 300. The terminal 100 includes a calling terminal 101 and a called terminal 102. The calling terminal 101 can perform data transmission with the called terminal 102. The calling terminal 101 can perform data transmission with the server 200 and the network terminal 300, and the called terminal 102 can perform data transmission with the server 200 and the network terminal 300.

[0089] This scenario can be applied to an IP Multimedia Subsystem (IMS). The server 200 can be an application server (AS), and the network end 300 can be a media function MF (MediaFunction). The MF can include a media gateway (MGW), a media server (such as a server providing IVR or conference services), etc., and is responsible for processing media streams, such as voice, video, and data streams.

[0090] The calling terminal 101 and the called terminal 102 may be wireless terminals, which may be devices that provide voice and / or other service data connectivity to users, or handheld devices with wireless connection functions, or other processing devices connected to wireless modems. The wireless terminal may communicate with one or more core networks via a radio access network (Radio Access Network, referred to as RAN). The wireless terminal may be a mobile terminal, such as a mobile phone (or "cellular" phone) and a computer with a mobile terminal, for example, a portable, pocket-sized, handheld, computer-built-in or vehicle-mounted mobile device, which exchanges language and / or data with the radio access network. The wireless terminal may also be referred to as a system, a subscriber unit, a subscriber station, a mobile station, a mobile station, a remote station, a remote terminal, an access terminal, a user terminal, a user agent, a user device or user equipment, which is not limited here.

[0091] It should be noted that the beneficial effects brought about by the embodiments of the present application or the technical problems solved are not limited to this one, but may also include other implicit or related problems. For details, please refer to the description of the following embodiments.

[0092] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0093] In one embodiment, Figure 2 As shown, a data communication method is provided, which is applied to Figure 1 The server in the example is used to illustrate the following steps:

[0094] Step 201: Send a basic digital human image to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0095] The basic digital human image corresponds to the target digital human identifier. The basic digital human image may include basic appearance features, such as shape, facial lines, gender, etc. The target digital human identifier may represent the target user and the scene in which the target user is located. The digital human metadata may be data such as the user's voice, face, body posture or movement. The digital human media stream may be a data stream including video, audio, and digital human appearance features.

[0096] Specifically, when the user establishes a voice and video session at the terminal, the server can send the basic digital human image to the terminal or the network. The terminal can render the basic digital human image through the digital human metadata to obtain a digital human media stream, or the network can render the basic digital human image through the digital human metadata to obtain a digital human data stream. The specific rendering method can be rendered by a preset rendering engine. No specific limitation is made here.

[0097] The above data communication method obtains a digital human media stream by sending the basic digital human image to a terminal or a network end for rendering, and can render the basic digital human image on the terminal or the network end, thereby realizing digital human communication in multiple rendering modes and improving the availability and reliability of digital human communication services.

[0098] In one embodiment, the data communication method further includes:

[0099] If the calling terminal meets the preset rendering conditions, the basic digital human image is sent to the calling terminal, so that the calling terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and sends the digital human media stream to the called terminal through the first communication channel for decoding and processing to obtain the digital human image, and displays the digital human image on the called terminal.

[0100] The terminal is a calling terminal, the preset rendering condition may be satisfying a preset rendering capability and / or a rendering capability identifier, the first communication channel is a communication channel between the calling terminal and the called terminal, and the rendering capability may be a digital human rendering capability.

[0101] Specifically, the server can determine whether the terminal or the network terminal meets the preset rendering condition according to the rendering capability and / or the rendering capability identifier. If the rendering capability of the calling terminal meets the preset rendering capability and / or the rendering capability identifier, the server determines that the calling terminal meets the preset rendering condition and sends the basic digital human image to the calling terminal. The calling terminal can capture the digital human metadata of the user. The calling terminal can render the basic digital human image based on the digital human metadata to obtain a digital human media stream. The calling terminal can encode the rendered basic digital human image to obtain a digital human media stream. The calling terminal can send the digital human media stream to the called terminal through the first communication channel. The called terminal can decode the digital human media to obtain the digital human image. The decoding process specifically adopted by the called terminal can be video decoding and / or audio decoding, and the digital human image in the digital human media stream can be restored by decoding the video and audio. The called terminal can display the digital human image, and the user can see the appearance, expression and action of the digital human on the screen of the called terminal.

[0102] In this embodiment, if the calling terminal meets the preset rendering condition, the basic digital human image is rendered at the calling terminal to obtain the digital human media stream, thereby achieving the rendering of the basic digital human image at the calling terminal.

[0103] In one embodiment, the data communication method further includes:

[0104] If the called terminal meets the preset rendering conditions, the basic digital human image is sent to the called terminal, so that the called terminal renders the basic digital human image based on the digital human metadata, obtains the digital human media stream, determines the digital human media stream as the digital human image, and displays the digital human image.

[0105] The terminal is a called terminal, and the digital human data is sent from the calling terminal to the called terminal through the first communication channel.

[0106] Specifically, if the rendering capability of the called terminal meets the preset rendering capability and / or rendering capability identifier, the server determines that the called terminal meets the preset rendering condition and sends the basic digital human image to the called terminal. The called terminal can receive the digital human metadata sent by the calling terminal through the first communication channel. The called terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, determines the digital human media stream as a digital human image, and displays the digital human image. The user can see the appearance, expression, and action of the digital human on the screen of the called terminal.

[0107] In this embodiment, by determining whether the called terminal meets the preset rendering condition, the basic digital human image is rendered at the called terminal to obtain the digital human media stream, thereby achieving the rendering of the basic digital human image at the called terminal.

[0108] In one embodiment, the data communication method further includes:

[0109] If the network terminal meets the preset rendering conditions, the basic digital human image is sent to the network terminal, so that the network terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and sends the digital human media stream to the called terminal for decoding processing to obtain the digital human image, and displays the digital human image on the called terminal.

[0110] Specifically, if the rendering capability of the network terminal meets the preset rendering capability and / or rendering capability identifier, the server determines that the called terminal meets the preset rendering condition and sends the basic digital human image to the called terminal. The network terminal can receive the digital human metadata sent by the calling terminal. The network terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream. The network terminal can encode the rendered basic digital human image to obtain a digital human media stream. The network terminal can send the digital human media stream to the called terminal, and the called terminal decodes the digital human media stream to obtain the digital human image. The specific decoding process adopted by the called terminal can be video decoding and / or audio decoding, and the digital human image in the digital human media stream is restored by video decoding and audio decoding. The called terminal can display the digital human image.

[0111] In this embodiment, by determining whether the server meets the preset rendering conditions, the basic digital human image is rendered on the server, thereby achieving the rendering of the basic digital human image on the server.

[0112] In one embodiment, the first communication channel is a real-time transport protocol (RTP) or an application data channel (ADC).

[0113] Among them, ADC can be an application data channel from person to application (P2A).

[0114] Specifically, the calling terminal can send an INVITE request (re-INVITE) in the established dialogue with the called terminal, add media descriptions related to digital human communication, and establish end-to-end communication with the called terminal. The calling terminal and the called terminal can establish a first communication channel. If the basic digital human image is rendered at the called terminal, the calling terminal can send digital human metadata to the called terminal via RTP or ADC. If the basic digital human image is rendered at the calling terminal, the calling terminal can send the digital human media stream to the called terminal via RTP or ADC.

[0115] In this embodiment, the efficiency of data transmission can be improved and the delay can be reduced by using the real-time transport protocol or the application data channel.

[0116] In one embodiment, the data communication method further includes:

[0117] Receive a target request sent by a calling terminal; based on the correspondence between the digital human identifier and the basic digital human image, obtain the basic digital human image corresponding to the target digital human identifier.

[0118] The target request carries the target digital person identification.

[0119] Specifically, the server may receive a target request sent by a calling terminal. The server may store the correspondence between the digital human identifier and the basic digital human image in a basic digital human library in advance. The server may obtain the basic digital human image corresponding to the target digital human identifier from the basic digital human library according to the target digital human identifier in the target request. The basic digital human library may be a network element for storing the basic digital human image.

[0120] In this embodiment, the basic digital human image is determined through the target request sent by the calling terminal, so that the network end obtains the basic digital human image and sends the corresponding basic digital human image to the terminal or the network end.

[0121] In one embodiment, the target request is a rendering request or an animation request.

[0122] Specifically, the server may receive a rendering request or an animation request sent by the calling terminal. The server may receive the rendering request or the animation request to obtain a basic digital human image corresponding to the target data human identifier.

[0123] In one embodiment, the data communication method further includes:

[0124] Determine the rendering capability of the target communication device; judge the relationship between the rendering capability of the target communication device and the preset conditions, and determine the rendering capability negotiation result of the target communication device.

[0125] The rendering capability may be determined by one or more of the terminal capability, user selection, and business policy. The rendering capability negotiation result indicates whether the target communication device meets the preset rendering condition, and the target communication device includes one or more of the calling terminal, the called terminal, or the network terminal. The preset condition may be a rendering condition, which may be determined by the condition satisfied by the rendering basic data human image.

[0126] Specifically, the server can determine the rendering capability of the calling terminal based on the terminal capability, user selection, and business policy. The server can determine the rendering capability negotiation result of the calling terminal based on the relationship between the calling terminal and the preset conditions. If the calling terminal meets the preset conditions, the rendering capability negotiation result of the calling terminal is to determine the calling terminal as the rendering subject; otherwise, the calling terminal cannot be determined as the rendering subject.

[0127] The server can determine the rendering capability of the called terminal based on the terminal capability, user selection, and business policy. The server can determine the rendering capability negotiation result of the called terminal based on the relationship between the called terminal and the preset conditions. If the called terminal meets the preset conditions, the rendering capability negotiation result of the called terminal is to determine the called terminal as the rendering subject; otherwise, the called terminal cannot be determined as the rendering subject.

[0128] The server can determine the rendering capability of the network terminal based on user selection or business policy. The server can determine the rendering capability negotiation result of the network terminal based on the relationship between the network terminal and the preset conditions. If the network terminal meets the preset conditions, the rendering capability negotiation result of the network terminal is to determine the network terminal as the rendering subject; otherwise, the network terminal cannot be determined as the rendering subject.

[0129] In this embodiment, the capability negotiation is performed on the rendering capability of the target device to determine the capability negotiation result, so as to determine the rendering subject according to the rendering capability, thereby realizing digital human communication in multiple rendering modes.

[0130] In one embodiment, the data communication method further includes:

[0131] Based on the rendering capability identifier, determine whether the calling terminal, the called terminal or the network terminal meets the preset rendering condition.

[0132] The rendering request may also carry a rendering capability identifier, and the rendering capability identifier may be determined based on a user selection or a rendering capability negotiation result.

[0133] Specifically, the server may identify the rendering capability identifier in the rendering request, and determine whether the calling terminal, the called terminal, or the network terminal meets the preset rendering condition based on the rendering subject specified in the rendering capability identifier.

[0134] In this embodiment, it is determined based on the rendering capability identifier whether the calling terminal, the called terminal or the network terminal meets the preset rendering condition, thereby realizing digital human communication in multiple rendering modes.

[0135] In one embodiment, Figure 3 As shown, a data communication method is provided, which is applied to Figure 1 The terminal in is used as an example to illustrate, including the following steps:

[0136] Step 301: Receive a basic digital human image sent by a server.

[0137] The basic digital human image corresponds to the target digital human identifier. The basic digital human image may include basic appearance features, such as shape, facial lines, gender, etc. The target digital human identifier may represent the target user and the scene in which the target user is located.

[0138] Specifically, if the terminal meets the preset rendering conditions, the terminal is used as the rendering subject, and the terminal can receive the basic digital human image sent by the server.

[0139] Step 302: Render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0140] The digital human metadata may be data such as the user's voice, face, body posture or movement, etc. The digital human media stream may be a data stream including video, audio and digital human appearance features.

[0141] Specifically, the terminal can identify or obtain digital human metadata. The terminal can render the basic digital human image according to the digital human metadata to obtain a digital human media stream.

[0142] The above data communication method obtains a digital human media stream by sending the basic digital human image to the terminal for rendering, and can render the basic digital human image at the terminal, thereby realizing digital human communication in multiple rendering modes and improving the availability and reliability of digital human communication services.

[0143] In one embodiment, the data communication method further includes:

[0144] A first communication channel is established with the called terminal, and a target request is sent to the server.

[0145] Among them, the terminal is a calling terminal, and the target request is used by the server to determine the basic digital human image.

[0146] Specifically, the calling terminal can send an INVITE request (re-INVITE) in the dialogue that has been established with the called terminal, add media descriptions related to digital human communication, and establish end-to-end communication with the called terminal. The calling terminal and the called terminal can establish a first communication channel. The calling terminal can send a target request to the server, carrying the target digital human identifier in the target request. The server can pre-store the correspondence between the digital human identifier and the basic digital human image in the basic digital human library. The server can obtain the basic digital human image corresponding to the target digital human identifier from the basic digital human library based on the target digital human identifier in the target request. The basic digital human library can store network elements for the basic digital human image.

[0147] In this embodiment, the basic digital human image is determined through the target request sent by the calling terminal, so that the network end obtains the basic digital human image and sends the corresponding basic digital human image to the terminal or the network end.

[0148] In one embodiment, the target request is a rendering request or an animation request.

[0149] Specifically, the calling terminal may send a rendering request or an animation request to the server. The server may receive the rendering request or the animation request to obtain a basic digital human image corresponding to the target data human identifier.

[0150] In one embodiment, the first communication channel is a real-time transport protocol RTP or an application data channel ADC.

[0151] Among them, ADC can be an application data channel from person to application (P2A).

[0152] Specifically, the calling terminal can send an INVITE request (re-INVITE) in the established dialogue with the called terminal, add media descriptions related to digital human communication, and establish end-to-end communication with the called terminal. The calling terminal and the called terminal can establish a first communication channel. If the basic digital human image is rendered at the called terminal, the calling terminal can send digital human metadata to the called terminal via RTP or ADC. If the basic digital human image is rendered at the calling terminal, the calling terminal can send the digital human media stream to the called terminal via RTP or ADC.

[0153] In this embodiment, the efficiency of data transmission can be improved and the delay can be reduced by using the real-time transport protocol or the application data channel.

[0154] In one embodiment, the data communication method further includes:

[0155] The digital human media stream is sent to the called terminal based on the first communication channel, so that the called terminal decodes the digital human media stream to obtain the digital human image, and displays the digital human image.

[0156] Specifically, the calling terminal can send the digital human media stream to the called terminal through the first communication channel. The called terminal can decode the digital human media to obtain the digital human image. The decoding process specifically adopted by the called terminal can be video decoding and / or audio decoding, and the digital human image in the digital human media stream can be restored by video decoding and audio decoding. The called terminal can display the digital human image, and the user can see the appearance, expression and action of the digital human on the screen of the called terminal.

[0157] In this embodiment, the digital human media stream is transmitted through the first communication channel, which improves the accuracy and reliability of the data transmission process. The called terminal performs decoding processing to obtain the digital human image, which ensures the smooth playback of the media stream and improves the application experience of digital human communication.

[0158] In one embodiment, the data communication method further includes:

[0159] The digital personal data sent by the calling terminal through the first communication channel is received.

[0160] Among them, the terminal is the called terminal.

[0161] Specifically, if the called terminal meets the preset rendering condition, the server can send a rendering response to the calling terminal, and the calling terminal captures the digital human metadata based on the rendering response. The called terminal can receive the digital human metadata sent by the calling terminal through the first communication channel, and the called terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0162] In this embodiment, by determining whether the called terminal meets the preset rendering condition, the basic digital human image is rendered at the called terminal to obtain the digital human media stream, thereby achieving the rendering of the basic digital human image at the called terminal.

[0163] In one embodiment, the data communication method further includes:

[0164] The digital human media stream is determined as a digital human image, and the digital human image is displayed.

[0165] Specifically, the called terminal can determine the digital human media stream as the digital human image. The called terminal can display the digital human image, and the user can see the appearance, expression, and movement of the digital human on the screen of the called terminal.

[0166] In this embodiment, digital human communication is achieved by displaying a digital human image on the called terminal.

[0167] In one embodiment, the data communication method further includes:

[0168] Send rendering capabilities to the server.

[0169] The rendering capability is used by the server to determine whether the terminal meets the preset rendering condition. The rendering capability can be determined by one or more of the terminal capability, user selection, and business policy.

[0170] Specifically, the called terminal or the calling terminal may send the rendering capability to the server. The server may determine the rendering capability of the calling terminal based on the terminal capability, user selection, and service policy. The server may determine the rendering capability negotiation result of the calling terminal according to the relationship between the calling terminal and the preset condition. If the calling terminal meets the preset condition, the rendering capability negotiation result of the calling terminal is to determine the calling terminal as the rendering subject; otherwise, the calling terminal cannot be determined as the rendering subject.

[0171] The server can determine the rendering capability of the called terminal based on the terminal capability, user selection, and business policy. The server can determine the rendering capability negotiation result of the called terminal based on the relationship between the called terminal and the preset conditions. If the called terminal meets the preset conditions, the rendering capability negotiation result of the called terminal is to determine the called terminal as the rendering subject; otherwise, the called terminal cannot be determined as the rendering subject.

[0172] In this embodiment, by sending the rendering capability to the server, the server can determine the rendering subject according to the rendering capability, so as to achieve determination of the rendering subject according to the rendering capability, thereby realizing digital human communication in multiple rendering modes.

[0173] In one embodiment, the rendering request carries a target digital human identifier, and the target digital human identifier is used by the server to obtain a basic digital human image corresponding to the target digital human identifier based on the correspondence between the digital human identifier and the basic digital human image.

[0174] Specifically, the calling terminal sends a rendering request to the server, and the rendering request carries the target digital human identifier. The server may store the correspondence between the digital human identifier and the basic digital human image in the basic digital human library in advance. The server may obtain the basic digital human image corresponding to the target digital human identifier from the basic digital human library according to the target digital human identifier in the target request. The basic digital human library may be a network element for storing the basic digital human image.

[0175] In this embodiment, the basic digital human image is determined through the target request sent by the calling terminal, so that the network end obtains the basic digital human image and sends the corresponding basic digital human image to the terminal or the network end.

[0176] In one embodiment, the rendering request carries a rendering capability identifier, and the rendering capability identifier is used by the server to determine whether the calling terminal, the called terminal, or the network terminal meets a preset rendering condition.

[0177] Specifically, the rendering request sent by the calling terminal to the server carries a rendering capability identifier, and the server can identify the rendering capability identifier in the rendering request, and determine whether the calling terminal, the called terminal or the network terminal meets the preset rendering condition based on the rendering subject specified in the rendering capability identifier.

[0178] In this embodiment, by carrying the rendering capability identifier, digital human communication in multiple rendering modes can be realized, which can ensure that the digital human image can be rendered with high quality on different terminals while maintaining a good user experience.

[0179] In one embodiment, Figure 4 As shown, a data communication method is provided, which is applied to Figure 1 The network end in FIG. 1 is taken as an example to illustrate, including the following steps:

[0180] Step 401: Receive a basic digital human image sent by a server.

[0181] The basic digital human image corresponds to the target digital human identifier. The basic digital human image may include basic appearance features, such as shape, facial lines, gender, etc. The target digital human identifier may represent the target user and the scene in which the target user is located.

[0182] Specifically, if the network terminal meets the preset rendering conditions and is used as the rendering subject, the network terminal can receive the basic digital human image sent by the server.

[0183] Step 402: Render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0184] The digital human metadata may be data such as the user's voice, face, body posture or movement, etc. The digital human media stream may be a data stream including video, audio and digital human appearance features.

[0185] Specifically, the server may send a rendering response to the calling terminal, and the calling terminal captures the digital human metadata based on the rendering response. The network end obtains the digital human metadata sent by the calling terminal, and the network end renders the basic digital human image through the digital human metadata to obtain the digital human media stream. The specific rendering method may be rendered by a preset rendering engine. No specific limitation is made here.

[0186] The above data communication method, by sending the basic digital human image to the network end for rendering, obtains the digital human media stream, and can render the basic digital human image on the network end, thereby realizing digital human communication in multiple rendering modes and improving the availability and reliability of digital human communication services.

[0187] In one embodiment, step 402 includes: receiving digital human metadata sent by the calling terminal, and rendering the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0188] Specifically, the network end may receive the digital human metadata sent by the calling terminal. The network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream. The specific rendering method may be rendered by a preset rendering engine. No specific limitation is made here. The network end may encode the rendered basic digital human image to obtain a digital human media stream. The specific encoding method may be encoded by a preset encoding technology, which is not specifically limited here.

[0189] In this embodiment, by rendering the basic digital human, a digital human media stream is obtained, thereby achieving the rendering of the digital human on the network side and improving the reliability of digital human communication.

[0190] In one embodiment, the data communication method further includes:

[0191] The digital human media stream is sent to the called terminal, so that the called terminal decodes the digital human media stream to obtain the digital human image and displays the digital human image.

[0192] Specifically, the network sends the digital media stream to the called terminal. The network and the called terminal can transmit data through a reliable transmission protocol. The called terminal can decode the digital human media to obtain the digital human image. The decoding process specifically adopted by the called terminal can be video decoding and / or audio decoding, and the digital human image in the digital human media stream is restored by video decoding and audio decoding. The called terminal can display the digital human image, and the user can see the appearance, expression and action of the digital human on the screen of the called terminal.

[0193] In one embodiment, the data communication method further includes:

[0194] A second communication channel is established with the called terminal, and a third communication channel is established with the calling terminal.

[0195] Specifically, the network establishes a second communication channel with the called terminal, and the network can transmit data with the called terminal through the second communication channel. The network establishes a third communication channel with the calling terminal, and the network can transmit data with the calling terminal through the third communication channel.

[0196] In this embodiment, the second communication channel and the third communication channel are established to respectively transmit data to the called terminal and the calling terminal, thereby improving the reliability of data transmission.

[0197] In one embodiment, the second communication channel is used to anchor the audio and video stream of the called terminal to the network end; the third communication channel is used to anchor the audio and video stream of the calling terminal to the network end.

[0198] Specifically, the network end may establish a second communication channel with the called terminal, and the network end may receive the audio and video stream of the called terminal through the second communication channel. The network end may establish a third communication channel with the calling terminal, and the network end may receive the audio and video stream of the calling terminal through the third communication channel. The network end may perform synchronous processing based on the received audio and video stream of the called terminal and the audio and video stream of the calling terminal.

[0199] In this embodiment, by anchoring the audio and video streams to the network end, bidirectional transmission and synchronization of the digital human media stream can be achieved, providing a stable data transmission foundation for the digital human application.

[0200] In one embodiment, the second communication channel is RTP or ADC; the third communication channel is RTP or ADC.

[0201] Among them, ADC can be an application data channel from person to application (P2A).

[0202] Specifically, the network end can establish a second communication channel with the called terminal. The second communication channel can be RTP or ADC. RTP can be used to transmit data in real time. For example, the network end can transmit a digital human media stream to the called terminal in real time through RTP, which can carry a timestamp.

[0203] The network end can establish a third communication channel with the calling terminal. The third communication channel can be RTP or ADC. RTP can be used to transmit data in real time. For example, the network end can transmit digital human metadata to the called terminal in real time through RTP, which can carry a timestamp.

[0204] In this embodiment, by using a real-time transport protocol or an application data channel, synchronous data transmission is ensured, the efficiency of data transmission is improved, and the delay is reduced.

[0205] In one embodiment, receiving digital personal data sent by a calling terminal includes:

[0206] The digital personal data sent by the calling terminal is received through the third communication channel.

[0207] Specifically, the network end may receive the digital personal data sent by the calling terminal through the third communication channel.

[0208] In one embodiment, sending the digital human media stream to the called terminal includes:

[0209] The digital human media stream is sent to the called terminal through the second communication channel.

[0210] Specifically, the network end sends the digital human media stream to the called terminal through the second communication channel.

[0211] In one embodiment, the data communication method further includes:

[0212] Send rendering capabilities to the server.

[0213] The rendering capability is used by the server to determine whether the network terminal meets the preset rendering conditions.

[0214] Specifically, the server may determine the rendering capability of the network terminal based on user selection or business policy. The server may determine the rendering capability negotiation result of the network terminal based on the relationship between the network terminal and the preset conditions. If the network terminal meets the preset conditions, the rendering capability negotiation result of the network terminal is to determine the network terminal as the rendering subject; otherwise, the network terminal cannot be determined as the rendering subject.

[0215] In this embodiment, by sending the rendering capability to the server, the server can determine the rendering subject according to the rendering capability, so as to achieve determination of the rendering subject according to the rendering capability, thereby realizing digital human communication in multiple rendering modes.

[0216] In one embodiment, the data communication method further includes:

[0217] A fourth communication channel with the server is established.

[0218] The fourth communication channel is used to determine the network end.

[0219] Specifically, the network end initiates media re-negotiation to the called terminal to connect the digital human media stream of the called terminal to the corresponding network end.

[0220] In one embodiment, Figure 5 A signaling interaction flow chart of a data communication method is provided. Figure 5 As shown, the calling terminal is used as the rendering subject. The method includes the following steps:

[0221] The calling terminal initiates re-INVITE, adds media descriptions related to digital human communication, and establishes an RTP and / or ADC channel between the calling terminal and the called terminal.

[0222] The calling terminal sends a rendering request to the server, and the rendering request carries the target digital human ID.

[0223] The server obtains the basic digital human image for rendering corresponding to the target digital human identifier from the basic digital human image storage network element, and the server returns the basic digital human image to the calling terminal.

[0224] The calling terminal captures the digital human metadata, renders and encodes the basic digital human image based on the digital human metadata, and obtains the digital human media stream.

[0225] The calling terminal sends a digital human media stream to the called terminal based on RTP or ADC.

[0226] The called terminal decodes the digital human media stream to obtain the digital human image and displays the digital human image to the user.

[0227] In one embodiment, Figure 6 A signaling interaction flow chart of a data communication method is provided. Figure 6 As shown, the called terminal is used as the rendering subject. The method includes the following steps:

[0228] The calling terminal initiates re-INVITE, adds media descriptions related to digital human communication, and establishes an RTP and / or ADC channel between the calling terminal and the called terminal.

[0229] The calling terminal sends a rendering request to the server, and the rendering request carries the target digital human ID.

[0230] The server obtains the basic digital human image for rendering corresponding to the target digital human identifier from the basic digital human image storage network element, and returns it to the called terminal.

[0231] The server sends a rendering response to the calling terminal, and the calling terminal captures the digital human metadata.

[0232] The calling terminal sends the digital human metadata to the called terminal through the RTP or ADC channel.

[0233] The called terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, determines the digital human media stream as the digital human image, and displays it to the user.

[0234] In one embodiment, Figure 7 A signaling interaction flow chart of a data communication method is provided. Figure 7 As shown, the network end is used as the rendering subject. The method includes the following steps:

[0235] An RTP or ADC channel is established between the calling terminal and the network end; an RTP or ADC channel is established between the called terminal and the network end;

[0236] The calling terminal sends a rendering request to the server, and the rendering request carries the target digital human ID.

[0237] The server obtains the basic digital human image for rendering corresponding to the target digital human identifier from the basic digital human image storage network element, and returns it to the network end.

[0238] The server sends a rendering response to the calling terminal, and the calling terminal captures the digital human metadata.

[0239] The calling terminal sends the digital human metadata to the network end through the RTP or ADC channel.

[0240] The network end renders and encodes the basic digital human image based on the digital human metadata to obtain the digital human media stream.

[0241] The network sends the digital human media stream to the called terminal based on RTP or ADC.

[0242] The called terminal decodes the digital human media stream to obtain the digital human image and displays the digital human image to the user.

[0243] In one embodiment, Figure 8 A signaling interaction flow chart of a data communication method is provided. Figure 8 As shown, the method comprises the following steps:

[0244] The calling terminal establishes a voice and video session and guides a data channel with the called terminal.

[0245] The calling terminal initiates a digital human image rendering capability negotiation request to the server, carrying the digital human rendering capability of the calling terminal.

[0246] The server requests the called terminal for the rendering capability of the called terminal, and the called terminal returns the rendering capability of the called terminal to the server.

[0247] The server requests the network end for the rendering capability of the network end, and the network end returns the rendering capability of the network end to the server.

[0248] The server determines the rendering subject based on the rendering capabilities reported by the calling terminal, the called terminal and the network and the local policy.

[0249] The server returns the rendering capability negotiation result to the calling terminal, the called terminal and the network end respectively.

[0250] It should be understood that although Figure 2-8 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 2-8 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.

[0251] In one embodiment, Fig. 9As shown, a data communication device is provided, which is applied to a server, and the device includes: a sending module 90, wherein:

[0252] The sending module 90 is used to send the basic digital human image to the terminal or network end, so that the terminal or network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and the basic digital human image corresponds to the target digital human identifier.

[0253] In one embodiment, the terminal is a calling terminal, and the sending module 90 is specifically used to send a basic digital human image to the calling terminal if the calling terminal meets a preset rendering condition, so that the calling terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and sends the digital human media stream to the called terminal through a first communication channel for decoding processing to obtain a digital human image, and displays the digital human image on the called terminal. The first communication channel is a communication channel between the calling terminal and the called terminal.

[0254] In one embodiment, the terminal is a called terminal, and the sending module 90 is specifically used to send a basic digital human image to the called terminal if the called terminal meets a preset rendering condition, so that the called terminal renders the basic digital human image based on the digital human metadata, obtains a digital human media stream, determines the digital human media stream as a digital human image, and displays the digital human image. The digital human metadata is sent from the calling terminal to the called terminal through the first communication channel.

[0255] In one embodiment, the sending module 90 is specifically used to send the basic digital human image to the network end if the network end meets the preset rendering conditions, so that the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and sends the digital human media stream to the called terminal for decoding processing to obtain the digital human image, and displays the digital human image on the called terminal.

[0256] In one embodiment, the first communication channel is a real-time transport protocol RTP or an application data channel ADC.

[0257] In one embodiment, the receiving module is used to receive a target request sent by a calling terminal, the target request carrying a target digital human identifier; based on the corresponding relationship between the digital human identifier and the basic digital human image, obtain the basic digital human image corresponding to the target digital human identifier.

[0258] In one embodiment, it is characterized in that the target request is a rendering request or an animation request.

[0259] In one embodiment, the processing module is used to determine the rendering capability of the target communication device;

[0260] Determine the relationship between the rendering capability of the target communication device and the preset conditions, and determine the rendering capability negotiation result of the target communication device. The rendering capability negotiation result indicates whether the target communication device meets the preset rendering conditions. The target communication device includes one or more of a calling terminal, a called terminal or a network terminal.

[0261] In one embodiment, the processing module is used to determine whether the calling terminal, the called terminal or the network terminal meets the preset rendering condition based on the rendering capability identifier.

[0262] In one embodiment, Fig.10 As shown, a data communication device is provided, which is applied to a terminal, and the device includes: a first receiving module 1001 and a first rendering module 1002, wherein:

[0263] The first receiving module 1001 is used to receive a basic digital human image sent by a server, where the basic digital human image corresponds to a target digital human identifier;

[0264] The first rendering module 1002 is used to render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0265] In one embodiment, the terminal is a calling terminal, and the sending module is used to establish a first communication channel with the called terminal and send a target request to the server, where the target request is used by the server to determine a basic digital human image.

[0266] In one embodiment, the target request is a rendering request or an animation request.

[0267] In one embodiment, the first communication channel is a real-time transport protocol RTP or an application data channel ADC.

[0268] In one embodiment, the sending module is used to send the digital human media stream to the called terminal based on the first communication channel, so that the called terminal decodes the digital human media stream to obtain the digital human image, and displays the digital human image.

[0269] In one embodiment, the terminal is a called terminal, and the first receiving module 1001 is used to receive digital personal data sent by the calling terminal through the first communication channel.

[0270] In one embodiment, the processing module is used to determine the digital human media stream as a digital human image and display the digital human image.

[0271] In one embodiment, the sending module is used to send the rendering capability to the server, and the rendering capability is used by the server to determine whether the terminal meets the preset rendering condition.

[0272] In one embodiment, the rendering request carries a target digital human identifier, and the target digital human identifier is used by the server to obtain a basic digital human image corresponding to the target digital human identifier based on the correspondence between the digital human identifier and the basic digital human image.

[0273] In one embodiment, the rendering request carries a rendering capability identifier, and the rendering capability identifier is used by the server to determine whether the calling terminal, the called terminal, or the network terminal meets a preset rendering condition.

[0274] In one embodiment, Fig.11 As shown, a data communication device is provided, which is applied to a terminal, and the device includes: a second receiving module 1101 and a second rendering module 1102, wherein:

[0275] The second receiving module 1101 is used to receive a basic digital human image sent by a server, where the basic digital human image corresponds to a target digital human identifier;

[0276] The second rendering module 1102 is used to render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0277] In one embodiment, the second rendering module 1102 is used to receive digital human metadata sent by the calling terminal, and render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0278] In one embodiment, the sending module is used to send the digital human media stream to the called terminal, so that the called terminal decodes the digital human media stream to obtain the digital human image and displays the digital human image.

[0279] In one embodiment, the establishing module is used to establish a second communication channel with the called terminal and a third communication channel with the calling terminal.

[0280] In one embodiment, the second communication channel is used to anchor the audio and video stream of the called terminal to the network end; the third communication channel is used to anchor the audio and video stream of the calling terminal to the network end.

[0281] In one embodiment, the second communication channel is RTP or ADC; the third communication channel is RTP or ADC.

[0282] In one embodiment, the second receiving module 1101 is used to receive digital personal data sent by the calling terminal through the third communication channel.

[0283] In one embodiment, the sending module is used to send the digital human media stream to the called terminal through the second communication channel.

[0284] In one embodiment, the sending module is further used to send the rendering capability to the server, and the rendering capability is used by the server to determine whether the network terminal meets the preset rendering condition.

[0285] In one embodiment, the establishing module is further used to establish a fourth communication channel with the server, and the fourth communication channel is used to determine the network end.

[0286] For the specific definition of the data communication device, please refer to the definition of the data communication method above, which will not be repeated here. Each module in the above data communication device can be implemented in whole or in part by software, hardware and a combination thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0287] In one embodiment, a communication device is provided. Fig.12 . Fig.12 It is a schematic diagram of the structure of a terminal provided by an embodiment of the present invention. Fig.12 The terminal device 1200 shown includes: at least one processor 1201, a memory 1202, at least one network interface 1204 and a user interface 1203. The various components in the terminal device 1200 are coupled together via a bus system 1205. It is understood that the bus system 1205 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 1205 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 1205 is not shown in FIG. Fig.12 Various buses are labeled as bus system 1205. In addition, the embodiment of the present invention also includes a transceiver 1206, which can be multiple components, that is, including a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium.

[0288] The user interface 1203 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touch pad, or a touch screen).

[0289] It can be understood that the memory 1202 in the embodiment of the present invention can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct RAM bus random access memory (DRRAM). The memory 702 of the system and method described in the embodiments of the present invention is intended to include, but is not limited to, these and any other suitable types of memory.

[0290] In some embodiments, the memory 1202 stores the following elements, executable modules or data structures, or a subset thereof, or an extended set thereof: an operating system 12021 and an application 12022 .

[0291] The operating system 12021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 12022 includes various application programs, such as a media player (MediaPlayer), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present invention can be included in the application 12022.

[0292] In an embodiment of the present invention, by calling the program or instruction stored in the memory 1202, specifically, it can be the program or instruction stored in the application 12022, wherein the transmitter is used to send the basic digital human image to the terminal or the network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and the basic digital human image corresponds to the target digital human identifier.

[0293] It is to be understood that the embodiments described in the embodiments of the present invention may be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSP devices, DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present application or a combination thereof.

[0294] For software implementation, the technology of the embodiments of the present invention can be implemented by a module (such as a process, function, etc.) that performs the functions of the embodiments of the present invention. The software code can be stored in a memory and executed by the processor 901. The memory can be implemented in the processor 901 or outside the processor 901.

[0295] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0296] The basic digital human image is sent to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, wherein the basic digital human image corresponds to the target digital human identifier.

[0297] The present application also provides a computer program product including instructions, which, when executed on a computer, causes the computer to perform the following steps:

[0298] The basic digital human image is sent to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, wherein the basic digital human image corresponds to the target digital human identifier.

[0299] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0300] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0301] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A data communication method, characterized in that: Applied to a server, the method comprises: The basic digital human image is sent to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, wherein the basic digital human image corresponds to the target digital human identifier.

2. The method according to claim 1, characterized in that The terminal is a calling terminal, and the method further includes: If the calling terminal meets the preset rendering conditions, a basic digital human image is sent to the calling terminal, so that the calling terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and sends the digital human media stream to the called terminal through a first communication channel for decoding processing to obtain a digital human image, and displays the digital human image on the called terminal. The first communication channel is a communication channel between the calling terminal and the called terminal.

3. The method according to claim 1, characterized in that The terminal is a called terminal, and the method further includes: If the called terminal meets the preset rendering conditions, a basic digital human image is sent to the called terminal, so that the called terminal renders the basic digital human image based on the digital human metadata, obtains a digital human media stream, determines the digital human media stream as a digital human image, and displays the digital human image. The digital human metadata is sent from the calling terminal to the called terminal through the first communication channel.

4. The method according to claim 1, characterized in that The method further comprises: If the network terminal meets the preset rendering conditions, a basic digital human image is sent to the network terminal, so that the network terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and sends the digital human media stream to the called terminal for decoding processing to obtain a digital human image, and displays the digital human image on the called terminal.

5. The method according to claim 2 or 3, characterized in that: The first communication channel is a real-time transport protocol RTP or an application data channel ADC.

6. The method according to any one of claims 1 to 4, characterized in that The method further comprises: receiving a target request sent by the calling terminal, wherein the target request carries the target digital person identifier; Based on the correspondence between the digital human identifier and the basic digital human image, the basic digital human image corresponding to the target digital human identifier is obtained.

7. The method according to claim 6, characterized in that The target request is a rendering request or an animation request.

8. The method according to claim 1, characterized in that The method further comprises: Determine the rendering capabilities of the target communication device; Determine the relationship between the rendering capability of the target communication device and the preset conditions, and determine the rendering capability negotiation result of the target communication device, wherein the rendering capability negotiation result represents whether the target communication device meets the preset rendering conditions, and the target communication device includes one or more of the calling terminal, the called terminal or the network terminal.

9. The method according to claim 7, characterized in that: The rendering request also carries a rendering capability identifier, and the method further includes: Based on the rendering capability identifier, it is determined whether the calling terminal, the called terminal or the network terminal meets the preset rendering condition.

10. A data communication method, characterized in that: Applied to a terminal, the method comprises: Receiving a basic digital human image sent by a server, wherein the basic digital human image corresponds to a target digital human identifier; The basic digital human image is rendered based on the digital human metadata to obtain a digital human media stream.

11. The method according to claim 10, characterized in that The terminal is a calling terminal, and the method further includes: A first communication channel is established with the called terminal, and a target request is sent to the server, wherein the target request is used by the server to determine the basic digital human image.

12. The method according to claim 11, characterized in that The target request is a rendering request or an animation request.

13. The method according to claim 11, characterized in that The first communication channel is a real-time transport protocol RTP or an application data channel ADC.

14. The method according to claim 11, characterized in that The method further comprises: The digital human media stream is sent to the called terminal based on the first communication channel, so that the called terminal decodes the digital human media stream to obtain a digital human image, and displays the digital human image.

15. The method according to claim 10, characterized in that The terminal is a called terminal, and the method further includes: The digital human metadata is received, which is sent by the calling terminal through the first communication channel.

16. The method according to claim 15, characterized in that The method further comprises: The digital human media stream is determined as the digital human image, and the digital human image is displayed.

17. The method according to claim 10, characterized in that The method further comprises: The rendering capability is sent to the server, where the rendering capability is used by the server to determine whether the terminal meets a preset rendering condition.

18. The method according to claim 12, characterized in that The rendering request carries the target digital human identifier, and the target digital human identifier is used by the server to obtain the basic digital human image corresponding to the target digital human identifier based on the corresponding relationship between the digital human identifier and the basic digital human image.

19. The method according to claim 12, characterized in that The rendering request carries a rendering capability identifier, and the rendering capability identifier is used by the server to determine whether the calling terminal, the called terminal or the network terminal meets a preset rendering condition.

20. A data communication method, characterized in that: Applied to a network end, the method comprises: Receiving a basic digital human image sent by a server, wherein the basic digital human image corresponds to a target digital human identifier; The basic digital human image is rendered based on the digital human metadata to obtain a digital human media stream.

21. The method according to claim 20, characterized in that The step of rendering the basic digital human image based on the digital human metadata to obtain a digital human media stream includes: The digital human metadata sent by the calling terminal is received, and the basic digital human image is rendered based on the digital human metadata to obtain a digital human media stream.

22. The method according to claim 20, characterized in that The method further comprises: The digital human media stream is sent to the called terminal, so that the called terminal decodes the digital human media stream to obtain the digital human image, and displays the digital human image.

23. The method according to claim 20, characterized in that The method further comprises: A second communication channel is established with the called terminal, and a third communication channel is established with the calling terminal.

24. The method according to claim 23, characterized in that The second communication channel is used to anchor the audio and video stream of the called terminal to the network end; the third communication channel is used to anchor the audio and video stream of the calling terminal to the network end.

25. The method according to claim 23, characterized in that The second communication channel is RTP or ADC; the third communication channel is RTP or ADC.

26. The method according to claim 21 or 23, characterized in that The receiving digital personal data sent by the calling terminal includes: The digital personal data sent by the calling terminal is received through the third communication channel.

27. The method according to claim 22 or 23, characterized in that The sending of the digital human media stream to the called terminal includes: The digital human media stream is sent to the called terminal through the second communication channel.

28. The method according to claim 20, characterized in that The method further comprises: The rendering capability is sent to the server, where the rendering capability is used by the server to determine whether the network terminal meets a preset rendering condition.

29. The method according to claim 20, characterized in that The method further comprises: A fourth communication channel is established with the server, wherein the fourth communication channel is used to determine the network end.

30. A data communication device, characterized in that: Applied to a server, the device comprises: The sending module is used to send a basic digital human image to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, wherein the basic digital human image corresponds to the target digital human identifier.

31. A data communication device, characterized in that: Applied to a terminal, the device comprises: A first receiving module, configured to receive a basic digital human image sent by a server, wherein the basic digital human image corresponds to a target digital human identifier; The first rendering module is used to render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

32. A data communication device, characterized in that: Applied to a network end, the device comprises: A second receiving module is used to receive a basic digital human image sent by the server, wherein the basic digital human image corresponds to the target digital human identifier; The second rendering module is used to render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

33. A communication device, characterized in that: include: Transmitter; The transmitter is used to send a basic digital human image to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and the basic digital human image corresponds to the target digital human identifier.

34. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 29 are implemented.

35. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 29 are implemented.

Images