Data communication method and apparatus, and communication device, readable storage medium and program product

Abstract

The present application relates to a data communication method and apparatus, and a communication device, a readable storage medium and a program product. The method comprises: sending a basic digital-human image to a terminal or a network end, such that the terminal or the network end renders the basic digital-human image on the basis of digital-human metadata, so as to obtain a digital-human media stream, wherein the basic digital-human image corresponds to a target digital-human identifier. By means of the method, the reliability of communication performed by using digital-human communication can be improved.

Description

Data communication method, device, communication equipment, readable storage medium and program product

[0001] The present application claims priority to the Chinese patent application No. 2024113863690, filed on September 30, 2024, and entitled "Data communication method, device, communication equipment, readable storage medium and program product", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of wireless communication, in particular to a data communication method, device, communication equipment, readable storage medium and program product. BACKGROUND

[0003] With the development of Internet Protocol (IP) Multimedia Subsystem (IMS) data channel technology, the 5th Generation Mobile Communication Technology (5G) call brings more innovative service experience to users. Displaying the virtual digital human image of the user during the call is a key scene for future applications. Based on the user's own features, different styles of digital human images are generated, and the information of voice, expression and action captured by the terminal during the call is used to realize real-time synchronization of the digital human image.

[0004] However, in the related art, when the user communicates using the digital human, the communication using the digital human is limited by the application scene, which reduces the reliability of the communication using the digital human. SUMMARY

[0005] Therefore, it is necessary to provide a data communication method, device, communication equipment, readable storage medium and program product to improve the reliability of communication using the digital human.

[0006] A data communication method, the method is applied to a server, and the method comprises:

[0007] sending a basic digital human image to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on digital human metadata to obtain a digital human media stream, the basic digital human image corresponding to a target digital human identifier.

[0008] In one of the embodiments, the terminal is a calling terminal, and the method further comprises:

[0009] If the calling terminal meets a preset rendering condition, a basic digital human image is sent to the calling terminal, so that the calling terminal renders the basic digital human image based on digital human metadata to obtain a digital human media stream, and sends the digital human media stream to a called terminal through a first communication channel for decoding processing to obtain a digital human image, and the digital human image is displayed on the called terminal, and the first communication channel is a communication channel between the calling terminal and the called terminal.

[0010] In one of the embodiments, the terminal is a called terminal, and the method further includes:

[0011] If the called terminal meets a preset rendering condition, a basic digital human image is sent to the called terminal, so that the called terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, the digital human media stream is determined as a digital human image, and the digital human image is displayed, and the digital human metadata is sent by a calling terminal to the called terminal through a first communication channel.

[0012] In one of the embodiments, the method further includes:

[0013] If the network end meets a preset rendering condition, a basic digital human image is sent to the network end, so that the network end renders the basic digital human image based on digital human metadata to obtain a digital human media stream, and the digital human media stream is sent to a called terminal for decoding processing to obtain a digital human image, and the digital human image is displayed on the called terminal.

[0014] In one of the embodiments, the first communication channel is a real-time transport protocol (RTP) or an application data channel (ADC).

[0015] In one of the embodiments, the method further includes:

[0016] The target request sent by the calling terminal is received, and the target request carries the target digital human identifier;

[0017] Based on the correspondence between the digital human identifier and the basic digital human image, the basic digital human image corresponding to the target digital human identifier is obtained.

[0018] In one of the embodiments, the target request is a rendering request or an animation request.

[0019] In one of the embodiments, the method further includes:

[0020] The rendering capability of the target communication device is determined.

[0021] determine a rendering capability negotiation result of the target communication device, the rendering capability negotiation result representing whether the target communication device meets a preset rendering condition, the target communication device including one or more of a calling terminal, a called terminal, or the network side.

[0022] In one of the embodiments, the rendering request further carries a rendering capability identifier, and the method further includes:

[0023] Based on the rendering capability identifier, it is determined whether the calling terminal, the called terminal, or the network side meets the preset rendering condition.

[0024] A data communication method, applied to a terminal, includes:

[0025] receiving a basic digital human image sent by a server, the basic digital human image corresponding to a target digital human identifier;

[0026] rendering the basic digital human image based on digital human metadata to obtain a digital human media stream.

[0027] In one of the embodiments, the terminal is a calling terminal, and the method further includes:

[0028] establishing a first communication channel with a called terminal, and sending a target request to the server, the target request being used for the server to determine the basic digital human image.

[0029] In one of the embodiments, the target request is a rendering request or an animation request.

[0030] In one of the embodiments, the first communication channel is a real-time transport protocol (RTP) or an application data channel (ADC).

[0031] In one of the embodiments, the method further includes:

[0032] sending the digital human media stream to the called terminal based on the first communication channel, so that the called terminal decodes and processes the digital human media stream to obtain a digital human image, and displays the digital human image.

[0033] In one of the embodiments, the terminal is a called terminal, and the method further includes:

[0034] receiving the digital human metadata sent by a calling terminal through a first communication channel.

[0035] In one of the embodiments, the method further includes:

[0036] determine the digital human media stream as the digital human image, and display the digital human image.

[0037] In one of the embodiments, the method further comprises:

[0038] sending a rendering capability to the server, the rendering capability being used by the server to determine whether the terminal meets preset rendering conditions.

[0039] In one of the embodiments, the rendering request carries the target digital human identifier, which is used by the server to obtain the base digital human image corresponding to the target digital human identifier based on the correspondence between the digital human identifier and the base digital human image.

[0040] In one of the embodiments, the rendering request carries a rendering capability identifier, which is used by the server to determine whether the calling terminal, the called terminal, or the network side meets preset rendering conditions.

[0041] A data communication method, applied to a network side, comprises:

[0042] receiving a base digital human image sent by a server, the base digital human image corresponding to a target digital human identifier;

[0043] rendering the base digital human image based on digital human metadata to obtain a digital human media stream.

[0044] In one of the embodiments, the rendering of the base digital human image based on the digital human metadata to obtain the digital human media stream comprises:

[0045] receiving digital human metadata sent by a calling terminal, and rendering the base digital human image based on the digital human metadata to obtain a digital human media stream.

[0046] In one of the embodiments, the method further comprises:

[0047] sending the digital human media stream to a called terminal, so that the called terminal decodes and processes the digital human media stream to obtain a digital human image, and displays the digital human image.

[0048] In one of the embodiments, the method further comprises:

[0049] establishing a second communication channel with the called terminal, and establishing a third communication channel with the calling terminal.

[0050] In one of the embodiments, the second communication channel is used to anchor the audio and video stream of the called terminal to the network end; and the third communication channel is used to anchor the audio and video stream of the calling terminal to the network end.

[0051] In one of the embodiments, the second communication channel is RTP or ADC; and the third communication channel is RTP or ADC.

[0052] In one of the embodiments, the receiving the digital human metadata sent by the calling terminal comprises:

[0053] The third communication channel is used to receive the digital human metadata sent by the calling terminal.

[0054] In one of the embodiments, the sending the digital human media stream to the called terminal comprises:

[0055] The second communication channel is used to send the digital human media stream to the called terminal.

[0056] In one of the embodiments, the method further comprises:

[0057] The rendering capability is sent to the server, and the rendering capability is used for the server to determine whether the network end meets a preset rendering condition.

[0058] In one of the embodiments, the method further comprises:

[0059] A fourth communication channel is established between the server, and the fourth communication channel is used to determine the network end.

[0060] A data communication device, the device is applied to a server, and the device comprises:

[0061] A sending module is configured to send a basic digital human image corresponding to a target digital human identifier to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on digital human metadata to obtain a digital human media stream.

[0062] A data communication device, the device is applied to a terminal, and the device comprises:

[0063] A first receiving module is configured to receive a basic digital human image sent by a server, and the basic digital human image corresponds to a target digital human identifier.

[0064] A first rendering module is configured to render the basic digital human image based on digital human metadata to obtain a digital human media stream.

[0065] A data communication device, the device is applied to a network end, and the device comprises:

[0066] The second receiving module is configured to receive a basic digital human figure sent by a server, the basic digital human figure corresponding to a target digital human identifier;

[0067] The second rendering module is configured to render the basic digital human figure based on digital human metadata to obtain a digital human media stream.

[0068] A communication device, comprising a transmitter;

[0069] The transmitter is configured to send a basic digital human figure to a terminal or a network end, so that the terminal or the network end renders the basic digital human figure based on digital human metadata to obtain a digital human media stream, the basic digital human figure corresponding to a target digital human identifier.

[0070] A computer readable storage medium having a computer program stored thereon, the computer program being executed by a processor to implement the following steps:

[0071] The transmitter is configured to send a basic digital human figure to a terminal or a network end, so that the terminal or the network end renders the basic digital human figure based on digital human metadata to obtain a digital human media stream, the basic digital human figure corresponding to a target digital human identifier.

[0072] A computer program product, comprising a computer program, wherein the computer program is executed by a processor to implement the data communication method provided in the embodiments of the present application, and the method can be:

[0073] The transmitter is configured to send a basic digital human figure to a terminal or a network end, so that the terminal or the network end renders the basic digital human figure based on digital human metadata to obtain a digital human media stream, the basic digital human figure corresponding to a target digital human identifier.

[0074] The above data communication method, device, communication device, storage medium and computer program product can render a basic digital human figure at a terminal or a network end to obtain a digital human media stream, thereby realizing digital human communication in multiple rendering modes and improving the availability and reliability of digital human communication services. BRIEF DESCRIPTION OF DRAWINGS

[0075] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related art, the drawings needed in the description of the embodiments of the present application or the related art will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and those skilled in the art can obtain other related drawings without creative labor.

[0076] Figure 1 is a diagram of an application environment of a data communication method in an embodiment;

[0077] Figure 2 is a flowchart of a data communication method in an embodiment;

[0078] Figure 3 is a flowchart of a data communication method in an embodiment;

[0079] Figure 4 is a flowchart of a data communication method in an embodiment;

[0080] Figure 5 is a signaling interaction flowchart of a data communication method in an embodiment;

[0081] Figure 6 is a signaling interaction flowchart of a data communication method in an embodiment;

[0082] Figure 7 is a signaling interaction flowchart of a data communication method in an embodiment;

[0083] Figure 8 is a signaling interaction flowchart of a data communication method in an embodiment;

[0084] Figure 9 is a structural block diagram of a data communication apparatus in an embodiment;

[0085] Figure 10 is a structural block diagram of a data communication apparatus in an embodiment;

[0086] Figure 11 is a structural block diagram of a data communication apparatus in an embodiment;

[0087] Figure 12 is an internal structure diagram of a communication device in an embodiment. DETAILED DESCRIPTION

[0088] To make the purposes, technical solutions and advantages of the present application clearer, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and should not be used to limit the present application.

[0089] Figure 1 is a diagram of an application environment of a data communication method in an embodiment. As shown in Figure 1, the scenario includes a terminal 100, a server 200 and a network end 300. The terminal 100 includes a calling terminal 101 and a called terminal 102. The calling terminal 101 can perform data transmission with the called terminal 102. The calling terminal 101 can be divided into a first part for performing data transmission with the server 200 and the network end 300, and the called terminal 102 can be divided into a second part for performing data transmission with the server 200 and the network end 300.

[0090] In an embodiment, the scenario can be applied in an IP Multimedia Subsystem (IMS). The server 200 can be an Application Server (AS), and the network end 300 can be a Media Function (MF), which can include a Media Gateway (MGW), a media server (such as a server providing IVR or conference service), etc., and is responsible for processing media streams, such as voice, video and data streams.

[0091] The calling terminal 101 and the called terminal 102 can be wireless terminals, which can be devices providing voice and / or other service data connectivity to users, or handheld devices with wireless connection functions, or other processing devices connected to wireless modems. The wireless terminals can communicate with one or more core networks via a Radio Access Network (RAN), and can be mobile terminals, such as mobile phones (or "cellular" phones) and computers with mobile terminals, for example, portable, pocket, handheld, built-in or vehicle-mounted mobile devices that exchange language and / or data with the radio access network. The wireless terminals can also be referred to as systems, subscriber units, subscriber stations, mobile stations, mobiles, remote stations, remote terminals, access terminals, user terminals, user agents, user devices or user equipment, without limitation.

[0092] It should be noted that the beneficial effects or technical problems solved by the embodiments of the present application are not limited to this, but can also be other implicit or related problems. For details, please refer to the description of the following embodiments.

[0093] The technical solutions of the present application and how the technical solutions solve the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes can not be described in detail in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.

[0094] In one embodiment, as shown in FIG. 2, a data communication method is provided, which is applied to the server in FIG. 1 as an example, and includes the following steps:

[0095] Step 201, send a basic digital human figure to a terminal or a network end, so that the terminal or the network end renders the basic digital human figure based on digital human metadata to obtain a digital human media stream.

[0096] In an embodiment, the basic digital human figure corresponds to a target digital human identity. The basic digital human figure can include basic appearance features such as shape, facial lines, gender, etc. The target digital human identity can represent a target user and a scene in which the target user is located. The digital human metadata can be data such as voice, face, body posture or motion of the user. The digital human media stream can be a data stream including video, audio and digital human appearance features.

[0097] In an embodiment, when a user establishes a voice and video session on a terminal, the server can send a basic digital human figure to the terminal or the network end. The terminal can render the basic digital human figure through digital human metadata to obtain a digital human media stream, or the network end can render the basic digital human figure through digital human metadata to obtain a digital human data stream. The specific rendering method can be rendered by a preset rendering engine. This is not specifically limited here.

[0098] The above data communication method can render the basic digital human figure on the terminal or the network end by sending the basic digital human figure to the terminal or the network end for rendering to obtain a digital human media stream, thereby realizing digital human communication in multiple rendering modes and improving the availability and reliability of digital human communication services.

[0099] In an embodiment, the data communication method further comprises:

[0100] If the calling terminal meets the preset rendering condition, the basic digital human figure is sent to the calling terminal, so that the calling terminal renders the basic digital human figure based on digital human metadata to obtain a digital human media stream, and the digital human media stream is sent to the called terminal through a first communication channel for decoding processing to obtain a digital human figure, and the digital human figure is displayed on the called terminal.

[0101] In an embodiment, the terminal is a calling terminal, the preset rendering condition can be a preset rendering capability and / or a rendering capability identifier, and the first communication channel is a communication channel between the calling terminal and the called terminal. The rendering capability can be a digital human rendering capability.

[0102] In an embodiment, the server can determine whether the terminal or the network side meets the preset rendering condition according to the rendering capability and / or the rendering capability identifier. If the rendering capability of the calling terminal meets the preset rendering capability and / or the rendering capability identifier, the server determines that the calling terminal meets the preset rendering condition, and sends the basic digital human image to the calling terminal. The calling terminal can capture the digital human metadata of the user. The calling terminal can render the basic digital human image based on the digital human metadata to obtain a digital human media stream. The calling terminal can encode the rendered basic digital human image to obtain the digital human media stream. The calling terminal can send the digital human media stream to the called terminal through the first communication channel. The called terminal can decode the digital human media to obtain the digital human image. The decoding process adopted by the called terminal can be video decoding and / or audio decoding, and the digital human image in the digital human media stream is restored through video decoding and / or audio decoding. The called terminal can display the digital human image, and the user can see the appearance, expression and action of the digital human on the screen of the called terminal.

[0103] In the embodiment, if the calling terminal meets the preset rendering condition, the basic digital human image is rendered on the calling terminal to obtain a digital human media stream, so that the basic digital human image is rendered on the calling terminal.

[0104] In an embodiment, the data communication method further comprises:

[0105] If the called terminal meets the preset rendering condition, the basic digital human image is sent to the called terminal, so that the called terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, determines the digital human media stream as a digital human image, and displays the digital human image.

[0106] In an embodiment, the terminal is a called terminal, and the digital human metadata is sent by a calling terminal to the called terminal through a first communication channel.

[0107] In an embodiment, if the rendering capability of the called terminal meets the preset rendering capability and / or the rendering capability identifier, the server determines that the called terminal meets the preset rendering condition, and sends the basic digital human image to the called terminal. The called terminal can receive the digital human metadata sent by the calling terminal through the first communication channel. The called terminal renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, determines the digital human media stream as a digital human image, and displays the digital human image, so that the user can see the appearance, expression and action of the digital human on the screen of the called terminal.

[0108] In the embodiment, the called terminal is determined whether to satisfy the preset rendering condition, the basic digital human image is rendered on the called terminal to obtain a digital human media stream, and the basic digital human image is rendered on the called terminal.

[0109] In one embodiment, the data communication method further includes:

[0110] If the network end satisfies the preset rendering condition, the basic digital human image is sent to the network end, so that the network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream, and the digital human media stream is sent to the called terminal for decoding processing to obtain a digital human image, and the digital human image is displayed on the called terminal.

[0111] In one embodiment, if the rendering capability of the network end satisfies the preset rendering capability and / or the rendering capability identifier, the server determines that the called terminal satisfies the preset rendering condition, and sends the basic digital human image to the called terminal. The network end can receive the digital human metadata sent by the calling terminal. The network end renders the basic digital human image based on the digital human metadata to obtain a digital human media stream. The network end can encode the rendered basic digital human image to obtain a digital human media stream. The network end can send the digital human media stream to the called terminal, and the called terminal decodes the digital human media stream to obtain a digital human image. The decoding process of the called terminal can be video decoding and / or audio decoding, and the digital human image in the digital human media stream is restored through video decoding and / or audio decoding. The called terminal can display the digital human image.

[0112] In the embodiment, the server is determined whether to satisfy the preset rendering condition, and the basic digital human image is rendered on the server to render the basic digital human image on the server.

[0113] In one embodiment, the first communication channel is a real-time transport protocol (RTP) or an application data channel (ADC).

[0114] In one embodiment, the ADC can be a personal-to-application (P2A) application data channel.

[0115] In an embodiment, the calling terminal can send an INVITE request (re-INVITE) in a session already established with the called terminal, add a digital human communication related media description, and establish an end-to-end communication with the called terminal. The calling terminal and the called terminal can establish a first communication channel. If the called terminal renders a basic digital human image, the calling terminal can send digital human metadata to the called terminal through RTP or ADC. If the calling terminal renders a basic digital human image, the calling terminal can send a digital human media stream to the called terminal through RTP or ADC.

[0116] In the embodiment, the efficiency of data transmission can be improved and the delay can be reduced by using the real-time transport protocol or the application data channel.

[0117] In an embodiment, the data communication method further comprises:

[0118] receiving a target request sent by the calling terminal; and obtaining a basic digital human image corresponding to a target digital human identifier based on a correspondence between the digital human identifier and the basic digital human image.

[0119] The target request carries the target digital human identifier.

[0120] In an embodiment, the server can receive a target request sent by the calling terminal. The server can pre-store a correspondence between a digital human identifier and a basic digital human image in a basic digital human library. The server can obtain a basic digital human image corresponding to the target digital human identifier from the basic digital human library according to the target digital human identifier in the target request. The basic digital human library can store a network element for the basic digital human image.

[0121] In the embodiment, the basic digital human image is determined by the target request sent by the calling terminal, so that the network side obtains the basic digital human image and sends the corresponding basic digital human image to the terminal or the network side.

[0122] In an embodiment, the target request is a rendering request or an animation request.

[0123] In an embodiment, the server can receive a rendering request or an animation request sent by the calling terminal. The server can receive the rendering request or the animation request to obtain a basic digital human image corresponding to the target digital human identifier.

[0124] In an embodiment, the data communication method further comprises:

[0125] determining a rendering capability of the target communication device; judging a relationship between the rendering capability of the target communication device and a preset condition, and determining a rendering capability negotiation result of the target communication device.

[0126] In an embodiment, the rendering capability can be determined by one or more of a terminal capability, a user selection, and a service policy. The rendering capability negotiation result represents whether the target communication device meets a preset rendering condition, the target communication device including one or more of a calling terminal, a called terminal, or a network end. The preset condition can be a rendering condition, which can be determined by a condition met by the rendering of the avatar based on the data.

[0127] In an embodiment, the server can determine the rendering capability of the calling terminal based on a terminal capability, a user selection, and a service policy. The server can determine the rendering capability negotiation result of the calling terminal according to the relationship between the calling terminal and the preset condition. If the calling terminal meets the preset condition, the rendering capability negotiation result of the calling terminal is to determine the calling terminal as the rendering subject; otherwise, the calling terminal cannot be determined as the rendering subject.

[0128] The server can determine the rendering capability of the called terminal based on a terminal capability, a user selection, and a service policy. The server can determine the rendering capability negotiation result of the called terminal according to the relationship between the called terminal and the preset condition. If the called terminal meets the preset condition, the rendering capability negotiation result of the called terminal is to determine the called terminal as the rendering subject; otherwise, the called terminal cannot be determined as the rendering subject.

[0129] The server can determine the rendering capability of the network end based on a user selection or a service policy. The server can determine the rendering capability negotiation result of the network end according to the relationship between the network end and the preset condition. If the network end meets the preset condition, the rendering capability negotiation result of the network end is to determine the network end as the rendering subject; otherwise, the network end cannot be determined as the rendering subject.

[0130] In this embodiment, the rendering capability of the target device is negotiated to determine the capability negotiation result, so as to determine the rendering subject according to the rendering capability, thereby realizing digital human communication in multiple rendering modes.

[0131] In an embodiment, the data communication method further includes:

[0132] Based on the rendering capability identifier, it is determined whether the calling terminal, the called terminal, or the network end meets the preset rendering condition.

[0133] The rendering request can also carry a rendering capability identifier, which can be determined based on a user selection or a rendering capability negotiation result.

[0134] In an embodiment, the server can identify the rendering capability identifier in the rendering request, and determine that the calling terminal, the called terminal, or the network end meets the preset rendering condition based on the rendering subject specified in the rendering capability identifier.

[0135] In the embodiment, the rendering capability identifier is used to determine whether the calling terminal, the called terminal or the network side meets the preset rendering condition, so as to realize the digital human communication in multiple rendering modes.

[0136] In one embodiment, as shown in FIG. 3, a data communication method is provided, which is taken as an example for description by being applied to the terminal in FIG. 1, and includes the following steps:

[0137] Step 301, receiving the basic digital human image sent by the server.

[0138] In one embodiment, the basic digital human image corresponds to the target digital human identifier. The basic digital human image can include basic appearance features such as shape, facial lines, gender, etc. The target digital human identifier can represent the target user and the scene in which the target user is located.

[0139] In one embodiment, if the terminal meets the preset rendering condition, the terminal is taken as the rendering subject, and then the terminal can receive the basic digital human image sent by the server.

[0140] Step 302, rendering the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0141] In one embodiment, the digital human metadata can be voice, face, body posture or motion data of the user. The digital human media stream can be a data stream including video, audio and digital human appearance features.

[0142] In one embodiment, the terminal can identify or acquire the digital human metadata. The terminal can render the basic digital human image based on the digital human metadata to obtain the digital human media stream.

[0143] The above data communication method can render the basic digital human image at the terminal to obtain the digital human media stream, thereby realizing the digital human communication in multiple rendering modes and improving the availability and reliability of the digital human communication service.

[0144] In one embodiment, the data communication method further includes:

[0145] establishing a first communication channel with the called terminal, and sending a target request to the server.

[0146] In one embodiment, the terminal is a calling terminal, and the target request is used for the server to determine the basic digital human image.

[0147] In an embodiment, the calling terminal can send an INVITE request (re-INVITE) in a session already established with the called terminal, add a media description related to digital human communication, and establish an end-to-end communication with the called terminal. The calling terminal and the called terminal can establish a first communication channel. The calling terminal can send a target request to the server, carrying a target digital human identifier in the target request. The server can pre-store a correspondence between the digital human identifier and the base digital human image in a base digital human library. The server can obtain the base digital human image corresponding to the target digital human identifier from the base digital human library according to the target digital human identifier in the target request. The base digital human library can store network elements for the base digital human image

[0148] In the embodiment, the base digital human image is determined by the target request sent by the calling terminal, so that the base digital human image obtained by the network side is sent to the terminal or the network side.

[0149] In an embodiment, the target request is a rendering request or an animation request.

[0150] In an embodiment, the calling terminal can send a rendering request or an animation request to the server. The server can receive the rendering request or the animation request to obtain the base digital human image corresponding to the target digital human identifier.

[0151] In an embodiment, the first communication channel is a real-time transport protocol (RTP) or an application data channel (ADC).

[0152] In an embodiment, the ADC can be a personal-to-application (P2A) application data channel.

[0153] In an embodiment, the calling terminal can send an INVITE request (re-INVITE) in a session already established with the called terminal, add a media description related to digital human communication, and establish an end-to-end communication with the called terminal. The calling terminal and the called terminal can establish a first communication channel. If the base digital human image is rendered at the called terminal, the calling terminal can send digital human metadata to the called terminal through RTP or ADC. If the base digital human image is rendered at the calling terminal, the calling terminal can send a digital human media stream to the called terminal through RTP or ADC.

[0154] In the embodiment, the use of real-time transport protocol or application data channel can improve the efficiency of data transmission and reduce the delay.

[0155] In an embodiment, the data communication method further comprises:

[0156] The digital human media stream is sent to the called terminal based on the first communication channel, so that the called terminal decodes and processes the digital human media stream to obtain a digital human image, and the digital human image is displayed.

[0157] In one embodiment, the calling terminal can send the digital human media stream to the called terminal through the first communication channel. The called terminal can decode and process the digital human media to obtain a digital human image. The specific decoding process of the called terminal can be video decoding and / or audio decoding, and the digital human image in the digital human media stream is restored through video decoding and / or audio decoding. The called terminal can display the digital human image, and the user can see the appearance, expression and action of the digital human on the screen of the called terminal.

[0158] In this embodiment, the digital human media stream is transmitted through the first communication channel, improving the accuracy and reliability in the data transmission process, and the called terminal decodes and processes to obtain a digital human image, ensuring smooth playback of the media stream and improving the application experience of digital human communication.

[0159] In one embodiment, the data communication method further comprises:

[0160] The digital human metadata sent by the calling terminal through the first communication channel is received.

[0161] In one embodiment, the terminal is a called terminal.

[0162] In one embodiment, if the called terminal meets the preset rendering condition, the server can send a rendering response to the calling terminal, and the calling terminal captures the digital human metadata based on the rendering response. The called terminal can receive the digital human metadata sent by the calling terminal through the first communication channel, and render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0163] In this embodiment, by determining whether the called terminal meets the preset rendering condition, the basic digital human image is rendered in the called terminal to obtain a digital human media stream, so that the basic digital human image is rendered in the called terminal.

[0164] In one embodiment, the data communication method further comprises:

[0165] The digital human media stream is determined as a digital human image, and the digital human image is displayed.

[0166] In one embodiment, the called terminal can determine the digital human media stream as a digital human image. The called terminal can display the digital human image, and the user can see the appearance, expression and action of the digital human on the screen of the called terminal.

[0167] In the embodiment, the digital human communication is realized by displaying the digital human image on the called terminal.

[0168] In an embodiment, the data communication method further comprises:

[0169] sending the rendering capability to the server.

[0170] In an embodiment, the rendering capability is used by the server to determine whether the terminal meets a preset rendering condition. The rendering capability can be determined by one or more of the terminal capability, user selection, and service policy.

[0171] In an embodiment, the called terminal or the calling terminal can send the rendering capability to the server. The server can determine the rendering capability of the calling terminal based on the terminal capability, user selection, and service policy. The server can determine the rendering capability negotiation result of the calling terminal according to the relationship between the calling terminal and the preset condition. If the calling terminal meets the preset condition, the rendering capability negotiation result of the calling terminal is to determine the calling terminal as the rendering subject; otherwise, the calling terminal cannot be determined as the rendering subject.

[0172] The server can determine the rendering capability of the called terminal based on the terminal capability, user selection, and service policy. The server can determine the rendering capability negotiation result of the called terminal according to the relationship between the called terminal and the preset condition. If the called terminal meets the preset condition, the rendering capability negotiation result of the called terminal is to determine the called terminal as the rendering subject; otherwise, the called terminal cannot be determined as the rendering subject.

[0173] In the embodiment, by sending the rendering capability to the server, the server can determine the rendering subject according to the rendering capability, so as to realize the digital human communication in the multi-rendering mode.

[0174] In an embodiment, the target digital human identifier is carried in the rendering request, and the target digital human identifier is used by the server to obtain the basic digital human image corresponding to the target digital human identifier based on the correspondence between the digital human identifier and the basic digital human image.

[0175] In an embodiment, the calling terminal sends the rendering request to the server, and the target digital human identifier is carried in the rendering request. The server can pre-store the correspondence between the digital human identifier and the basic digital human image in the basic digital human library. The server can obtain the basic digital human image corresponding to the target digital human identifier from the basic digital human library according to the target digital human identifier in the target request. The basic digital human library can be a basic digital human image storage element.

[0176] In the embodiment, the target request sent by the calling terminal determines the basic digital human image, so that the network end obtains the basic digital human image, and sends the corresponding basic digital human image to the terminal or the network end.

[0177] In one embodiment, the rendering request carries a rendering capability identifier, which is used by the server to determine whether the calling terminal, the called terminal or the network end meets the preset rendering condition.

[0178] In one embodiment, the rendering request sent by the calling terminal to the server carries a rendering capability identifier, and the server can identify the rendering capability identifier in the rendering request. Based on the rendering subject specified in the rendering capability identifier, it is determined whether the calling terminal, the called terminal or the network end meets the preset rendering condition.

[0179] In the embodiment, by carrying the rendering capability identifier, the digital human communication in multiple rendering modes can be realized, and it can be ensured that the digital human image can be rendered in high quality on different terminals, while maintaining good user experience.

[0180] In one embodiment, as shown in FIG. 4, a data communication method is provided. Taking the network end in FIG. 1 as an example, the method comprises the following steps:

[0181] Step 401, receiving the basic digital human image sent by the server.

[0182] In one embodiment, the basic digital human image corresponds to a target digital human identifier. The basic digital human image can include basic appearance characteristics, such as shape, facial lines, gender, etc. The target digital human identifier can represent a target user and a scene in which the target user is located.

[0183] In one embodiment, if the network end meets the preset rendering condition, the network end is used as the rendering subject, and then the network end can receive the basic digital human image sent by the server.

[0184] Step 402, rendering the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0185] In one embodiment, the digital human metadata can be voice, face, body posture or motion data of the user. The digital human media stream can be a data stream including video, audio and digital human appearance characteristics.

[0186] In one embodiment, the server can send a rendering response to the calling terminal, and the calling terminal captures the digital human metadata based on the rendering response. The network end obtains the digital human metadata sent by the calling terminal, and the network end can render the basic digital human image based on the digital human metadata to obtain a digital human media stream. The specific rendering method can be rendered by a preset rendering engine. No specific limitation is made herein.

[0187] The data communication method can render the base digital human image at the network end to obtain a digital human media stream, thereby realizing digital human communication in multiple rendering modes, and improving the availability and reliability of digital human communication services.

[0188] In one embodiment, step 402 includes receiving digital human metadata sent by the calling terminal, and rendering the base digital human image based on the digital human metadata to obtain a digital human media stream.

[0189] In one embodiment, the network end can receive digital human metadata sent by the calling terminal. The network end renders the base digital human image based on the digital human metadata to obtain a digital human media stream. The specific rendering mode can be rendered by a preset rendering engine. No specific limitation is made herein. The network end can encode the rendered base digital human image to obtain a digital human media stream. The specific encoding mode can be encoded by a preset encoding technology, and no specific limitation is made herein.

[0190] In this embodiment, the base digital human is rendered to obtain a digital human media stream, thereby realizing rendering of the digital human at the network end and improving the reliability of digital human communication.

[0191] In one embodiment, the data communication method further includes:

[0192] The digital human media stream is sent to the called terminal, so that the called terminal decodes the digital human media stream to obtain a digital human image and displays the digital human image.

[0193] In one embodiment, the network end sends the digital media stream to the called terminal. The network end and the called terminal can transmit data through a reliable transmission protocol. The called terminal can decode the digital human media to obtain a digital human image. The specific decoding process of the called terminal can be video decoding and / or audio decoding, and the digital human image in the digital human media stream is restored through video decoding and / or audio decoding. The called terminal can display the digital human image, and the user can see the appearance, expression, and action of the digital human on the screen of the called terminal.

[0194] In one embodiment, the data communication method further includes:

[0195] A second communication channel is established with the called terminal, and a third communication channel is established with the calling terminal.

[0196] In an embodiment, the network end establishes a second communication channel with the called terminal, and the network end can transmit data to the called terminal through the second communication channel. The network end establishes a third communication channel with the calling terminal. The network end can transmit data to the calling terminal through the third communication channel.

[0197] In the embodiment, by establishing the second communication channel and the third communication channel for data transmission with the called terminal and the calling terminal respectively, the reliability of data transmission is improved.

[0198] In an embodiment, the second communication channel is used to anchor the audio and video stream of the called terminal to the network end, and the third communication channel is used to anchor the audio and video stream of the calling terminal to the network end.

[0199] In an embodiment, the network end can establish a second communication channel with the called terminal, and the network end can receive the audio and video stream of the called terminal through the second communication channel. The network end can establish a third communication channel with the calling terminal, and the network end can receive the audio and video stream of the calling terminal through the third communication channel. The network end can perform synchronization processing according to the received audio and video stream of the called terminal and the audio and video stream of the calling terminal.

[0200] In the embodiment, by anchoring the audio and video stream to the network end, bidirectional transmission and synchronization of the digital human media stream can be realized, and a stable data transmission foundation is provided for digital human application.

[0201] In an embodiment, the second communication channel is RTP or ADC, and the third communication channel is RTP or ADC.

[0202] In an embodiment, the ADC can be a personal-to-application (P2A) application data channel.

[0203] In an embodiment, the network end can establish a second communication channel with the called terminal, and the second communication channel can be RTP or ADC. Using RTP can realize real-time data transmission. For example, the network end can transmit the digital human media stream to the called terminal in real time through RTP, and a timestamp can be carried.

[0204] The network end can establish a third communication channel with the calling terminal, and the third communication channel can be RTP or ADC. Using RTP can realize real-time data transmission. For example, the network end can transmit the digital human metadata to the called terminal in real time through RTP, and a timestamp can be carried.

[0205] In the embodiment, by using the real-time transmission protocol or the application data channel, synchronous data transmission is ensured, the efficiency of data transmission is improved, and the delay is reduced.

[0206] In an embodiment, the digital human metadata sent by the calling terminal is received, including:

[0207] The digital human metadata sent by the calling terminal is received through a third communication channel.

[0208] In an embodiment, the network end can receive the digital human metadata sent by the calling terminal through a third communication channel.

[0209] In an embodiment, the digital human media stream is sent to the called terminal, including:

[0210] The digital human media stream is sent to the called terminal through a second communication channel.

[0211] In an embodiment, the network end sends the digital human media stream to the called terminal through a second communication channel.

[0212] In an embodiment, the data communication method further includes:

[0213] Sending a rendering capability to a server.

[0214] In an embodiment, the rendering capability is used by the server to determine whether the network end meets a preset rendering condition.

[0215] In an embodiment, the server can determine the rendering capability of the network end based on user selection or business policy. The server can determine the rendering capability negotiation result of the network end according to the relationship between the network end and the preset condition. If the network end meets the preset condition, the rendering capability negotiation result of the network end is to determine the network end as a rendering subject; otherwise, the network end cannot be determined as a rendering subject.

[0216] In this embodiment, by sending the rendering capability to the server, the server can determine the rendering subject according to the rendering capability, so as to realize the determination of the rendering subject according to the rendering capability, thereby realizing the digital human communication in the multi-rendering mode.

[0217] In an embodiment, the data communication method further includes:

[0218] A fourth communication channel between the network end and the server is established.

[0219] In an embodiment, the fourth communication channel is used to determine the network end.

[0220] In an embodiment, the network end initiates media renegotiation to the called terminal, so as to connect the digital human media stream of the called terminal to the corresponding network end.

[0221] In an embodiment, FIG. 5 provides a signaling interaction flow diagram of a data communication method. As shown in FIG. 5, the calling terminal is a rendering subject. The method includes the following steps:

[0222] The calling terminal initiates re-INVITE, adds media description related to digital human communication, and establishes an RTP and / or ADC channel between the calling terminal and the called terminal.

[0223] The calling terminal sends a rendering request to the server, and the rendering request carries a target digital human identifier.

[0224] The server obtains a basic digital human image corresponding to the target digital human identifier from a basic digital human image storage network element, and returns the basic digital human image to the calling terminal.

[0225] The calling terminal captures digital human metadata, renders and encodes the basic digital human image based on the digital human metadata, and obtains a digital human media stream.

[0226] The calling terminal sends the digital human media stream to the called terminal based on RTP or ADC.

[0227] The called terminal decodes the digital human media stream, obtains a digital human image, and displays the digital human image to a user.

[0228] In one embodiment, FIG. 6 provides a signaling interaction flow diagram of a data communication method. As shown in FIG. 6, the called terminal is the rendering subject. The method includes the following steps:

[0229] The calling terminal initiates re-INVITE, adds media description related to digital human communication, and establishes an RTP and / or ADC channel between the calling terminal and the called terminal.

[0230] The calling terminal sends a rendering request to the server, and the rendering request carries a target digital human identifier.

[0231] The server obtains a basic digital human image corresponding to the target digital human identifier from a basic digital human image storage network element, and returns the basic digital human image to the calling terminal.

[0232] The server sends a rendering response to the calling terminal, and the calling terminal captures digital human metadata.

[0233] The calling terminal sends the digital human metadata to the called terminal through an RTP or ADC channel.

[0234] The called terminal renders a basic digital human image based on the digital human metadata, obtains a digital human media stream, determines the digital human media stream as a digital human image, and displays the digital human image to a user.

[0235] In one embodiment, FIG. 7 provides a signaling interaction flow diagram of a data communication method. As shown in FIG. 7, the network is the rendering subject. The method includes the following steps:

[0236] The calling terminal and the network end establish an RTP or ADC channel; the called terminal and the network end establish an RTP or ADC channel.

[0237] The calling terminal sends a rendering request to the server, and the rendering request carries a target digital human identifier.

[0238] The server obtains a basic digital human image corresponding to the target digital human identifier for rendering from a basic digital human image storage network element and returns it to the network end.

[0239] The server sends a rendering response to the calling terminal, and the calling terminal captures digital human metadata.

[0240] The calling terminal sends the digital human metadata to the network end through the RTP or ADC channel.

[0241] The network end renders and encodes the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0242] The network end sends the digital human media stream to the called terminal based on RTP or ADC.

[0243] The called terminal decodes the digital human media stream to obtain a digital human image and displays the digital human image to the user.

[0244] In one embodiment, FIG. 8 provides a signaling interaction flow diagram of a data communication method. As shown in FIG. 8, the method includes the following steps:

[0245] The calling terminal and the called terminal establish a voice and video session and a guide data channel.

[0246] The calling terminal initiates a digital human image rendering capability negotiation request to the server, carrying the digital human rendering capability of the calling terminal.

[0247] The server requests the rendering capability of the called terminal from the called terminal, and the called terminal returns the rendering capability of the called terminal to the server.

[0248] The server requests the rendering capability of the network end from the network end, and the network end returns the rendering capability of the network end to the server.

[0249] The server determines the rendering subject based on the rendering capabilities reported by the calling terminal, the called terminal and the network end and a local policy.

[0250] The server returns the rendering capability negotiation result to the calling terminal, the called terminal and the network end respectively.

[0251] It should be understood that although the steps in the flowcharts of FIGS. 2-8 are shown in sequential order, such that each step must be completed before another step begins, the steps do not have to be performed in the order shown. Unless explicitly stated, the steps can be performed in any order, and need not be performed in the order shown. Furthermore, at least some of the steps in FIGS. 2-8 can include multiple steps or stages, which need not be performed in the order shown, and can be performed at different times, and need not be performed sequentially, but can be performed in parallel or in an interleaved manner with at least some of the steps or stages of other steps or stages.

[0252] In an embodiment, as shown in FIG. 9, a data communication apparatus applied to a server is provided, and the apparatus comprises a sending module 90, wherein:

[0253] The sending module 90 is configured to send a basic digital human image to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on digital human metadata to obtain a digital human media stream, and the basic digital human image corresponds to a target digital human identifier.

[0254] In an embodiment, the terminal is a calling terminal, and the sending module 90 is specifically configured to send the basic digital human image to the calling terminal if the calling terminal meets a preset rendering condition, so that the calling terminal renders the basic digital human image based on the digital human metadata to obtain the digital human media stream, and sends the digital human media stream to a called terminal through a first communication channel for decoding processing to obtain a digital human image, and the digital human image is displayed on the called terminal, and the first communication channel is a communication channel between the calling terminal and the called terminal.

[0255] In an embodiment, the terminal is a called terminal, and the sending module 90 is specifically configured to send the basic digital human image to the called terminal if the called terminal meets a preset rendering condition, so that the called terminal renders the basic digital human image based on the digital human metadata to obtain the digital human media stream, determines the digital human media stream as the digital human image, and displays the digital human image, and the digital human metadata is sent to the called terminal by the calling terminal through the first communication channel.

[0256] In an embodiment, the terminal is a called terminal, and the sending module 90 is specifically configured to send the basic digital human image to the called terminal if the called terminal meets a preset rendering condition, so that the called terminal renders the basic digital human image based on the digital human metadata to obtain the digital human media stream, determines the digital human media stream as the digital human image, and displays the digital human image, and the digital human metadata is sent to the called terminal by the calling terminal through the first communication channel.

[0257] In an embodiment, the first communication channel is a real-time transport protocol (RTP) or an application data channel (ADC).

[0258] In one embodiment, the receiving module is configured to receive a target request sent by the calling terminal, the target request carrying a target digital human identifier; and based on a correspondence between the digital human identifier and a basic digital human image, obtain a basic digital human image corresponding to the target digital human identifier.

[0259] In one embodiment, the target request is a rendering request or an animation request.

[0260] In one embodiment, the processing module is configured to determine a rendering capability of the target communication device.

[0261] determine a relationship between the rendering capability of the target communication device and a preset condition, and determine a rendering capability negotiation result of the target communication device, the rendering capability negotiation result indicating whether the target communication device meets a preset rendering condition, the target communication device including one or more of the calling terminal, the called terminal, or the network side.

[0262] In one embodiment, the processing module is configured to determine, based on the rendering capability identifier, whether the calling terminal, the called terminal, or the network side meets the preset rendering condition.

[0263] In one embodiment, as shown in FIG. 10, a data communication apparatus is provided, applied to a terminal, and the apparatus includes a first receiving module 1001 and a first rendering module 1002, wherein:

[0264] The first receiving module 1001 is configured to receive a basic digital human image sent by a server, the basic digital human image corresponding to a target digital human identifier.

[0265] The first rendering module 1002 is configured to render the basic digital human image based on digital human metadata to obtain a digital human media stream.

[0266] In one embodiment, the terminal is a calling terminal, and the sending module is configured to establish a first communication channel with a called terminal and send a target request to a server, the target request being used by the server to determine a basic digital human image.

[0267] In one embodiment, the target request is a rendering request or an animation request.

[0268] In one embodiment, the first communication channel is a real-time transport protocol (RTP) or an application data channel (ADC).

[0269] In one embodiment, the sending module is configured to send the digital human media stream to the called terminal based on the first communication channel, so that the called terminal decodes and processes the digital human media stream to obtain a digital human image, and displays the digital human image.

[0270] In one embodiment, the terminal is a called terminal, the first receiving module 1001 is configured to receive digital human metadata sent by a calling terminal through a first communication channel.

[0271] In one embodiment, the processing module is configured to determine the digital human media stream as a digital human image, and display the digital human image.

[0272] In one embodiment, the sending module is configured to send the rendering capability to the server, and the rendering capability is used by the server to determine whether the terminal meets a preset rendering condition.

[0273] In one embodiment, the rendering request carries a target digital human identifier, and the target digital human identifier is used by the server to obtain a basic digital human image corresponding to the target digital human identifier based on a correspondence between the digital human identifier and the basic digital human image.

[0274] In one embodiment, the rendering request carries a rendering capability identifier, and the rendering capability identifier is used by the server to determine whether the calling terminal, the called terminal, or the network side meets a preset rendering condition.

[0275] In one embodiment, as shown in FIG. 11, a data communication apparatus is provided, which is applied to a terminal, and the apparatus comprises a second receiving module 1101 and a second rendering module 1102, wherein:

[0276] The second receiving module 1101 is configured to receive a basic digital human image sent by the server, and the basic digital human image corresponds to a target digital human identifier;

[0277] The second rendering module 1102 is configured to render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0278] In one embodiment, the second rendering module 1102 is configured to receive digital human metadata sent by the calling terminal, and render the basic digital human image based on the digital human metadata to obtain a digital human media stream.

[0279] In one embodiment, the sending module is configured to send the digital human media stream to the called terminal, so that the called terminal decodes and processes the digital human media stream to obtain a digital human image, and displays the digital human image.

[0280] In one embodiment, the establishing module is configured to establish a second communication channel with the called terminal, and establish a third communication channel with the calling terminal.

[0281] In one embodiment, the second communication channel is configured to anchor an audio and video stream of the called terminal to the network side; and the third communication channel is configured to anchor an audio and video stream of the calling terminal to the network side.

[0282] In an embodiment, the second communication channel is RTP or ADC; and the third communication channel is RTP or ADC.

[0283] In an embodiment, the second receiving module 1101 is configured to receive, through the third communication channel, the digital human metadata sent by the calling terminal.

[0284] In an embodiment, the sending module is configured to send, to the called terminal, the digital human media stream through the second communication channel.

[0285] In an embodiment, the sending module is further configured to send, to the server, the rendering capability, where the rendering capability is used by the server to determine whether the network side satisfies a preset rendering condition.

[0286] In an embodiment, the establishing module is further configured to establish a fourth communication channel with the server, where the fourth communication channel is used to determine the network side.

[0287] The specific limitations on the data communication apparatus can refer to the limitations on the data communication method described above, which will not be repeated here. Each module in the above data communication apparatus can be realized by software, hardware, and a combination thereof, in whole or in part. Each module described above can be embedded in or independent of the processor in the computer device in hardware form, or stored in the memory in the computer device in software form, so as to be called and executed by the processor to perform the operations corresponding to each module.

[0288] In an embodiment, a communication device is provided, as shown in FIG. 12. FIG. 12 is a structural schematic diagram of a terminal according to an embodiment of the present application. The terminal device 1200 shown in FIG. 12 includes at least one processor 1201, a memory 1202, at least one network interface 1204, and a user interface 1203. Each component in the terminal device 1200 is coupled together through a bus system 1205. It can be understood that the bus system 1205 is used to realize the connection and communication between the components. In addition to the data bus, the bus system 1205 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, all kinds of buses are marked as the bus system 1205 in FIG. 12. In addition, the present embodiment also includes a transceiver 1206, which can be multiple elements, i.e., including a transmitter and a receiver, providing a unit for communicating with various other devices over a transmission medium.

[0289] The user interface 1203 can include a display, a keyboard, or a pointing device (e.g., a mouse, a trackball, a touchpad, or a touchscreen).

[0290] It is to be understood that the memory 1202 in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable Programmable ROM (EPROM), an Electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a Random Access Memory (RAM) used as an external cache. By way of example, and not limitation, many forms of RAM can be used, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous Dynamic RAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The memory 702 of the system and method described in the embodiments of the present application is intended to include, but not be limited to, these and any other suitable types of memory.

[0291] In some embodiments, the memory 1202 stores the following elements, executable modules or data structures, or a subset thereof, or an extended set thereof: an operating system 12021 and an application program 12022.

[0292] Among them, the operating system 12021 contains various system programs, such as framework layer, core library layer, driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application program 12022 contains various application programs, such as Media Player, Browser, etc., for implementing various application services. The program for implementing the method of the embodiments of the present application can be contained in the application program 12022.

[0293] In the embodiments of the present application, the program or instruction stored in the memory 1202 is called, specifically, the program or instruction stored in the application program 12022, wherein the transmitter is configured to send a basic digital human image to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on digital human metadata to obtain a digital human media stream, and the basic digital human image corresponds to a target digital human identifier.

[0294] It can be understood that the embodiments described in the embodiments of the present application can be realized by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units for performing the functions described in the present application, or a combination thereof.

[0295] For software implementation, the technical solutions of the embodiments of the present application can be implemented by modules (such as processes, functions, etc.) for performing the functions of the embodiments of the present application. The software code can be stored in the memory and executed by the processor 901. The memory can be implemented in the processor 901 or outside the processor 901.

[0296] In one embodiment, a computer readable storage medium is provided, and the computer program is stored on the computer readable storage medium, and the computer program is executed by the processor to implement the following steps:

[0297] The basic digital human image is sent to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on digital human metadata to obtain a digital human media stream, and the basic digital human image corresponds to a target digital human identifier.

[0298] The embodiments of the present application also provide a computer program product containing instructions, which, when running on a computer, causes the computer to execute the following steps:

[0299] The basic digital human image is sent to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on digital human metadata to obtain a digital human media stream, and the basic digital human image corresponds to a target digital human identifier.

[0300] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when executed, can include the processes of the above-mentioned embodiment methods. Any reference to memory, storage, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0301] Any combination of the technical features of the above embodiments can be made. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, but as long as the combination of the technical features does not exist, it should be considered as the scope of the present application.

[0302] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, some modifications and improvements can be made, which are all within the protection scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A data communication method applied to a server, the method comprising: sending a base digital human avatar to a terminal or a network end, so that the terminal or the network end renders the base digital human avatar based on digital human metadata to obtain a digital human media stream, the base digital human avatar corresponding to a target digital human identifier.

2. The method of claim 1, wherein, The terminal is a calling terminal, and the method further comprises: if the calling terminal meets a preset rendering condition, sending a base digital human avatar to the calling terminal, so that the calling terminal renders the base digital human avatar based on digital human metadata to obtain a digital human media stream, and sends the digital human media stream to a called terminal through a first communication channel for decoding processing to obtain a digital human avatar, and displaying the digital human avatar on the called terminal, the first communication channel being a communication channel between the calling terminal and the called terminal.

3. The method of claim 1, wherein, The terminal is a called terminal, and the method further comprises: if the called terminal meets a preset rendering condition, sending a base digital human avatar to the called terminal, so that the called terminal renders the base digital human avatar based on the digital human metadata to obtain a digital human media stream, determines the digital human media stream as a digital human avatar, and displays the digital human avatar, the digital human metadata being sent by a calling terminal to the called terminal through a first communication channel.

4. The method of claim 1, further comprising: if the network end meets a preset rendering condition, sending a base digital human avatar to the network end, so that the network end renders the base digital human avatar based on digital human metadata to obtain a digital human media stream, and sends the digital human media stream to a called terminal for decoding processing to obtain a digital human avatar, and displaying the digital human avatar on the called terminal.

5. The method of claim 2 or 3, wherein, The first communication channel is a real-time transport protocol (RTP) or an application data channel (ADC).

6. The method of any one of claims 2 or 3, further comprising: receiving a target request sent by the calling terminal, the target request carrying the target digital human identifier; based on the correspondence between the digital human identifier and the base digital human avatar, obtaining the base digital human avatar corresponding to the target digital human identifier.

7. The method of claim 6, further comprising: pre-storing the correspondence between the digital human identifier and the base digital human avatar in a base digital human library.

8. The method of claim 6, wherein, The target request is a rendering request or an animation request.

9. The method of claim 1, further comprising: determining the rendering capability of a target communication device; judging the relationship between the rendering capability of the target communication device and a preset condition to determine a rendering capability negotiation result of the target communication device, the rendering capability negotiation result indicating whether the target communication device meets a preset rendering condition, the target communication device including one or more of a calling terminal, a called terminal, or the network end.

10. The method of claim 8, wherein, The rendering request further carries a rendering capability identifier, and the method further comprises: based on the rendering capability identifier, determining whether the calling terminal, the called terminal, or the network end meets the preset rendering condition.

11. A data communication method applied to a terminal, the method comprising: receiving a base digital human avatar sent by a server, the base digital human avatar corresponding to a target digital human identifier; rendering the base digital human avatar based on digital human metadata to obtain a digital human media stream.

12. The method of claim 11, wherein, The terminal is a calling terminal, and the method further comprises: establishing a first communication channel with a called terminal and sending a target request to the server, the target request being used by the server to determine the base digital human avatar.

13. The method of claim 12, wherein, The target request is a rendering request or an animation request.

14. The method of claim 12, wherein, The first communication channel is a real-time transport protocol (RTP) or an application data channel (ADC).

15. The method of claim 12, further comprising: sending the digital human media stream to the called terminal based on the first communication channel, so that the called terminal decodes and processes the digital human media stream to obtain a digital human avatar and displays the digital human avatar.

16. The method of claim 11, wherein, The terminal is a called terminal, and the method further comprises: receiving the digital human metadata sent by the calling terminal through the first communication channel.

17. The method of claim 16, further comprising: determining the digital human media stream as the digital human avatar and displaying the digital human avatar.

18. The method of claim 11, further comprising: sending a rendering capability to the server, the rendering capability being used by the server to determine whether the terminal meets a preset rendering condition.

19. The method of claim 13, wherein, The target digital human identifier is carried in the rendering request, and is used by the server to obtain the base digital human avatar corresponding to the target digital human identifier based on a correspondence between digital human identifiers and base digital human avatars.

20. The method of claim 13, wherein, The rendering capability identifier is carried in the rendering request, and is used by the server to determine whether the calling terminal, the called terminal, or a network end meets a preset rendering condition.

21. A method of data communication, wherein, The method applied to a network end, comprising: receiving a base digital human avatar sent by a server, the base digital human avatar corresponding to a target digital human identifier; rendering the base digital human avatar based on digital human metadata to obtain a digital human media stream.

22. The method of claim 21, wherein, The rendering of the base digital human avatar based on the digital human metadata to obtain the digital human media stream comprises: receiving digital human metadata sent by a calling terminal, and rendering the base digital human avatar based on the digital human metadata to obtain a digital human media stream.

23. The method of claim 21, further comprising: sending the digital human media stream to a called terminal, so that the called terminal decodes and processes the digital human media stream to obtain a digital human avatar and displays the digital human avatar.

24. The method of claim 21, further comprising: establishing a second communication channel with a called terminal and establishing a third communication channel with a calling terminal.

25. The method of claim 24, wherein, The second communication channel is used to anchor an audio and video stream of the called terminal to the network end, and the third communication channel is used to anchor an audio and video stream of the calling terminal to the network end.

26. The method of claim 24, wherein, The second communication channel is an RTP or an ADC, and the third communication channel is an RTP or an ADC.

27. The method of claim 22 or 24, wherein, The digital human metadata sent by the calling terminal is received, including: The digital human metadata sent by the calling terminal is received through the third communication channel.

28. The method of claim 23 or 24, wherein, The digital human media stream is sent to the called terminal, including: The digital human media stream is sent to the called terminal through the second communication channel.

29. The method of claim 21, further comprising: sending rendering capability to the server, the rendering capability being used by the server to determine whether the network end meets a preset rendering condition.

30. The method of claim 21, further comprising: establishing a fourth communication channel with the server, the fourth communication channel being used to determine the network end.

31. A data communication device applied to a server, the device comprising: a sending module configured to send a basic digital human image corresponding to a target digital human identifier to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on digital human metadata to obtain a digital human media stream.

32. A data communication device applied to a terminal, the device comprising: a first receiving module configured to receive a basic digital human image sent by a server, the basic digital human image corresponding to a target digital human identifier; a first rendering module configured to render the basic digital human image based on digital human metadata to obtain a digital human media stream.

33. A data communication device applied to a network end, the device comprising: a second receiving module configured to receive a basic digital human image sent by a server, the basic digital human image corresponding to a target digital human identifier; a second rendering module configured to render the basic digital human image based on digital human metadata to obtain a digital human media stream.

34. A communication device comprising: a transmitter; the transmitter is configured to send a basic digital human image corresponding to a target digital human identifier to a terminal or a network end, so that the terminal or the network end renders the basic digital human image based on digital human metadata to obtain a digital human media stream.

35. A computer readable storage medium having stored thereon a computer program, wherein, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 30.

36. A computer program product comprising a computer program, wherein, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 30.

Images