Digital human communication methods and apparatuses, UE, network side device, medium and computer program product
By obtaining the digital human identification and address information during the digital human communication process and using the network side equipment or other user equipment on the other end to render the digital human media, the problem of poor digital human call quality caused by insufficient user device resources is solved, and a better digital human call experience is achieved.
Patent Information
- Application Number
- PCT/CN2025/085831
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-04-03
- Filing Date
- 2025-03-28
- Publication Date
- 2025-10-09
AI Technical Summary
Due to low battery or insufficient computing power of the user's device, digital human media rendering cannot be performed locally, resulting in poor digital human call quality.
During the establishment of the application data channel for digital human communication, the user device obtains the digital human identification and address information, and performs digital human media rendering through the network side device or other user device at the other end.
The effect of digital human calls has been improved, ensuring that even if the user device resources are insufficient, digital human media rendering can be completed through network-side devices or other user devices.
Smart Images

Figure CN2025085831_09102025_PF_FP_ABST
Abstract
Description
Digital human communication method, device, UE, network-side equipment, medium and computer program product
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to Chinese Patent Application No. 202410403732.9 filed in China on April 3, 2024, the entire contents of which are incorporated herein by reference. Technical Field
[0003] The present application belongs to the field of communication technology, and specifically relates to a digital human communication method, device, UE, network-side equipment, medium and computer program product. Background Art
[0004] Currently, the fifth generation mobile communication technology (5G) new call NG-Real-time Communications (RTC) is based on 5G NR-based voice call (VoNR) multimedia real-time communication and equipped with a new data transmission channel, providing users with a new real-time communication service that integrates high-definition audio and video calls with data applications. Among them, there are two types of data transmission channels: the Bootstrap Data Channel (BDC) and the Application Data Channel (ADC). The Bootstrap Data Channel can be used to download applications from the Data Channel Signaling Function (DCSF), and the Application Data Channel can be used to transmit application data.
[0005] On this basis, user equipment (UE) can conduct high-definition audio and video calls using digital human avatars based on the Internet Protocol Multimedia Subsystem (IMS). Typically, a UE can initiate IMS communication with a peer UE, decode the acquired avatar repository (AR) media, perform AR media rendering locally, and display the rendered avatar on the screen, completing the digital human call.
[0006] However, since the above method can only perform digital human media rendering locally on the UE, when the UE is unable to perform digital human media rendering, such as due to low battery or insufficient computing power, the UE will be unable to perform digital human media rendering, which will result in poor digital human calls using the digital human image. Summary of the Invention
[0007] The embodiments of the present application provide a digital human communication method, apparatus, UE, network-side equipment, medium, and computer program product, which can improve the effect of digital human calls.
[0008] In a first aspect, a digital human communication method is provided, which is executed by a first network-side device. The method includes: during the establishment of an application data channel for digital human communication, the first network-side device obtains a first message, wherein the first message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the image of the first digital human; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the image of the first digital human.
[0009] In a second aspect, a digital human communication method is provided, which is executed by a second UE, and the method includes: during the establishment of an application data channel for digital human communication, the second UE obtains an eighth message; wherein the eighth message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the image of the first digital human; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of a second network side device, and the second network device stores the image of the first digital human.
[0010] In a third aspect, a digital human communication method is provided, which is executed by a fourth network side device. The method includes: during the establishment of an application data channel for digital human communication, the fourth network side device obtains a fourteenth message, and the fourteenth message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the first digital human image; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of a second network side device, and the second network device stores the first digital human image.
[0011] In a fourth aspect, a digital human communication method is provided, which is executed by a third network side device. The method includes: during the establishment of an application data channel for digital human communication, the third network side device obtains an eighteenth message, and the eighteenth message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the first digital human image; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of a second network side device, and the second network device stores the first digital human image.
[0012] In a fifth aspect, a digital human communication method is provided, which is executed by a first UE. The method includes: during the establishment of an application data channel for digital human communication, the first UE sends an eighteenth message, and the eighteenth message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the image of the first digital human; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of a second network side device, and the second network device stores the image of the first digital human.
[0013] In a sixth aspect, a digital human communication device is provided, which includes: a first acquisition module; the first acquisition module is used to obtain a first message during the establishment of an application data channel for digital human communication, wherein the first message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the image of the first digital human; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of a second network side device, and the second network device stores the image of the first digital human.
[0014] In the seventh aspect, a digital human communication device is provided, which includes: a second acquisition module; the second acquisition module is used for the second UE to obtain an eighth message during the establishment of an application data channel for digital human communication; wherein the eighth message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the first digital human image; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of the second network side device, and the second network device stores the first digital human image.
[0015] In an eighth aspect, a digital human communication device is provided, which includes: a third acquisition module; the third acquisition module is used to obtain a fourteenth message during the establishment of an application data channel for digital human communication, and the fourteenth message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the first digital human image; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of a second network side device, and the second network device stores the first digital human image.
[0016] In the ninth aspect, a digital human communication device is provided, which includes: a fourth acquisition module; the fourth acquisition module is used to obtain an eighteenth message during the establishment of an application data channel for digital human communication, and the eighteenth message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the first digital human image; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of a second network side device, and the second network device stores the first digital human image.
[0017] In the tenth aspect, a digital human communication device is provided, which includes: a fifth sending module; the fifth sending module is used to send an eighteenth message during the establishment of an application data channel for digital human communication, and the eighteenth message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the first digital human image; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of a second network side device, and the second network device stores the first digital human image.
[0018] In the eleventh aspect, a UE is provided, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the second aspect or the fifth aspect are implemented.
[0019] In a twelfth aspect, a UE is provided, comprising a processor and a communication interface, wherein the communication interface is used to obtain an eighth message, or to send an eighteenth message to a third network side device.
[0020] In the thirteenth aspect, a network side device is provided, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect, the third aspect, or the fourth aspect are implemented.
[0021] In the fourteenth aspect, a network side device is provided, including a processor and a communication interface, wherein the communication interface is used to obtain a first message, or to obtain a fourteenth message, or to obtain an eighteenth message.
[0022] In the fifteenth aspect, a readable storage medium is provided, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented, or the steps of the method described in the second aspect are implemented, or the steps of the method described in the third aspect are implemented, or the steps of the method described in the fourth aspect are implemented, or the steps of the method described in the fifth aspect are implemented.
[0023] In the sixteenth aspect, a wireless communication system is provided, including: a UE and a network side device, wherein the UE can be used to execute the steps of the method described in the second aspect or the fifth aspect, and the network side device can be used to execute the steps of the method described in the first aspect, the third aspect or the fourth aspect.
[0024] In the seventeenth aspect, a chip is provided, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the method described in the first aspect, or the steps of the method described in the second aspect, or the steps of the method described in the third aspect, or the steps of the method described in the fourth aspect, or the steps of the method described in the fifth aspect.
[0025] In aspect 18, a computer program / program product is provided, which is stored in a storage medium, and is executed by at least one processor to implement the steps of the method described in aspect 1, or the steps of the method described in aspect 2, or the steps of the method described in aspect 3, or the steps of the method described in aspect 4, or the steps of the method described in aspect 5.
[0026] In an embodiment of the present application, during the establishment of an application data channel for digital human communication, a first network-side device receives a first message; wherein the first message includes at least one of the following: a first digital human identifier, which identifies the first digital human image; first address information, which indicates an address for downloading the digital human image; and second address information, which indicates an address of a second network-side device, where the first digital human image is stored. Alternatively, during the establishment of an application data channel for digital human communication, a second UE receives an eighth message; wherein the eighth message includes at least one of the following: a first digital human identifier, which identifies the first digital human image; first address information, which indicates an address for downloading the digital human image; and second address information, which indicates an address of a second network-side device, where the first digital human image is stored. With this solution, during a digital human call, when a first UE requests another device to perform digital human media rendering for it, the first UE can provide digital human-related information to the second UE or the first network-side device on the other end, so that the second UE or the first network-side device can perform digital human media rendering for the first UE. Improved the quality of digital human conversations conducted with a digital human avatar. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] FIG1 is a schematic diagram of a possible structure of a communication system involved in an embodiment of the present invention;
[0028] FIG2 is a schematic diagram of a process for establishing a P2P ADC according to an embodiment of the present application;
[0029] FIG3 is a schematic diagram of a process for establishing a P2P2A ADC according to an embodiment of the present application;
[0030] FIG4 is a schematic diagram of a process for establishing a P2A ADC according to an embodiment of the present application;
[0031] FIG5 is a schematic diagram of a process of UE-centered digital human media rendering provided by an embodiment of the present application;
[0032] FIG6 is a flow chart of a digital human media rendering process centered on a network-side device, provided in an embodiment of the present application;
[0033] FIG7 is a flow chart of a digital human communication method according to an embodiment of the present application;
[0034] FIG8 is a schematic diagram of an example flow chart of a digital human communication method provided in an embodiment of the present application;
[0035] FIG9 is a second example flow diagram of a digital human communication method provided in an embodiment of the present application;
[0036] FIG10 is a second flow chart of a digital human communication method provided in an embodiment of the present application;
[0037] FIG11 is a third example flow diagram of a digital human communication method provided in an embodiment of the present application;
[0038] FIG12 is a fourth example flow diagram of a digital human communication method provided in an embodiment of the present application;
[0039] FIG13 is a third flow chart of a digital human communication method provided in an embodiment of the present application;
[0040] FIG14 is a fourth flow chart of a digital human communication method provided in an embodiment of the present application;
[0041] FIG15 is a fifth flow chart of a digital human communication method provided in an embodiment of the present application;
[0042] FIG16 is a schematic structural diagram of a digital human communication device provided in an embodiment of the present application;
[0043] FIG17 is a schematic structural diagram of a digital human communication device provided in an embodiment of the present application;
[0044] FIG18 is a schematic structural diagram of a digital human communication device provided in an embodiment of the present application;
[0045] FIG19 is a schematic structural diagram of a digital human communication device provided in an embodiment of the present application;
[0046] FIG20 is a schematic structural diagram of a digital human communication device provided in an embodiment of the present application;
[0047] FIG21 is a schematic diagram of the hardware structure of a communication device provided in an embodiment of the present application;
[0048] FIG22 is a schematic diagram of the hardware structure of a UE provided in an embodiment of the present application;
[0049] Figure 23 is a schematic diagram of the hardware structure of a network-side device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0050] The following will be combined with the accompanying drawings in the embodiments of this application to clearly describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.
[0051] The terms "first", "second", etc. in this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same type, and do not limit the number of objects, for example, the first object can be one or more. In addition, "or" in this application represents at least one of the connected objects. For example, "A or B" covers three options, namely, Option 1: including A but not including B; Option 2: including B but not including A; Option 3: including both A and B. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.
[0052] The term "indication" in this application can be either a direct indication (or explicit indication) or an indirect indication (or implicit indication). A direct indication can be understood as the sender explicitly informing the receiver of specific information, the operation to be performed, or the requested result, etc. in the instruction sent; an indirect indication can be understood as the receiver determining the corresponding information based on the instruction sent by the sender, or making a judgment and determining the operation to be performed or the requested result, etc. based on the judgment result.
[0053] The terms "at least one" and "at least one of" in this application refer to any one, any two, or a combination of more than two of the objects included. For example, at least one of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c", and "a, b, and c", where a, b, and c can be single or multiple. Similarly, "at least two" means two or more, and its meaning is similar to "at least one".
[0054] It is worth noting that the technology described in the embodiments of the present application is not limited to the Long Term Evolution (LTE) / LTE-Advanced (LTE-A) system, but can also be used in other wireless communication systems, such as Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Frequency Division Multiple Access (FDMA), Orthogonal Frequency Division Multiple Access (OFDMA), Single-carrier Frequency-Division Multiple Access (SC-FDMA) or other systems. The terms "system" and "network" in the embodiments of the present application are often used interchangeably, and the technology described can be used for the systems and radio technologies mentioned above, as well as for other systems and radio technologies. The following description describes a New Radio (NR) system for illustrative purposes, and NR terminology is used in most of the following description, but these technologies can also be applied to systems other than NR systems, such as 6th generation (6G) systems. th Generation, 6G) communication system.
[0055] FIG1 shows a block diagram of a wireless communication system applicable to an embodiment of the present application. The wireless communication system includes a UE 11 and a network-side device 12. The UE 11 may be a mobile phone, a tablet computer, a laptop computer, a notebook computer, a personal digital assistant (PDA), a handheld computer, a netbook, an ultra-mobile personal computer (UMPC), a mobile internet device (MID), an augmented reality (AR), a virtual reality (VR) device, a robot, a wearable device, a flight vehicle, a vehicle user equipment (VUE), a ship-borne device, a pedestrian user equipment (PUE), a smart home (a household appliance with wireless communication capabilities, such as a refrigerator, a television, a washing machine, or furniture), a game console, a personal computer (PC), a teller machine, or a self-service machine, or other UE-side device. Wearable devices include: smart watches, smart bracelets, smart headphones, smart glasses, smart jewelry (smart bracelets, smart bracelets, smart rings, smart necklaces, smart anklets, smart anklets, etc.), smart wristbands, smart clothing, etc. Among them, the vehicle-mounted equipment can also be referred to as a vehicle-mounted UE, a vehicle-mounted controller, a vehicle-mounted module, a vehicle-mounted component, a vehicle-mounted chip or a vehicle-mounted unit, etc. It should be noted that the specific type of UE11 is not limited in the embodiment of the present application. The network side device 12 may include an access network device or a core network device, wherein the access network device may also be referred to as a radio access network (Radio Access Network, RAN) device, a radio access network function or a radio access network unit. The access network device may include a base station, a wireless local area network (WLAN) access point (AS) or a wireless fidelity (WiFi) node, etc.Among them, the base station can be referred to as Node B (NB), Evolved Node B (eNB), the next generation Node B (gNB), New Radio Node B (NR Node B), access point, Relay Base Station (RBS), Serving Base Station (SBS), Base Transceiver Station (BTS), radio base station, radio transceiver, Basic Service Set (BSS), Extended Service Set (ESS), Home Node B (HNB), Home evolved Node B (home evolved Node B), Transmission Reception Point (TRP) or other appropriate terms in the relevant field. As long as the same technical effect is achieved, the base station is not limited to specific technical vocabulary. It should be noted that in the embodiment of the present application, only the base station in the NR system is used as an example for introduction, and the specific type of the base station is not limited.
[0056] The following describes the user-to-user (Person to Person, P2P) ADC establishment process, the user-to-application-to-user (Person to Application to Person, P2A2P) ADC establishment process, and the user-to-application (Person to Application, P2A) ADC establishment process in the digital human communication process with reference to the accompanying drawings.
[0057] 1. P2P ADC establishment process
[0058] As shown in FIG. 2 , FIG. 2 is a schematic diagram of a process of establishing a P2P ADC. The process of establishing a P2P ADC may include the following steps S100 to S119 .
[0059] S100, IMS session and BDC have been established.
[0060] The selected data channel application can be downloaded to UE1 or UE2.
[0061] S101 and UE1 send a Session Initiation Protocol (SIP) reinviter request with an updated Session Description Protocol (SDP) to the IMS Application Server (AS) via the Proxy Call Session Control Function (P-CSCF) and Serving-Call Session Control Function (S-CSCF). The updated SDP contains the bootstrap data channel information, the requested application data channel, and the associated data channel (DC) application binding information.
[0062] S102: The IMS AS verifies the user subscription data to determine whether the media change request event should be notified to the DCSF.
[0063] S103. The IMS AS notifies the DCSF of the media change request event through Nimsas_SessionEventControl_Notify.
[0064] The Nimsas_session event control_notification may include a media change request event, a session identifier (Identity, ID), an event direction, an event initiator, and a media information list.
[0065] S104. After receiving the session event notification, the DCSF determines a policy for processing the application data channel establishment request based on the notification and / or relevant parameters in the DCSF service-specific policy (ie, the associated DC application binding information).
[0066] S105. The DCSF determines that the added application data channel media descriptor provided by the SDP takes UE 2 as the target endpoint and does not need to be anchored on a local Management Function (MF) or Media Resource Function (MRF).
[0067] S106. The DCSF responds to the notification received in step S13.
[0068] S107-S108. The IMS AS sends the re-invite to the initiating S-CSCF, and then sends it to the terminating network (Terminating network) / UE2.
[0069] S109-S111, the terminating network / UE2 returns a 200 OK response.
[0070] The 200 OK response may include an SDP answer for the application data channel to the originating network. Based on the DC application binding information received in the re-invite SDP offer, UE2 may need to download the corresponding DC application sent in the SDP offer and associate it with the requested application DC.
[0071] It should be noted that the terminating network / UE2 can decide whether to use the DC application based on the received DC application binding information.
[0072] S112. The IMS AS notifies the DCSF that the data channel modification is successful.
[0073] S113. The DCSF responds to the notification received in step S112.
[0074] S114-S115. The IMS AS sends a 200 OK response to the initiating S-CSCF and P-CSCF.
[0075] S116. The originating network P-CSCF performs a Quality of Service (QoS) process on the application data channel media based on the SDP answer information from the 200 OK response.
[0076] S117. The P-CSCF returns a 200 OK response to UE1.
[0077] S118. UE1 sends an ACK to the terminating network / UE2.
[0078] S119: Establish an application data channel between UE1 and UE2.
[0079] 2. P2A2P ADC establishment process
[0080] The P2A2P process requires the establishment of application data channels from UE1 to the MF and from UE2 to the MF. These two application data channels are associated with the same application. This allows UE1 and UE2 to interact with the same DC application server at the same time, and the DC application server can associate the data exchanged with the two UEs.
[0081] As shown in FIG3 , FIG3 is a schematic diagram of a process of establishing a P2A2P ADC. The process of establishing a P2A2P ADC may include the following steps S200 to S226 .
[0082] S200: The IMS session and the bootstrap data channel are successfully established.
[0083] The selected data channel application can be downloaded to UE1 or UE2.
[0084] S201. UE1 sends a SIP re-invite request with updated SDP to the IMS AS.
[0085] The updated SDP includes the boot data channel, application data channel information and associated DC application binding information.
[0086] S202: The IMS AS verifies the data channel media description information and / or user subscription data to determine whether the DCSF needs to be notified.
[0087] S203: The IMS AS selects and notifies the DCSF of the call event and the data channel establishment request.
[0088] S204. The DCSF decides how to process the application data channel establishment request according to the parameters in the IMS AS and / or DCSF service-specific policy notification.
[0089] The parameters in the above-mentioned specific policy notification may be the associated DC application binding information.
[0090] S205: The DCSF determines that the application data channel media (meida) added in the SDP offer requires a DC application server as the originating and terminating UE endpoint, and that the application DC must be anchored to the MF or MRF. The DCSF communicates with the DC application server to implement data center resource control. Once the application data channel is established, the DC application server will send and receive traffic to UE1 over the MDC2 interface.
[0091] S206. The DCSF invokes the nimsas_media control (medicontrol) service to send a data channel control request to the IMS AS, including information on how to relay the data channel media through the MDC2 interface.
[0092] S207: The IMS AS reserves data channel media resources in the MF via DC2 or in the MRF via Mr / Cr based on the data channel media information received from the DCSF. These requests sent by the IMS AS are used to create two associated resources in the MF / MRF.
[0093] Among them, one of the two associated resources can be used to initiate the UE (ie, UE1), and the other can be used to terminate the UE (ie, UE2).
[0094] S208. The IMS AS notifies the DCSF of the medi control command control response.
[0095] S209 : The DCSF communicates with the data center application server to control data center resources and provides information about data channel media resources reserved in the MF.
[0096] S210. DCSF stores the media resource information and responds to the Nimsas notification request.
[0097] S211-S212. The IMS AS sends a re-INVITE.
[0098] The re-INVITE may include an SDP proposal provided by the MF or MRF for the application data channel, which is then sent to the original S-CSCF and then to the terminating network / UE2.
[0099] S213-S216, the terminating network / UE2 returns 200 OK.
[0100] The 200 OK may contain SDP responses for audio / video and application data channels. The P-CSCF performs QoS procedures for the application data channel media based on the SDP in the 200 OK. Based on the DC application binding information received in the reinvite, UE2 may need to download the corresponding DC application sent in the SDP offer and associate it with the requested application DC.
[0101] It should be noted that the UE may determine whether to use the data center application according to the received data center application binding information.
[0102] S217: The IMS AS notifies the DCSF of the success result of the MediaChangeRequest event.
[0103] S218. DCSF updates the media resources in MF / MRF through IMS AS.
[0104] S219. DCSF responds to the notification received in step 17.
[0105] S220-S221. The IMS AS includes an SDP response of the application data channel to UE1 in the 200OK, and sends the 200OK to the S-CSCF and the P-CSCF.
[0106] S222: The originating network P-CSCF performs a QoS process on the application data channel media based on the SDP in the 200 OK.
[0107] S223: P-CSCF returns 200 OK to UE1.
[0108] S224. UE1 sends an ACK to the terminating network / UE2.
[0109] S225: An application data channel is established between UE 1 and the DC application server via the MF or MRF. The MF or MRF forwards the data channel traffic between UE 1 and the DC application server via MDC 2.
[0110] S226: An application data channel is established between UE 2 and the DC application server via the MF or MRF. The MF or MRF forwards the data channel traffic between UE 2 and the DC application server via MDC2.
[0111] 3. P2A ADC establishment process
[0112] As shown in FIG4 , FIG4 is a schematic diagram of a process of establishing a P2A ADC. The process of establishing a P2A ADC may include the following steps S300 to S327 .
[0113] S300: The IMS session and the bootstrap data channel are successfully established.
[0114] The selected data channel application can be downloaded to UE1 or UE2.
[0115] S301. UE1 sends a SIP re-invite request with updated SDP to the IMS AS.
[0116] The updated SDP includes the boot data channel, application data channel information and associated DC application binding information.
[0117] S302: The IMS AS verifies the data channel media description information and / or user subscription data to determine whether the DCSF needs to be notified.
[0118] S303: The IMS AS selects and notifies the DCSF of the call event and the data channel establishment request.
[0119] S304: After receiving the session event notification, the DCSF determines a policy for processing the application data channel establishment request based on the notification and / or relevant parameters in the DCSF service-specific policy.
[0120] S305: The DCSF determines that the added offered application data channel media uses the DC application server as the target endpoint and needs to be anchored in the MF or MRF.
[0121] S306: The DCSF invokes the nimsas_medicontrol service operation to instruct the IMS AS to terminate the media flow initiated from the UE to the MF.
[0122] The instruction instructing the IMS AS to terminate the media flow initiated from the UE to the MF also includes information to be used by the MF, that is, the data channel media should be forwarded through the MDC2 interface.
[0123] S307. The IMS AS calls the media termination descriptor list (Nmf_MRM_Create) service operation and instructs the MF to establish an application data channel and reserve data channel media resources according to the DC media information received from the DCSF.
[0124] If MRF is used, the IMS AS can use Mr / Cr to MRF to reserve data channel media resources.
[0125] S308. The IMS AS notifies the DCSF of a medicontrol command control response.
[0126] S309. DCSF stores the media resource information and sends a P2A application data channel establishment request to the DC application server through DC3 / DC4.
[0127] The above media resource information may include MDC2 media resources received from the MF / MRF.
[0128] S310 , the DC application server accepts the P2A application data channel establishment request, returns the media resources reserved by MDC2 as a response, and prepares for UE1 traffic passing through MDC2.
[0129] The team would like to note that detailed information on how the DCSF communicates with the DC Application Server is outside the scope of this release.
[0130] S311. The DCSF requests the IMS AS to update the MF / MRF resources with the MDC2 media endpoint information of the DC application server.
[0131] S312. The IMS AS updates MF / MRF resources.
[0132] S313. The IMS AS notifies the DCSF of a medicontrol command control response.
[0133] S314. DCSF responds to the notification received in step S313.
[0134] S315-S316. The IMS AS sends a re-invite to the terminating network / UE2 through the original S-CSCF.
[0135] The S-CSCF does not include an application data channel request in the SDP of the application data channel.
[0136] S317-S319, the terminating network / UE2 returns a 200 OK response,
[0137] The 200 OK response may include an SDP answer for the audio / video.
[0138] S320: The IMS AS notifies the DCSF of the success result of the MediaChangeRequest event.
[0139] S321, DCSF reply notification.
[0140] S322-S323. The IMS AS includes the SDP response of the application data channel to UE1 in the 200 OK response, and sends a 200 OK response to the S-CSCF and P-CSCF.
[0141] S324. The initial network P-CSCF performs a QoS process on the application data channel medium based on the SDP answer information from the 200 OK response.
[0142] S325. CSCF returns a 200 OK response to UE1.
[0143] S326. UE1 sends an ACK to the terminating network / UE2.
[0144] S327: The application data channel between UE 1 and the DC application server is established via the MF or MRF. The MF or MRF forwards the data channel traffic between UE 1 and the DC application server based on the MDC2 media point information received in steps S309 and S312.
[0145] Furthermore, the following describes UE-centric augmented reality (AR) media rendering and network-side device-centric AR media rendering with reference to the accompanying drawings.
[0146] 1. UE-centered digital human media rendering
[0147] As shown in FIG5 , FIG5 is a schematic diagram of a process of AR media rendering centered on a UE. The AR media rendering process centered on a UE may include the following steps S401 to S406 .
[0148] S401. UE1 and UE2 initiate IMS communication, including establishing a bootstrap data channel.
[0149] S402: The user upgrades the IMS session through the AR experience.
[0150] Specifically, UE1 can initiate a re-invite and add the media descriptors required by the AR application to establish end-to-end, such as RTP and / or application data channels. The application data channel can be anchored in the MF / MRF.
[0151] In this scenario, the UE can perform AR media rendering based on the AR data of the local application.
[0152] It should be noted that, in other cases, the UE may obtain AR data from other sources, such as a peer UE, an AR AS, and the like.
[0153] S403 : UE1 captures AR data, performs AR media rendering locally, and then encodes AR media, such as audio / video media streams.
[0154] S404 : UE1 sends AR media to the peer end through the established media connection.
[0155] S405 : UE1 receives AR media from the peer end through the established media connection.
[0156] S406: UE1 decodes the AR media, renders it locally, and displays it on its screen.
[0157] 2. AR media rendering centered on network-side devices
[0158] As shown in FIG6 , FIG6 is a schematic diagram of a process of AR media rendering centered on a network-side device. The AR media rendering process centered on a network-side device may include the following steps S501 to S509 .
[0159] S501. UE1 initiates an IMS session and establishes an audio and video session connection with UE2.
[0160] It is understandable that UE1 and UE2 can establish the bootstrap data channel at the same time.
[0161] S502 : UE1 decides to request network media rendering based on its own status, such as power, signal, computing capability, internal storage, etc.
[0162] S503 : UE1 completes AR media rendering negotiation with the AR application server.
[0163] S504: If the negotiation in step S503 is successful, UE1 initiates a new P2A application data channel for ARAR data transmission between UE1 and the network. During the P2A application data channel establishment process, DCSF will instruct MF / MRF through IMS AS on how to establish the data channel and corresponding media processing specifications.
[0164] Optionally, in S505 , the IMS AS initiates a media renegotiation request to UE1 to connect the audio and video media streams of UE1 to the MF / MRF.
[0165] S506 : The IMS initiates a media renegotiation request to UE2 to connect the audio and video media streams of UE2 to the MF / MRF.
[0166] If the status of UE1 changes, such as low power consumption, low computing power, etc., UE1 can request to change the network rendering content.
[0167] S507 : UE1 captures AR data and sends the AR data to MF / MRF for network-assisted rendering.
[0168] S508 : Based on the AR data received from UE1 and / or the instruction received from the AR AS, the MF / MRF performs AR media rendering according to the negotiation result of step 3 .
[0169] S509 : The MF / MRF sends the presented audio / video media stream to UE2.
[0170] In the digital human communication method provided by the embodiment of the present application, during the process of establishing an application data channel for digital human communication, if the first UE requires other devices to perform digital human media rendering for it, the first UE can provide digital human-related information to the second UE or the first network-side device at the opposite end, so that the digital human media rendering can be performed for the first UE by the second UE or the first network-side device at the opposite end, thereby improving the effect of digital human calls conducted in the digital human image.
[0171] The following, in combination with the accompanying drawings, describes in detail the digital human communication method, device, UE, network-side equipment, medium and computer program product provided in the embodiments of the present application through some embodiments and their application scenarios.
[0172] FIG7 shows a flow chart of a digital human communication method provided in an embodiment of the present application. As shown in FIG7 , the digital human communication method may include the following step 201 .
[0173] Step 201: During the process of establishing an application data channel for digital human communication, a first network-side device obtains a first message.
[0174] The first message may include at least one of the following:
[0175] A first digital person identifier, which is used to identify the image of the first digital person;
[0176] First address information, the first address information is used to indicate the address for downloading the digital human image;
[0177] The second address information is used to indicate the address of the second network side device, and the second network device stores the first digital human image.
[0178] In some embodiments of the present application, the first network-side device may be an MF.
[0179] In some embodiments of the present application, the above-mentioned digital human identification may be a digital human ID (Avatar ID).
[0180] In some embodiments of the present application, the first digital human identifier may be used to identify a first digital human avatar. The user may use the first digital human avatar during a digital human call. In other words, the first digital human identifier may be the digital human identifier of the digital human avatar used by the user of the first UE during digital human communication.
[0181] In some embodiments of the present application, the first UE may be a device that requires the first network-side device to perform digital human media rendering for it.
[0182] Exemplarily, the first digital human identifier may be a digital human identifier selected by a user of the first UE.
[0183] In some embodiments of the present application, the first digital human image may be avatar metadata.
[0184] It should be noted that the above-mentioned digital human image metadata can also be called digital human image, digital human image information, data human data, basic digital human, digital human information, digital human model and other different names, but technical personnel in this field can understand that although these names are different, the essence is the same.
[0185] Specifically, digital avatar metadata is the 2D or 3D representational content of an avatar stored in a file; alternatively, digital avatar metadata is the 2D or 3D representational model of an avatar stored in a file that can be accessed via a Uniform Resource Locator (URL). Digital avatar metadata can be stored in an Avatar Repository (AR), a Data Channel Avatar Repository (DCAR), or other network functions. Digital avatar metadata, or a reference to digital avatar metadata, such as an identifier, can be associated with each user and / or with each user's user identifier. Digital avatar metadata needs to correspond to the face, the entire body, or a portion of the body. Other metadata can be associated with the avatar metadata, such as format, resolution, access / usage permissions and time, creation date, permissions, etc.
[0186] In some embodiments of the present application, the address for downloading the digital human image may be a download URL of the digital human image.
[0187] In some embodiments of the present application, the address for downloading the digital human image may also be referred to as the address for downloading the image data corresponding to the digital human identifier.
[0188] In some embodiments of the present application, the second network-side device may be a digital human image warehouse application server.
[0189] In some embodiments of the present application, the second address information may be a URL of the second network-side device.
[0190] In some embodiments of the present application, after the first UE participating in the digital human communication downloads the digital human image that it wants to use in the digital human communication on the BDC, or after the BDC obtains the digital human identification list, or obtains the download address of the digital human image, or obtains the download address of the digital human image corresponding to the selected digital human identification, if the first UE does not need network assistance for rendering, it can directly establish the ADC for UE-side rendering of the digital human communication.
[0191] In the digital human communication method provided in the embodiments of the present application, if a first UE requires another device to render the digital human for it, such as when the first UE is low on battery, has insufficient computing power, or does not want to render on its own, then a second UE or network-side device on the other end can perform the rendering. In this case, the urgent problem of allowing the second UE or network-side device on the other end to obtain the digital human image and perform the rendering is solved.
[0192] In some embodiments of the present application, the first network side device can obtain the digital human image that performs digital human media rendering for the first UE by obtaining a message containing at least one of a digital human identifier, an address indicating downloading the digital human image, and an address indicating the second network side device.
[0193] In the digital human communication method provided in the embodiment of the present application, the first network side device can obtain at least one of the digital human identifier, the address indicating the downloading of the digital human image, and the address indicating the second network side device during the establishment of the application data channel for digital human communication, thereby performing digital human media rendering for the UE to improve the effect of digital human communication.
[0194] In some embodiments of the present application, the first message may include the first address information, or the first message may include the first digital human identifier and the first address information.
[0195] In some embodiments of the present application, the digital human communication method provided by the embodiments of the present application may further include the following step 202.
[0196] Step 202: The first network-side device downloads the digital human image based on the first address information.
[0197] In some embodiments of the present application, when the first message includes the first address information, the first network-side device can directly download the digital human image based on the first address information.
[0198] In some embodiments of the present application, the first message includes a first digital human identifier and first address information. When downloading a digital human image based on the first address information, the first network-side device can determine that the downloaded digital human image is the digital human image corresponding to the first digital human identifier.
[0199] In this way, when the first message contains the first address information, or when the first message contains the first digital human identifier and the first address information, the first network side device can directly download the digital human image based on the first address information, thereby performing digital human media rendering for the UE to improve the effect of digital human communication.
[0200] In some embodiments of the present application, the first message may include at least one of a first digital human identifier and a second address information.
[0201] In some embodiments of the present application, the digital human communication method provided by the embodiments of the present application may further include the following step 203.
[0202] Step 203: The first network-side device obtains the first address information corresponding to the first digital human identifier from the second network-side device or the third network-side device, and downloads the digital human image based on the first address information.
[0203] In some embodiments of the present application, the third network-side device may be an IMS AS.
[0204] In some embodiments of the present application, when the first message includes the first digital human identifier, the digital human communication method provided by the embodiment of the present application may further include the following step 204.
[0205] Step 204: The first network-side device obtains first address information from the third network-side device.
[0206] In some embodiments of the present application, when the first message includes the first digital human identifier, the first network side device can obtain the first address information corresponding to the first digital human identifier from the third network side device, and download the digital human image based on the first address information.
[0207] In some embodiments of the present application, the above step 204 may include the following step 204a.
[0208] Step 204a: The first network-side device receives a second message sent by the third network-side device.
[0209] Among them, the above-mentioned second message may include first address information, which is obtained by the fourth network side device from the second network side device based on the first digital human identifier, and the second network side device is used to provide the first address information corresponding to the first digital human identifier.
[0210] In some embodiments of the present application, the above-mentioned second network side device may include the address information of the download address of the digital human image corresponding to at least one digital human identification; or, the above-mentioned second network side device stores the correspondence between at least one digital human identification and the address information of the download address of at least one digital human image.
[0211] In some embodiments of the present application, the at least one digital human identification includes a first digital human identification.
[0212] In some embodiments of the present application, the fourth network-side device may be a DCSF.
[0213] In some embodiments of the present application, a third network device may select and notify a fourth network device of a call event and a data channel establishment request. The data channel establishment request may include the aforementioned first digital human identifier. The fourth network device may then send the first digital human identifier to the second network device. Upon receiving the first digital human identifier, the second network device may return the first address information corresponding to the first digital human identifier to the fourth network device. The fourth network device may then include the first address information in a second message and send it to the first network device.
[0214] In some embodiments of the present application, the third network-side device may reserve data channel media resources in the MF through DC2 or in the MRF through Mr / Cr based on the data channel media information received from the fourth network-side device.
[0215] In some embodiments of the present application, the request sent by the third network-side device may be used to create two associated resources in the MF / MRF, one of which may be used to initiate the UE (i.e., the first UE) and the other may be used to terminate the UE (i.e., the second UE).
[0216] In some embodiments of the present application, the third network-side device may provide a download URL of the digital human image to the first network-side device, so that the first network-side device can subsequently perform digital human media rendering for the first UE.
[0217] In some embodiments of the present application, when the first message includes the first digital human identification and the second address information, the digital human communication method provided by the embodiment of the present application may further include the following step 205.
[0218] Step 205: The first network-side device obtains first address information from the second network-side device, and downloads the digital human image based on the first address information.
[0219] Among them, the above-mentioned second network side device is used to provide the first address information corresponding to the first digital human identifier.
[0220] In some embodiments of the present application, the "first network-side device obtains the first address information from the second network-side device" in the above step 205 may include the following steps 205a and 205b.
[0221] Step 205a: The first network-side device sends a third message to the second network-side device.
[0222] The third message may carry the first digital human identifier.
[0223] Step 205b: The first network-side device receives the fourth message sent by the second network-side device.
[0224] The fourth message may include the first address information.
[0225] In some embodiments of the present application, when the first message includes the first digital human identifier and the address of the second network side device, the first network side device can directly access the second network side device based on the address of the second network side device, and obtain the first address information based on the first digital human identifier.
[0226] In this way, when the first message contains at least one of the first digital human identifier and the second address information, the first network side device can obtain the first address information corresponding to the first digital human identifier from the second network side device or the third network side device, and download the digital human image based on the first address information, thereby improving the flexibility of the first network side device in obtaining the first address information.
[0227] In some embodiments of the present application, the above step of "the first network-side device downloads the digital human image based on the first address information" may include the following step A.
[0228] Step A: The first network-side device downloads the digital human image based on the first address information through the application data channel.
[0229] In some embodiments of the present application, after the application data channel is established, the first network-side device may download the digital human image based on the first address information through the application data channel.
[0230] In this way, the first network-side device can obtain the address information required to download the digital human image during the establishment of the application data channel, so that the digital human image can be downloaded immediately after the application data channel is established, thereby improving the efficiency of rendering for the UE.
[0231] In some embodiments of the present application, before the above step 201, the digital human communication method provided by the embodiment of the present application may further include the following step 206.
[0232] Step 206: The first network side device negotiates with the first user equipment UE whether to perform digital human media rendering for the first UE based on at least one of the capability information and power information of the first user equipment UE and the capability information of the first network side device.
[0233] In some embodiments of the present application, the capability information of the first network side device is used to indicate whether the first network side device has the ability to render digital human media, and the capability information of the first network side device includes at least one of the following: computing power information, load information, and capability information for providing data channel services.
[0234] In some embodiments of the present application, at least one of the capability information and power information of the above-mentioned first UE is used to indicate whether the first UE has the ability to render digital human media, and the capability information of the first UE includes at least one of the following: computing power information, load information, and capability information of providing data channel services.
[0235] In some embodiments of the present application, when the first network side device performs digital human media rendering for the first UE, the first network side device and the first UE can negotiate whether the first network side device performs digital human media rendering for the first UE based on at least one of the capability information and power information of the first user equipment UE, and the capability information of the first network side device.
[0236] In this way, digital human media rendering can be performed for the UE while ensuring that the first network-side device has the capability of performing digital human media rendering.
[0237] In some embodiments of the present application, the digital human communication method provided by the embodiments of the present application may further include the following step 207.
[0238] Step 207: After the application data channel is established, the first network-side device performs digital human media rendering.
[0239] In some embodiments of the present application, the first network-side device can obtain the address information required to download the digital human image during the establishment of the application data channel, so that the digital human image can be downloaded immediately and the digital human media rendering can be performed after the application data channel is established, thereby improving the efficiency of rendering for the UE.
[0240] In some embodiments of the present application, after the above step 207, the digital human communication method provided by the application embodiment may further include the following step 208.
[0241] Step 208: The first network-side device sends a fifth message to the second UE.
[0242] The fifth message may include rendered digital human media.
[0243] In some embodiments of the present application, after the first network side device performs digital human media rendering, the rendered digital human media can be sent to the second UE. After receiving the rendered digital human media, the second UE can display it to complete the digital human communication.
[0244] In some embodiments of the present application, the digital human communication method provided by the embodiments of the present application may further include the following step 209.
[0245] Step 209: After the application data channel is established, the first network-side device receives a sixth message sent by the first UE.
[0246] Among them, the above-mentioned sixth message may include digital human related data of the first UE.
[0247] In some embodiments of the present application, the digital human-related data of the above-mentioned first UE may include at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
[0248] In some embodiments of the present application, the above step 207 may include the following step 207a.
[0249] Step 207a: After the application data channel is established, the first network-side device performs digital human media rendering on the digital human image based on the digital human-related data of the user of the first UE.
[0250] In some embodiments of the present application, the first UE may send the captured user's character information as digital human-related data to the first network-side device, so that the first network-side device may perform digital human media rendering on the digital human image based on the digital human-related data.
[0251] It can be understood that after the first network side device obtains the digital human related data, it performs digital human media rendering on the digital human image based on the digital human related data. The rendered digital human media can have the same or similar expressions, actions, sounds and other features as the user of the first UE, thereby improving the effect of digital human communication.
[0252] In some embodiments of the present application, before the above step 209, the digital human communication method provided by the embodiment of the present application may further include the following step 210.
[0253] Step 210: The first network-side device sends a seventh message to the first UE, where the seventh message is used to indicate that the downloading of the digital human image is complete.
[0254] In some embodiments of the present application, the first network-side device may send a seventh message to the first UE after the download of the digital human image is completed, to notify the first UE that the digital human-related data may be sent to the first network-side device, so that the rendered digital human media has a better display effect.
[0255] The following takes the first UE as UE1, the second UE as UE2, the first network side device as MF, the second network side device as AR, and the third network side device as IMS AS as an example to illustrate the digital human communication method provided in the embodiment of the present application.
[0256] As shown in FIG8 , the digital human communication method provided in the embodiment of the present application includes the following steps:
[0257] S600: UE1 negotiates with the first network-side device, and decides that the first network-side device performs digital human media rendering for UE1 based on the capabilities, power consumption, computing resources, etc. of UE1 and the network.
[0258] S601. UE1 sends a SIP reinvite request with an updated SDP to the IMS AS through the initiating network P-CSCF and S-CSCF.
[0259] In some embodiments of the present application, the updated SDP offer includes boot data channel information, requested application data channel and associated DC application binding information, and digital human image information.
[0260] In some embodiments of the present application, the above-mentioned digital human image information may include at least one of the following: a first digital human identifier, which is used to identify the first digital human image; first address information, which is used to indicate the address for downloading the digital human image; and second address information, which is used to indicate the address of the second network side device, where the second network device stores the first digital human image.
[0261] S603: The IMS AS selects and notifies the DCSF of the call event and the data channel establishment request.
[0262] In some embodiments of the present application, the above-mentioned call event and data channel establishment request may carry the first message provided by the UE in the SDP offer.
[0263] For example, UE1 may provide a selected first digital human identifier, and MF subsequently needs to obtain the corresponding digital image data from AR and perform rendering.
[0264] S605-1. After obtaining the first digital human identifier, the DCSF requests the AR for the digital human image.
[0265] In some embodiments of the present application, the request for the digital human image may carry the first digital human identifier.
[0266] S605-2. AR returns the download URL corresponding to the digital human image
[0267] It should be noted that if the first message in step S601 carries the download URL corresponding to the digital human image, step S605 may not be performed.
[0268] S606: DCSF returns the download URL to the IMS AS.
[0269] S607: Based on the data channel media information received from the DCSF, the IMS AS reserves the data channel media resources at the MF via DC2 or at the MRF via Mr / Cr, and provides the MF with the download URL of the digital human image.
[0270] S627: After the application data channel is successfully established, the MF can download the avatar data through the obtained download URL.
[0271] In some embodiments of the present application, the MF may also directly download the digital human image after receiving the download URL, which is not specifically limited in the present application.
[0272] S628 : The MF performs rendering of the digital human image for the UE.
[0273] In this way, the first network side device can obtain at least one of the digital human identification, the address indicating the downloading of the digital human image, and the address indicating the second network side device during the establishment of the application data channel for digital human communication, so as to perform digital human media rendering for the UE to improve the effect of digital human communication.
[0274] Example 2: As shown in FIG9 , the digital human communication method provided in this embodiment of the application includes the following steps:
[0275] S707: After the ADC is established, UE1 provides the MF with a download URL for the digital human image through a data channel.
[0276] In some embodiments of the present application, the download URL of the digital human image may be obtained by UE1 from BDC.
[0277] S708. MF downloads the digital human image according to the download URL.
[0278] S709 , MF notifies UE1 that the downloading of the digital human image has been completed.
[0279] S710. UE1 obtains the user's digital human related data and sends it to MF.
[0280] In some embodiments of the present application, the aforementioned digital human-related data may include, but is not limited to, information such as the user's gestures, face, and voice.
[0281] In some embodiments of the present application, the aforementioned digital human-related data may be used to render digital human media data.
[0282] S711, MF performs digital human media rendering
[0283] S712. The MF sends the rendered digital human media to the peer UE2 via RTP or ADC.
[0284] In some embodiments of the present application, when the established data channel is P2A ADC, the MF may send the rendered digital human media to UE2 via RTP; when the established data channel is P2A2P ADC, the MF may send the rendered digital human media to UE2 via RTP or ADC.
[0285] In this way, the first network side device can perform digital human media rendering for the first UE, so that the first UE and the second UE can smoothly conduct a digital human call, thereby improving the effect of the digital human call conducted in the digital human image.
[0286] FIG10 shows a flow chart of a digital human communication method provided in an embodiment of the present application. As shown in FIG10 , the digital human communication method may include the following step 301 .
[0287] Step 301: During the process of establishing an application data channel for digital human communication, the second UE obtains an eighth message.
[0288] The eighth message may include at least one of the following:
[0289] A first digital person identifier, which is used to identify the image of the first digital person;
[0290] First address information, the first address information is used to indicate the address for downloading the digital human image;
[0291] The second address information is used to indicate the address of the second network side device, and the second network device stores the first digital human image.
[0292] In some embodiments of the present application, the second UE may be a UE participating in digital human communication, which may be a peer UE of the first UE.
[0293] In some embodiments of the present application, the second UE can obtain the digital human image that performs digital human media rendering for the first UE by obtaining a message containing at least one of a digital human identifier, an address indicating downloading the digital human image, and an address indicating a second network side device.
[0294] In some embodiments of the present application, the eighth message may be carried in a re-invite message sent by the third network-side device.
[0295] In some embodiments of the present application, the third network-side device may resend the invitation message to the fifth network-side device, which then sends the invitation message to the second UE.
[0296] In some embodiments of the present application, the fifth network-side device may be an I / S-CSCF.
[0297] In the digital human communication method provided in the embodiment of the present application, the second UE can obtain at least one of the digital human identifier, the address indicating the downloading of the digital human image, and the address indicating the second network side device during the establishment of the application data channel for digital human communication, so as to perform digital human media rendering for the first UE to improve the effect of digital human communication.
[0298] For other descriptions of the first digital person identifier, the first address information, and the second address information, please refer to the relevant description in the above step 201. To avoid repetition, they will not be repeated here.
[0299] In some embodiments of the present application, the eighth message may include the first address information, or the eighth message may include the first digital human identifier and the first address information.
[0300] In some embodiments of the present application, the digital human communication method provided by the embodiments of the present application may further include the following step 302.
[0301] Step 302: The second UE downloads the digital human image based on the first address information.
[0302] In some embodiments of the present application, when the first message includes the first address information, the second UE may directly download the digital human image based on the first address information.
[0303] In some embodiments of the present application, the first message includes a first digital human identifier and first address information. When the second UE downloads a digital human image based on the first address information, it can determine that the downloaded digital human image is the digital human image corresponding to the first digital human identifier.
[0304] In this way, when the first message contains the first address information, or when the first message contains the first digital human identifier and the first address information, the second UE can directly download the digital human image based on the first address information, thereby performing digital human media rendering for the UE to improve the effect of digital human communication.
[0305] In some embodiments of the present application, the eighth message may include at least one of the first digital human identifier and the second address information.
[0306] In some embodiments of the present application, the digital human communication method provided by the embodiments of the present application may further include the following step 303.
[0307] Step 303: The second UE obtains the first address information from the second network-side device or the fifth network-side device, and downloads the digital human image based on the first address information.
[0308] In some embodiments of the present application, the fifth network-side device may be an I / S-CSCF.
[0309] In some embodiments of the present application, when the eighth message mentioned above includes the first digital human identifier, the digital human communication method provided by the embodiment of the present application may further include the following step 304.
[0310] Step 304: The second UE obtains first address information from the fifth network-side device.
[0311] In some embodiments of the present application, when the first message includes the first digital human identifier, the second UE can directly obtain the first address information corresponding to the first digital human identifier from the fifth network side device, and download the digital human image based on the first address information.
[0312] In some embodiments of the present application, the above step 304 may include the following step 304a.
[0313] Step 304a: The second UE receives a ninth message sent by the fifth network-side device.
[0314] Among them, the above-mentioned ninth message may include the first address information. The ninth message is obtained by the fifth network side device from the third network side device. The first address information is obtained by the fourth network side device from the second network side device based on the first digital human identifier and sent to the third network side device. The second network side device is used to provide the first address information corresponding to the first digital human identifier.
[0315] In some embodiments of the present application, the above-mentioned second network side device may include the address information of the download address of the digital human image corresponding to at least one digital human identification; or, the above-mentioned second network side device may store the correspondence between at least one digital human identification and the address information of the download address of at least one digital human image.
[0316] The at least one digital human identification may include a first digital human identification.
[0317] In some embodiments of the present application, the third network device may send the first digital human identifier to the fourth network device. The fourth network device may then send the first digital human identifier to the second network device. Upon receiving the first digital human identifier, the second network device may return the first address information corresponding to the first digital human identifier to the fourth network device. The fourth network device may then return the first address information to the third network device. The third network device may carry the first address information in a ninth message and send it to the second UE.
[0318] In some embodiments of the present application, when the first information includes the first digital human identification and the second address information, the digital human communication method provided by the embodiment of the present application may further include the following step 305.
[0319] Step 305: The second UE obtains the first address information from the second network-side device, and downloads the digital human image based on the first address information.
[0320] The second network side device is used to provide first address information corresponding to the first digital human identifier.
[0321] In some embodiments of the present application, the “second UE obtains the first address information from the second network side device” in the above step 305 may include the following steps 305a and 305b.
[0322] Step 305a: The second UE sends a tenth message to the second network-side device, where the tenth message carries the first digital human identifier;
[0323] Step 305b: The second UE receives the eleventh message sent by the second network side device, where the eleventh message includes the first address information.
[0324] In some embodiments of the present application, when the eighth message includes the first digital human identifier and the address of the second network side device, the second UE can directly access the second network side device based on the address of the second network side device, and obtain the first address information from the second network side device based on the first digital human identifier.
[0325] In this way, when the first message contains at least one of the first digital human identifier and the second address information, the second UE can obtain the first address information corresponding to the first digital human identifier from the second network side device or the third network side device, and download the digital human image based on the first address information, thereby improving the flexibility of the first network side device in obtaining the first address information.
[0326] In some embodiments of the present application, the above step of "the second UE downloads the digital human image based on the first address information" may include the following step B.
[0327] Step B: The second UE downloads the digital human image based on the first address information through the application data channel.
[0328] In some embodiments of the present application, after the application data channel is established, the second UE may download the digital human image based on the first address information through the application data channel.
[0329] In this way, the second UE can obtain the address information required to download the digital human image during the establishment of the application data channel, so that the digital human image can be downloaded immediately after the application data channel is established, thereby improving the efficiency of rendering for the first UE.
[0330] In some embodiments of the present application, before the above step 301, the digital human communication method provided by the embodiment of the present application may further include the following step 306.
[0331] Step 306: The second UE negotiates with the first UE and the first network-side device whether the second UE performs digital human media rendering for the first UE based on at least one of the capability information and power information of the first UE, at least one of the capability information and power information of the second UE, and the capability information of the first network-side device.
[0332] In some embodiments of the present application, the capability information and power information of the second UE can be used to indicate whether the second UE has the ability to render digital human media. The capability information of the second UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services.
[0333] In some embodiments of the present application, the capability information and power information of the first UE are used to indicate whether the first UE has the ability to render digital human media, and the capability information of the first UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services.
[0334] In some embodiments of the present application, when the second UE performs digital human media rendering for the first UE, the second UE and the first UE can negotiate whether the second UE performs digital human media rendering for the first UE based on at least one of the capability information and power information of the first UE, at least one of the capability information and power information of the second UE, and the capability information of the first network side device.
[0335] In this way, digital human media rendering can be performed for the first UE while ensuring that the second UE has the capability of performing digital human media rendering.
[0336] In some embodiments of the present application, the digital human communication method provided by the embodiments of the present application may further include the following step 307.
[0337] Step 307: After the application data channel is established, the second UE performs digital human media rendering.
[0338] In some embodiments of the present application, the second UE can obtain the address information required to download the digital human image during the establishment of the application data channel, so that after the application data channel is established, the digital human image can be immediately downloaded and the digital human media rendering can be performed, thereby improving the efficiency of rendering for the first UE.
[0339] In some embodiments of the present application, the digital human communication method provided by the embodiments of the present application may further include the following step 308.
[0340] Step 308: After the application data channel is established, the second UE receives the twelfth message sent by the first UE.
[0341] The twelfth message may include digital human-related data of the first UE.
[0342] In some embodiments of the present application, the digital human-related data of the above-mentioned first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
[0343] In some embodiments of the present application, the above step 307 may include the following step 307a.
[0344] Step 307a: The second UE performs digital human media rendering on the digital human image based on the digital human related data of the first UE.
[0345] In some embodiments of the present application, the first UE may send the captured character information of the user as digital human-related data to the second UE, so that the second UE may perform digital human media rendering on the digital human image based on the digital human-related data.
[0346] It is understandable that after the second UE obtains the digital human-related data, it performs digital human media rendering on the digital human image based on the digital human-related data. The rendered digital human media can have the same or similar expressions, actions, sounds and other features as the user of the first UE, thereby improving the effect of digital human communication.
[0347] In some embodiments of the present application, before the above step 308, the digital human communication method provided by the embodiment of the present application may further include the following step 309.
[0348] Step 309: The second UE sends a thirteenth message to the first UE. The thirteenth message is used to indicate that the downloading of the digital human image is completed.
[0349] In some embodiments of the present application, after the digital human image is downloaded, the second UE may send a thirteenth message to the first UE to notify the first UE that the digital human-related data may be sent to the second UE, so that the rendered digital human media has a better display effect.
[0350] The following takes the first UE as UE1, the second UE as UE2, the first network side device as MF, the second network side device as AR, the third network side device as IMS AS, the fourth network side device as DCSF, and the fifth network side device as IS-CSCF as an example to illustrate the digital human communication method provided in the embodiment of the present application.
[0351] Example 3: As shown in FIG11 , the digital human communication method provided in the embodiment of the present application includes the following steps:
[0352] S801. UE1 sends a SIP reinvite request with an updated SDP to the IMS AS through the initiating network P-CSCF and S-CSCF.
[0353] In some embodiments of the present application, the updated SDP offer may include boot data channel information, requested application data channel and associated DC application binding information, and digital human image information.
[0354] In some embodiments of the present application, the above-mentioned digital human image information may include at least one of the following: a first digital human identifier, which is used to identify the first digital human image; first address information, which is used to indicate the address for downloading the digital human image; and second address information, which is used to indicate the address of a second network side device, where the first digital human image is stored.
[0355] S805-1. When the eighth message carries the first digital human identifier, the DCSF requests the AR for the digital human image.
[0356] In some embodiments of the present application, the request for the digital human image may carry the first digital human identifier.
[0357] S805-2. AR returns the first address information corresponding to the digital human image.
[0358] S807-S808. The IMS AS may send a re-invite message to the I / S-CSCF, and then the I / S-CSCF sends the re-invite message to UE2.
[0359] In some embodiments of the present application, the re-invite message may carry the eighth message or the first address information returned by the AR.
[0360] S809: When the eighth message carries at least the first address information, UE2 downloads the digital human image according to the first address information.
[0361] Exemplarily, when the eighth message carries at least the download URL corresponding to the first digital human identifier, UE2 can directly download the digital human image according to the download URL.
[0362] It should be noted that steps S805-1 and S805-2, and step S809 may be performed alternatively. That is, if the eighth message carries the first digital personal identifier, steps S805-1 and S805-2 may be performed, but step S809 may not be performed; if the eighth message carries at least the first address information, step S809 may be performed, but steps S805-1 and S805-2 may not be performed.
[0363] S820. UE1 obtains digital human related data used to generate a digital human image in digital human communication.
[0364] For example, UE1 may capture information such as actions, expressions, and sounds of the user of UE1.
[0365] S821. UE2 performs digital human media rendering.
[0366] S822. UE2 displays the digital human image of UE1.
[0367] In this way, the second UE can obtain at least one of the digital human identification, the address indicating the downloading of the digital human image, and the address indicating the second network side device during the establishment of the application data channel for digital human communication, so as to perform digital human media rendering for the first UE to improve the effect of digital human communication.
[0368] Example 4: As shown in FIG12 , the digital human communication method provided in the embodiment of the present application includes the following steps:
[0369] S903: After the ADC is established, UE1 provides UE2 with a download URL for the digital human image through a data channel.
[0370] In some embodiments of the present application, UE1 may select a digital human image and determine a digital human identifier corresponding to the digital human image during the BDC process.
[0371] S904. UE2 downloads the digital human image through the download URL.
[0372] S905 , UE2 sends a digital human image download completion message to UE1.
[0373] S906. UE1 sends the digital human related data of UE1 to UE2.
[0374] S907 , UE2 performs digital human media rendering on the digital human image based on the digital human related data of UE1.
[0375] S908. UE2 displays the rendered digital human image.
[0376] In this way, the second UE can perform digital human media rendering for the first UE, so that the first UE and the second UE can smoothly conduct a digital human conversation, thereby improving the effect of the digital human conversation conducted in the digital human image.
[0377] FIG13 shows a flow chart of a digital human communication method provided in an embodiment of the present application. As shown in FIG13 , the digital human communication method may include the following step 401 .
[0378] Step 401: During the process of establishing an application data channel for digital human communication, the fourth network-side device obtains a fourteenth message.
[0379] The fourteenth message may include at least one of the following:
[0380] A first digital person identifier, which is used to identify the image of the first digital person;
[0381] First address information, the first address information is used to indicate the address for downloading the digital human image;
[0382] The second address information is used to indicate the address of the second network side device, and the second network device stores the first digital human image.
[0383] In some embodiments of the present application, after the above step 401, the digital human communication method provided by the embodiment of the present application may further include the following steps 402 to 404.
[0384] Step 402: The fourth network-side device sends a fifteenth message to the second network-side device.
[0385] The fifteenth message may include the first digital human identifier.
[0386] Step 403: The fourth network-side device receives the sixteenth message sent by the second network-side device.
[0387] Among them, the above-mentioned sixteenth message includes the first address information corresponding to the first digital human identifier; the second network side device is used to provide the first address information corresponding to the first digital human identifier.
[0388] Step 404: The fourth network-side device sends a seventeenth message to the third network-side device, where the seventeenth message includes the first address information.
[0389] For detailed descriptions of steps 401 to 404, please refer to the relevant descriptions of steps 201 to 210 and steps 301 to 309. To avoid repetition, they will not be described here.
[0390] In the digital human communication method provided in the embodiment of the present application, the fourth network side device can obtain the first address information corresponding to the first digital human identifier from the second network side device based on the first digital human identifier, and then transmit it to the first network side device or the second UE through the third network side device, so that the first network side device or the second UE can perform digital human media rendering for the first UE, thereby improving the effect of digital human calls conducted in the digital human image.
[0391] FIG14 shows a flow chart of a digital human communication method provided in an embodiment of the present application. As shown in FIG14 , the digital human communication method may include the following step 501 .
[0392] Step 501: During the process of establishing an application data channel for digital human communication, a third network-side device obtains an eighteenth message.
[0393] The eighteenth message may include at least one of the following:
[0394] A first digital person identifier, which is used to identify the image of the first digital person;
[0395] First address information, the first address information is used to indicate the address for downloading the digital human image;
[0396] The second address information is used to indicate the address of the second network side device, and the second network device stores the first digital human image.
[0397] In some embodiments of the present application, after the above step 501, the digital human communication method provided by the embodiment of the present application may further include the following step 502 or step 503.
[0398] Step 502: The third network-side device sends a first message to the first network-side device.
[0399] The first message may include at least one of the following:
[0400] A first digital person identifier, which is used to identify the image of the first digital person;
[0401] First address information, the first address information is used to indicate the address for downloading the digital human image;
[0402] The second address information is used to indicate the address of the second network side device, and the second network device stores the first digital human image.
[0403] Step 503: The third network-side device sends an eighth message to the second UE through the fifth network-side device.
[0404] The eighth message may be used to instruct the second UE to download a digital human image, which is used for digital human communication.
[0405] In some embodiments of the present application, the eighteenth message may include a first digital human identifier.
[0406] In some embodiments of the present application, the digital human communication method provided by the embodiments of the present application may further include the following steps 504 and 505.
[0407] Step 504: The third network-side device sends a fourteenth message to the fourth network-side device.
[0408] The fourteenth message may include the first digital human identifier.
[0409] Step 505: The third network-side device receives the seventeenth message from the fourth network-side device.
[0410] The seventeenth message may include the first address information.
[0411] For detailed descriptions of steps 501 to 505, please refer to the relevant descriptions of steps 201 to 210 and steps 301 to 309. To avoid repetition, they will not be described here.
[0412] In the digital human communication method provided in the embodiment of the present application, the third network side device can obtain the first address information through the fourth network side device, and thus can transmit the first address information to the first network side device or the second UE, so that the first network side device or the second UE can perform digital human media rendering for the first UE, thereby improving the effect of digital human calls conducted in the digital human image.
[0413] FIG15 shows a flow chart of a digital human communication method provided in an embodiment of the present application. As shown in FIG15 , the digital human communication method may include the following step 601 .
[0414] Step 601: During the establishment of an application data channel for digital human communication, the first UE sends an eighteenth message.
[0415] The eighteenth message may include at least one of the following:
[0416] A first digital person identifier, which is used to identify the image of the first digital person;
[0417] First address information, the first address information is used to indicate the address for downloading the digital human image;
[0418] The second address information is used to indicate the address of the second network side device, and the second network device stores the first digital human image.
[0419] In some embodiments of the present application, the first UE may carry the eighteenth message in a SIP message and send it, or may carry the eighteenth message in an SDP offer and send it.
[0420] In some embodiments of the present application, before the above step 601, the digital human communication method provided by the embodiment of the present application may further include the following step 602.
[0421] Step 602: The first UE obtains the eighteenth message during the establishment of the guided data channel.
[0422] In some embodiments of the present application, the digital human communication method provided by the embodiments of the present application may further include the following step 603 or step 604.
[0423] Step 603: The first UE sends six messages to the first network side device.
[0424] Among them, the above-mentioned sixth message may include digital human related data of the first UE.
[0425] Step 604: The first UE sends a twelfth message to the second UE.
[0426] The twelfth message may include digital human-related data of the first UE.
[0427] In some embodiments of the present application, the digital human-related data of the above-mentioned first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
[0428] For detailed descriptions of steps 601 to 604, please refer to the relevant descriptions of steps 201 to 210 and steps 301 to 309. To avoid repetition, they will not be described here.
[0429] In the digital human communication method provided by the embodiment of the present application, during the process of establishing an application data channel for digital human communication, if the first UE requires other devices to perform digital human media rendering for it, the first UE can provide digital human-related information to the second UE or the first network-side device at the opposite end, so that the digital human media rendering can be performed for the first UE by the second UE or the first network-side device at the opposite end, thereby improving the effect of digital human calls conducted in the digital human image.
[0430] Each of the above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or any two or more of them can be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of this application do not limit this.
[0431] The digital human communication method provided in the embodiment of the present application can be executed by a digital human communication device. In the embodiment of the present application, the digital human communication device provided in the embodiment of the present application is described by taking the digital human communication device executing the digital human communication method as an example.
[0432] An embodiment of the present application provides a digital human communication device 160 , as shown in FIG16 . The digital human communication device 160 includes: a first acquisition module 161 .
[0433] Among them, the first acquisition module 161 is used to obtain a first message during the establishment of an application data channel for digital human communication, wherein the first message includes at least one of the following: a first digital human identifier, which is used to identify the image of the first digital human; first address information, which is used to indicate the address for downloading the digital human image; second address information, which is used to indicate the address of a second network side device, and the second network device stores the image of the first digital human.
[0434] In a possible implementation, the first message includes the first address information, or the first message includes the first digital human identifier and the first address information;
[0435] The above-mentioned device further includes: a first downloading module;
[0436] The first downloading module is used to download the digital human image based on the first address information.
[0437] In a possible implementation, the first message includes at least one of a first digital human identifier and second address information;
[0438] The first acquisition module 161 is further configured to acquire first address information corresponding to the first digital human identifier from the second network side device or the third network side device;
[0439] The first downloading module is used to download the digital human image based on the first address information.
[0440] In a possible implementation, the first message includes a first digital human identifier;
[0441] The first acquisition module 161 is further configured to acquire the first address information from the third network-side device.
[0442] In one possible implementation, the above-mentioned first acquisition module 161 is specifically used to receive a second message sent by a third network side device, where the second message includes first address information. The first address information is obtained by the fourth network side device from the second network side device based on the first digital human identifier, and the second network side device is used to provide the first address information corresponding to the first digital human identifier.
[0443] In a possible implementation, the first message includes a first digital human identifier and second address information;
[0444] The first acquisition module 161 is further configured to acquire the first address information from the second network-side device;
[0445] The first downloading module is used to download the digital human image based on the first address information;
[0446] The second network side device is used to provide first address information corresponding to the first digital human identifier.
[0447] In a possible implementation, the apparatus further includes: a first sending module;
[0448] The first sending module is configured to send a third message to the second network-side device, where the third message carries the first digital human identifier;
[0449] The first acquisition module 161 is specifically configured to receive a fourth message sent by the second network-side device, where the fourth message includes the first address information.
[0450] In a possible implementation, the second network-side device includes at least one address information of a download address of a digital human image corresponding to a digital human identifier; or
[0451] The second network side device stores a correspondence between at least one digital human identifier and address information of a download address of at least one digital human image;
[0452] The at least one digital human identification includes a first digital human identification.
[0453] In a possible implementation, the first downloading module is specifically configured to download the digital human image based on the first address information through an application data channel.
[0454] In a possible implementation, the apparatus further includes: a first negotiation module;
[0455] The above-mentioned first negotiation module is used to negotiate with the first UE whether the first network side device performs digital human media rendering for the first UE based on at least one of the capability information and power information of the first user equipment UE and the capability information of the first network side device before the first acquisition module 161 obtains the first message.
[0456] In one possible implementation, the capability information of the first network-side device is used to indicate whether the first network-side device has the capability to render digital human media, and the capability information of the first network-side device includes at least one of the following: computing power information, load information, and capability information for providing data channel services;
[0457] At least one of the capability information and power information of the first UE is used to indicate whether the first UE has the capability to render digital human media. The capability information of the first UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services.
[0458] In a possible implementation, the apparatus further includes: a first rendering module;
[0459] The first rendering module is used to perform digital human media rendering after the application data channel is established.
[0460] In a possible implementation, the first sending module is configured to send a fifth message to the second UE after the first rendering module performs digital human media rendering, where the fifth message includes the rendered digital human media.
[0461] In a possible implementation, the first acquisition module 161 is further configured to receive a sixth message sent by the first UE after the application data channel is established, where the sixth message includes digital human-related data of the first UE.
[0462] In a possible implementation, the first rendering module is specifically configured to perform digital human media rendering on the digital human image based on the digital human-related data of the user of the first UE.
[0463] In a possible implementation, the digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
[0464] In a possible implementation, the first sending module is configured to send a seventh message to the first UE before the first obtaining module 161 receives the sixth message sent by the first UE, where the seventh message is used to indicate that the downloading of the digital human image is complete.
[0465] An embodiment of the present application provides a digital human communication device. In the process of establishing an application data channel for digital human communication, a first network-side device can obtain at least one of a digital human identifier, an address indicating a download address for a digital human image, and an address indicating a second network-side device, thereby performing digital human media rendering for a UE to improve the effect of digital human communication.
[0466] The embodiment of the present application further provides a digital human communication device 170 , as shown in FIG17 . The digital human communication device 170 includes: a second acquisition module 171 .
[0467] Among them, the second acquisition module 171 is used for the second UE to obtain the eighth message during the establishment of the application data channel for digital human communication; wherein the eighth message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the first digital human image; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of the second network side device, and the second network device stores the first digital human image.
[0468] In a possible implementation, the eighth message includes the first address information, or the eighth message includes the first digital human identifier and the first address information;
[0469] The above device also includes: a second download module;
[0470] The second downloading module is used to download the digital human image based on the first address information.
[0471] In a possible implementation, the eighth message includes the first digital human identifier and the second address information;
[0472] The second acquisition module 171 is further configured to acquire the first address information from the second network-side device or the fifth network-side device;
[0473] The second downloading module is used to download the digital human image based on the first address information.
[0474] In a possible implementation, the eighth message includes a first digital human identifier;
[0475] The second acquisition module 171 is further configured to acquire the first address information from the fifth network-side device.
[0476] In one possible implementation, the above-mentioned second acquisition module 171 is specifically used to receive a ninth message sent by the fifth network side device, the ninth message including the first address information, the ninth message is obtained by the fifth network side device from the third network side device, the first address information is obtained by the fourth network side device from the second network side device based on the first digital human identifier and sent to the third network side device, and the second network side device is used to provide the first address information corresponding to the first digital human identifier.
[0477] In a possible implementation, the first information includes a first digital human identifier and second address information;
[0478] The second acquisition module 171 is further configured to acquire the first address information from the second network-side device;
[0479] The second downloading module is used to download the digital human image based on the first address information;
[0480] The second network side device is used to provide first address information corresponding to the first digital human identifier.
[0481] In a possible implementation, the apparatus further includes: a second sending module;
[0482] The second sending module is configured to send a tenth message to the second network-side device, where the tenth message carries the first digital human identifier;
[0483] The second acquisition module 171 is specifically configured to receive an eleventh message sent by the second network-side device, where the eleventh message includes the first address information.
[0484] In a possible implementation, the second network-side device includes at least one address information of a download address of a digital human image corresponding to a digital human identifier; or
[0485] The second network side device stores a correspondence between at least one digital human identifier and address information of a download address of at least one digital human image;
[0486] The at least one digital human identification includes a first digital human identification.
[0487] In a possible implementation, the second downloading module is specifically configured to download the digital human image based on the first address information via an application data channel.
[0488] In a possible implementation, the apparatus further includes: a second negotiation module;
[0489] The above-mentioned second negotiation module is used to negotiate with the first UE and the first network side device whether the second UE performs digital human media rendering for the first UE based on at least one of the capability information and power information of the first UE, at least one of the capability information and power information of the second UE, and the capability information of the first network side device before the second acquisition module 171 obtains the eighth message.
[0490] In one possible implementation, the capability information and power information of the second UE are used to indicate whether the second UE has the capability to render digital human media, and the capability information of the second UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services;
[0491] The capability information and power information of the first UE are used to indicate whether the first UE has the capability to render digital human media. The capability information of the first UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services.
[0492] In a possible implementation, the apparatus further includes: a second rendering module;
[0493] The second rendering module is used to perform digital human media rendering after the application data channel is established.
[0494] In a possible implementation, the second obtaining module 171 is further configured to receive a twelfth message sent by the first UE after the application data channel is established, where the twelfth message includes the digital human-related data of the first UE;
[0495] In a possible implementation, the second rendering module is specifically configured to perform digital human media rendering on the digital human image based on the digital human-related data of the first UE.
[0496] In a possible implementation, the digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
[0497] In a possible implementation, the second sending module is configured to send a thirteenth message to the first UE before the second obtaining module 171 receives the twelfth message sent by the first UE, where the thirteenth message is used to indicate that the downloading of the digital human image is complete.
[0498] An embodiment of the present application provides a digital human communication device, which can obtain at least one of a digital human identifier, an address indicating a download address for a digital human image, and an address indicating a second network-side device during the process of establishing an application data channel for digital human communication, thereby performing digital human media rendering for a first UE to improve the effect of digital human communication.
[0499] The embodiment of the present application further provides a digital human communication device 180 , as shown in FIG18 . The digital human communication device 180 includes: a third acquisition module 181 .
[0500] Among them, the third acquisition module 181 is used to obtain the fourteenth message during the establishment of the application data channel for digital human communication. The fourteenth message includes at least one of the following: a first digital human identifier, which is used to identify the image of the first digital human; first address information, which is used to indicate the address for downloading the digital human image; second address information, which is used to indicate the address of the second network side device, and the second network device stores the image of the first digital human.
[0501] In a possible implementation, the apparatus further includes: a third sending module;
[0502] The third sending module is configured to send a fifteenth message to the second network-side device after the third acquiring module 181 acquires the fourteenth message, where the fifteenth message includes the first digital human identifier;
[0503] The third acquisition module 181 is further configured to receive a sixteenth message sent by the second network-side device, the sixteenth message including the first address information corresponding to the first digital human identifier; the second network-side device is configured to provide the first address information corresponding to the first digital human identifier;
[0504] The third sending module is further configured to send a seventeenth message to the third network-side device, where the seventeenth message includes the first address information.
[0505] An embodiment of the present application provides a digital human communication device, which can obtain first address information corresponding to the first digital human identifier from a second network side device based on the first digital human identifier, and then transmit it to the first network side device or the second UE through a third network side device, so that the first network side device or the second UE can perform digital human media rendering for the first UE, thereby improving the effect of digital human calls conducted in the digital human image.
[0506] The embodiment of the present application further provides a digital human communication device 190 , as shown in FIG19 . The digital human communication device 190 includes: a fourth acquisition module 191 .
[0507] Among them, the fourth acquisition module 191 is used to obtain the eighteenth message during the establishment of the application data channel for digital human communication. The eighteenth message includes at least one of the following: a first digital human identifier, which is used to identify the image of the first digital human; first address information, which is used to indicate the address for downloading the digital human image; second address information, which is used to indicate the address of the second network side device, and the second network device stores the image of the first digital human.
[0508] In a possible implementation, the apparatus further includes: a fourth sending module;
[0509] The fourth sending module is configured to send the first message to the first network side device after the fourth obtaining module 191 obtains the eighteenth message; or
[0510] The fourth sending module is configured to send an eighth message to the second UE via the fifth network-side device after the fourth acquiring module 191 acquires the eighteenth message, wherein the eighth message is used to instruct the second UE to download the digital human image, which is used for digital human communication;
[0511] The first message includes at least one of the following:
[0512] A first digital person identifier, which is used to identify the image of the first digital person;
[0513] First address information, the first address information is used to indicate the address for downloading the digital human image;
[0514] The second address information is used to indicate the address of the second network side device, and the second network device stores the first digital human image.
[0515] In a possible implementation, the eighteenth message includes a first digital human identifier;
[0516] The fourth sending module is configured to send a fourteenth message to the fourth network-side device, where the fourteenth message includes the first digital human identifier;
[0517] The fourth obtaining module 191 is further configured to receive a seventeenth message from the fourth network-side device, where the seventeenth message includes the first address information.
[0518] An embodiment of the present application provides a digital human communication device, in which a third network-side device can obtain first address information through a fourth network-side device, thereby transmitting the first address information to a first network-side device or a second UE, so that the first network-side device or the second UE can perform digital human media rendering for the first UE, thereby improving the effect of digital human calls conducted in the image of a digital human.
[0519] The embodiment of the present application further provides a digital human communication device 200 , as shown in FIG20 . The digital human communication device 200 includes: a fifth sending module 201 .
[0520] Among them, the fifth sending module 201 is used to send the eighteenth message during the establishment of the application data channel for digital human communication. The eighteenth message includes at least one of the following: a first digital human identifier, which is used to identify the image of the first digital human; first address information, which is used to indicate the address for downloading the digital human image; second address information, which is used to indicate the address of the second network side device, and the second network device stores the image of the first digital human.
[0521] In a possible implementation, the apparatus further includes: a fifth acquisition module;
[0522] The fifth obtaining module is configured to obtain the eighteenth message during the establishment of the guided data channel before the fifth sending module 201 sends the eighteenth message.
[0523] In a possible implementation, the fifth sending module 201 is further configured to send a sixth message to the first network-side device, where the sixth message includes the digital human-related data of the first UE; or
[0524] The fifth sending module 201 is further configured to send a twelfth message to the second UE, where the twelfth message includes the digital human-related data of the first UE.
[0525] In a possible implementation, the digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
[0526] An embodiment of the present application provides a digital human communication device. During the establishment of an application data channel for digital human communication, if a first UE requires other devices to perform digital human media rendering for it, the first UE can provide digital human related information to a second UE or a first network-side device at the opposite end, so that the second UE or the first network-side device at the opposite end can perform digital human media rendering for the first UE, thereby improving the effect of digital human calls conducted in the digital human image.
[0527] The digital human communication device in the embodiments of the present application can be an electronic device, such as an electronic device with an operating system, or a component in an electronic device, such as an integrated circuit or chip. The electronic device can be a UE, or it can be another device other than a UE. For example, the UE can include but is not limited to the types of UE11 listed above, and other devices can be servers, network attached storage (NAS), etc., which are not specifically limited in the embodiments of the present application.
[0528] The digital human communication device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and achieve the same technical effect. To avoid repetition, it will not be described here.
[0529] As shown in Figure 21, an embodiment of the present application further provides a communication device 2100, including a processor 2101 and a memory 2102. The memory 2102 stores a program or instruction that can be run on the processor 2101. For example, when the communication device 2100 is a UE, the program or instruction, when executed by the processor 2101, implements the various steps of the above-mentioned digital human communication method embodiment and can achieve the same technical effect. When the communication device 2100 is a network-side device, the program or instruction, when executed by the processor 2101, implements the various steps of the above-mentioned digital human communication method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0530] The present application also provides a UE, including a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is configured to execute a program or instruction to implement the steps in the method embodiment shown in FIG8 or FIG15. This UE embodiment corresponds to the above-mentioned UE-side method embodiment, and each implementation process and implementation method of the above-mentioned method embodiment can be applied to this UE embodiment and can achieve the same technical effect. Specifically, FIG22 is a schematic diagram of the hardware structure of a UE implementing an embodiment of the present application.
[0531] The UE 2200 includes but is not limited to at least some of the components including a radio frequency unit 2201 , a network module 2202 , an audio output unit 2203 , an input unit 2204 , a sensor 2205 , a display unit 2206 , a user input unit 2207 , an interface unit 2208 , a memory 2209 and a processor 2210 .
[0532] Those skilled in the art will appreciate that the UE 2200 may further include a power supply (such as a battery) for powering various components. The power supply may be logically connected to the processor 2210 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The UE structure shown in FIG22 does not limit the UE. The UE may include more or fewer components than shown, or may combine certain components, or have different component arrangements, which will not be described in detail here.
[0533] It should be understood that in an embodiment of the present application, the input unit 2204 may include a graphics processing unit (GPU) 22041 and a microphone 22042, and the graphics processor 22041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 2206 may include a display panel 22061, and the display panel 22061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 2207 includes a touch panel 22071 and at least one of other input devices 22072. The touch panel 22071 is also called a touch screen. The touch panel 22071 may include two parts: a touch detection device and a touch controller. Other input devices 22072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0534] In the embodiment of the present application, after receiving downlink data from the network-side device, the RF unit 2201 can transmit the data to the processor 2210 for processing. In addition, the RF unit 2201 can send uplink data to the network-side device. Generally, the RF unit 2201 includes but is not limited to an antenna, an amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, etc.
[0535] The memory 2209 can be used to store software programs or instructions and various data. The memory 2209 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 2209 may include a volatile memory or a non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 2209 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0536] Processor 2210 may include one or more processing units. Optionally, processor 2210 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 2210.
[0537] In which, when the above-mentioned UE is the second UE, the above-mentioned radio frequency unit 2201 is used for the second UE to obtain the eighth message during the establishment of the application data channel for digital human communication; wherein the eighth message includes at least one of the following: a first digital human identifier, the first digital human identifier is used to identify the image of the first digital human; first address information, the first address information is used to indicate the address for downloading the digital human image; second address information, the second address information is used to indicate the address of the second network side device, and the second network device stores the image of the first digital human.
[0538] In a possible implementation, the eighth message includes the first address information, or the eighth message includes the first digital human identifier and the first address information;
[0539] The radio frequency unit 2201 is configured to download the digital human image based on the first address information.
[0540] In a possible implementation, the eighth message includes the first digital human identifier and the second address information;
[0541] The radio frequency unit 2201 is further configured to obtain the first address information from the second network side device or the fifth network side device;
[0542] The radio frequency unit 2201 is configured to download the digital human image based on the first address information.
[0543] In a possible implementation, the eighth message includes a first digital human identifier;
[0544] The radio frequency unit 2201 is further configured to obtain the first address information from the fifth network-side device.
[0545] In one possible implementation, the above-mentioned radio frequency unit 2201 is specifically used to receive a ninth message sent by the fifth network side device, the ninth message including the first address information, the ninth message is obtained by the fifth network side device from the third network side device, the first address information is obtained by the fourth network side device from the second network side device based on the first digital human identifier and sent to the third network side device, and the second network side device is used to provide the first address information corresponding to the first digital human identifier.
[0546] In a possible implementation, the first information includes a first digital human identifier and second address information;
[0547] The radio frequency unit 2201 is further configured to obtain the first address information from the second network side device;
[0548] The radio frequency unit 2201 is configured to download the digital human image based on the first address information;
[0549] The second network side device is used to provide first address information corresponding to the first digital human identifier.
[0550] In a possible implementation, the radio frequency unit 2201 is configured to send a tenth message to the second network-side device, where the tenth message carries the first digital human identifier;
[0551] The radio frequency unit 2201 is specifically configured to receive an eleventh message sent by the second network side device, where the eleventh message includes the first address information.
[0552] In a possible implementation, the second network-side device includes at least one address information of a download address of a digital human image corresponding to a digital human identifier; or
[0553] The second network side device stores a correspondence between at least one digital human identifier and address information of a download address of at least one digital human image;
[0554] The at least one digital human identification includes a first digital human identification.
[0555] In a possible implementation, the radio frequency unit 2201 is specifically configured to download the digital human image based on the first address information through an application data channel.
[0556] In one possible implementation, the above-mentioned radio frequency unit 2201 is used to negotiate with the first UE and the first network side device whether the second UE performs digital human media rendering for the first UE based on at least one of the capability information and power information of the first UE, at least one of the capability information and power information of the second UE, and the capability information of the first network side device before the radio frequency unit 2201 obtains the eighth message.
[0557] In one possible implementation, the capability information and power information of the second UE are used to indicate whether the second UE has the capability to render digital human media, and the capability information of the second UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services;
[0558] The capability information and power information of the first UE are used to indicate whether the first UE has the capability to render digital human media. The capability information of the first UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services.
[0559] In a possible implementation, the processor 2210 is configured to perform digital human media rendering after the application data channel is established.
[0560] In a possible implementation, the radio frequency unit 2201 is further configured to receive a twelfth message sent by the first UE after the application data channel is established, where the twelfth message includes digital human-related data of the first UE;
[0561] In a possible implementation, the processor 2210 is specifically configured to perform digital human media rendering on the digital human image based on the digital human related data of the first UE.
[0562] In a possible implementation, the digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
[0563] In a possible implementation, the RF unit 2201 is configured to send a thirteenth message to the first UE before the RF unit 2201 receives the twelfth message sent by the first UE, where the thirteenth message is used to indicate that the downloading of the digital human image is complete.
[0564] An embodiment of the present application provides a UE that can, during the process of establishing an application data channel for digital human communication, obtain at least one of a digital human identifier, an address indicating a download address for a digital human image, and an address indicating a second network-side device, thereby performing digital human media rendering for a first UE to improve the effect of digital human communication.
[0565] When the above-mentioned UE is the first UE, the above-mentioned radio frequency unit 2201 is used to send the eighteenth message during the establishment of the application data channel for digital human communication. The eighteenth message includes at least one of the following: a first digital human identifier, which is used to identify the image of the first digital human; first address information, which is used to indicate the address for downloading the digital human image; second address information, which is used to indicate the address of the second network side device, and the second network device stores the image of the first digital human.
[0566] In a possible implementation, the RF unit 2201 is configured to obtain the eighteenth message during the establishment of the guided data channel before the RF unit 2201 sends the eighteenth message.
[0567] In a possible implementation, the radio frequency unit 2201 is further configured to send six messages to the first network side device, where the sixth message includes digital human-related data of the first UE; or
[0568] The radio frequency unit 2201 is further configured to send a twelfth message to the second UE, where the twelfth message includes digital human-related data of the first UE.
[0569] In a possible implementation, the digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
[0570] An embodiment of the present application provides a UE. During the process of establishing an application data channel for digital human communication, if other devices are required to perform digital human media rendering for it, the UE can provide digital human related information to a second UE or a first network-side device at the opposite end, so that the second UE or the first network-side device at the opposite end can perform digital human media rendering for the first UE, thereby improving the effect of digital human calls conducted in the digital human image.
[0571] It can be understood that the implementation process of each implementation method mentioned in this embodiment can refer to the relevant description of the method embodiment and achieve the same or corresponding technical effects. To avoid repetition, it will not be described here.
[0572] The present application also provides a network-side device, including a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is configured to execute a program or instruction to implement the steps of the method embodiment shown in Figures 7, 13, or 14. This network-side device embodiment corresponds to the aforementioned network-side device method embodiment, and each implementation process and implementation method of the aforementioned method embodiment can be applied to this network-side device embodiment and can achieve the same technical effects.
[0573] Specifically, embodiments of the present application also provide a network-side device. As shown in Figure 23, network-side device 2300 includes an antenna 231, a radio frequency device 232, a baseband device 233, a processor 234, and a memory 235. Antenna 231 is connected to radio frequency device 232. In the uplink direction, radio frequency device 232 receives information via antenna 231 and sends the received information to baseband device 233 for processing. In the downlink direction, baseband device 233 processes the information to be transmitted and sends it to radio frequency device 232. Radio frequency device 232 processes the received information and then sends it through antenna 231.
[0574] The method executed by the network-side device in the above embodiment may be implemented in the baseband device 233 , which includes a baseband processor.
[0575] The baseband device 233 may include, for example, at least one baseband board, on which multiple chips are arranged, as shown in Figure 23, one of the chips is, for example, a baseband processor, which is connected to the memory 235 through a bus interface to call the program in the memory 235 to execute the network device operations shown in the above method embodiment.
[0576] The network side device may further include a network interface 236 , which is, for example, a Common Public Radio Interface (CPRI).
[0577] Specifically, the network side device 2300 of the embodiment of the present application also includes: instructions or programs stored in the memory 235 and executable on the processor 234. The processor 234 calls the instructions or programs in the memory 235 to execute the methods executed by the modules shown in Figures 7, 13 or 14, and achieves the same technical effect. To avoid repetition, they will not be elaborated here.
[0578] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned digital human communication method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0579] The processor is the processor in the UE described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk. In some examples, the readable storage medium may be a non-transitory readable storage medium.
[0580] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned digital human communication method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0581] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0582] An embodiment of the present application further provides a computer program / program product, which is stored in a storage medium. The computer program / program product is executed by at least one processor to implement the various processes of the above-mentioned digital human communication method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0583] An embodiment of the present application also provides a communication system, including: a UE and a network-side device, wherein the UE can be used to execute the steps of the UE-side digital human communication method described above, and the network-side device can be used to execute the steps of the network-side device-side digital human communication method described above.
[0584] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0585] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of a computer software product plus a necessary general hardware platform, or of course, by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.) and includes several instructions for causing the UE or network-side device to execute the methods described in each embodiment of the present application.
[0586] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms of implementation methods without departing from the purpose of this application and the scope of protection of the claims. These implementation methods are all within the protection of this application.
Claims
1. A digital human communication method, comprising: During the process of establishing the application data channel for digital human communication, the first network side device obtains the first message; The first message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
2. The method according to claim 1, wherein The first message includes the first address information, or the first message includes the first digital human identifier and the first address information; The method further comprises: The first network-side device downloads the digital human image based on the first address information.
3. The method according to claim 1, wherein The first message includes at least one of the first digital human identifier and the second address information; The method further comprises: The first network side device obtains first address information corresponding to the first digital human identifier from the second network side device or the third network side device, and downloads the digital human image based on the first address information.
4. The method according to claim 1 or 3, wherein The first message includes the first digital human identifier; The method further comprises: The first network-side device obtains the first address information from a third network-side device.
5. The method according to claim 4, wherein The first network-side device acquiring the first address information from the third network-side device includes: The first network side device receives a second message sent by the third network side device, and the second message includes the first address information. The first address information is obtained by the fourth network side device from the second network side device based on the first digital human identifier. The second network side device is used to provide the first address information corresponding to the first digital human identifier.
6. The method according to claim 1 or 3, wherein: The first message includes the first digital human identifier and the second address information; The method further comprises: The first network-side device obtains the first address information from the second network-side device, and downloads the digital human image based on the first address information; The second network-side device is used to provide first address information corresponding to the first digital human identifier.
7. The method according to claim 6, wherein: The first network side device acquiring the first address information from the second network side device includes: The first network side device sends a third message to the second network side device, where the third message carries the first digital human identifier; The first network side device receives a fourth message sent by the second network side device, where the fourth message includes the first address information.
8. The method according to any one of claims 5 to 7, wherein: The second network side device includes at least one address information of a download address of a digital human image corresponding to a digital human identifier; or The second network side device stores a correspondence between at least one digital human identifier and address information of a download address of at least one digital human image; The at least one digital human identification includes the first digital human identification.
9. The method according to any one of claims 2 to 8, wherein: The first network-side device downloads the digital human image based on the first address information, including: The first network-side device downloads the digital human image based on the first address information through the application data channel.
10. The method according to any one of claims 1 to 9, wherein: Before the first network-side device obtains the first message, the method further includes: The first network side device negotiates with the first user equipment UE whether the first network side device performs digital human media rendering for the first UE based on at least one of the capability information and power information of the first user equipment UE and the capability information of the first network side device.
11. The method according to claim 10, wherein: The capability information of the first network side device is used to indicate whether the first network side device has the capability of rendering digital human media, and the capability information of the first network side device includes at least one of the following: computing power information, load information, and capability information of providing data channel services; At least one of the capability information and power information of the first UE is used to indicate whether the first UE has the capability to render digital human media, and the capability information of the first UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services.
12. The method according to any one of claims 1 to 11, wherein: The method further comprises: After the application data channel is established, the first network-side device performs digital human media rendering.
13. The method according to claim 12, wherein: After the first network-side device performs digital human media rendering, the method further includes: The first network-side device sends a fifth message to the second UE, where the fifth message includes rendered digital human media.
14. The method according to claim 12 or 13, wherein: The method further comprises: After the application data channel is established, the first network-side device receives a sixth message sent by the first UE, where the sixth message includes digital human-related data of the first UE.
15. The method according to claim 14, wherein The first network-side device performs digital human media rendering, including: The first network-side device performs digital human media rendering on the digital human image based on the digital human-related data of the user of the first UE.
16. The method according to claim 14 or 15, wherein: The digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
17. The method according to claim 14, wherein: Before the first network side device receives the sixth message sent by the first UE, the method further includes: The first network-side device sends a seventh message to the first UE, where the seventh message is used to indicate that the downloading of the digital human image is complete.
18. A digital human communication method, comprising: During the establishment of the application data channel for digital human communication, the second UE obtains an eighth message; The eighth message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
19. The method according to claim 18, wherein The eighth message includes the first address information, or the eighth message includes the first digital human identifier and the first address information; The method further comprises: The second UE downloads the digital human image based on the first address information.
20. The method according to claim 18, wherein The eighth message includes the first digital human identifier and the second address information; The method further comprises: The second UE obtains the first address information from the second network-side device or the fifth network-side device, and downloads the digital human image based on the first address information.
21. The method according to claim 18 or 20, wherein The eighth message includes a first digital human identifier; The method further comprises: The second UE obtains the first address information from the fifth network side device.
22. The method according to claim 21, wherein The second UE acquiring the first address information from the fifth network-side device includes: The second UE receives the ninth message sent by the fifth network side device, and the ninth message includes the first address information. The ninth message is obtained by the fifth network side device from the third network side device. The first address information is obtained by the fourth network side device from the second network side device based on the first digital human identifier and sent to the third network side device. The second network side device is used to provide the first address information corresponding to the first digital human identifier.
23. The method according to claim 18 or 20, wherein The first information includes the first digital human identifier and the second address information; The method further comprises: The second UE obtains the first address information from the second network-side device, and downloads the digital human image based on the first address information; The second network-side device is used to provide first address information corresponding to the first digital human identifier.
24. The method according to claim 23, wherein The second UE acquiring the first address information from the second network side device includes: The second UE sends a tenth message to the second network side device, where the tenth message carries the first digital human identifier; The second UE receives an eleventh message sent by the second network side device, where the eleventh message includes the first address information.
25. The method according to any one of claims 22 to 24, wherein: The second network side device includes at least one address information of a download address of a digital human image corresponding to a digital human identifier; or The second network side device stores a correspondence between at least one digital human identifier and address information of a download address of at least one digital human image; The at least one digital human identification includes the first digital human identification.
26. The method according to claims 19 to 25, wherein The second UE downloading the digital human image based on the first address information includes: The second UE downloads the digital human image based on the first address information through the application data channel.
27. The method according to any one of claims 18 to 26, wherein Before the second UE obtains the eighth message, the method further includes: The second UE negotiates with the first UE and the first network side device whether the second UE performs digital human media rendering for the first UE based on at least one of the capability information and power information of the first UE, at least one of the capability information and power information of the second UE, and the capability information of the first network side device.
28. The method according to claim 27, wherein The capability information and power information of the second UE are used to indicate whether the second UE has the capability to render digital human media, and the capability information of the second UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services; The capability information and power information of the first UE are used to indicate whether the first UE has the capability to render digital human media. The capability information of the first UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services.
29. The method according to any one of claims 18 to 28, wherein The method further comprises: After the application data channel is established, the second UE performs digital human media rendering.
30. The method according to claim 29, wherein The method further comprises: After the application data channel is established, the second UE receives a twelfth message sent by the first UE, where the twelfth message includes digital human-related data of the first UE.
31. The method according to claim 30, wherein The second UE performs digital human media rendering, including: The second UE performs digital human media rendering on the digital human image based on the digital human related data of the first UE.
32. The method according to claim 30, wherein The digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
33. The method according to claim 30, wherein Before the second UE receives the twelfth message sent by the first UE, the method further includes: The second UE sends a thirteenth message to the first UE, where the thirteenth message is used to indicate that the downloading of the digital human image is complete.
34. A digital human communication method, the method comprising: During the process of establishing the application data channel for digital human communication, the fourth network-side device obtains a fourteenth message, where the fourteenth message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
35. The method according to claim 34, wherein After the fourth network-side device obtains the fourteenth message, the method further includes: The fourth network side device sends a fifteenth message to the second network side device, where the fifteenth message includes the first digital human identifier; The fourth network side device receives the sixteenth message sent by the second network side device, where the sixteenth message includes the first address information corresponding to the first digital human identifier; and the second network side device is configured to provide the first address information corresponding to the first digital human identifier; The fourth network-side device sends a seventeenth message to the third network-side device, where the seventeenth message includes the first address information.
36. A digital human communication method, the method comprising: During the process of establishing the application data channel for digital human communication, the third network-side device obtains an eighteenth message, where the eighteenth message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
37. The method according to claim 36, wherein After the third network-side device obtains the eighteenth message, the method further includes: The third network side device sends a first message to the first network side device; or, The third network-side device sends an eighth message to the second UE via the fifth network-side device, where the eighth message is used to instruct the second UE to download a digital human image, where the digital human image is used for digital human communication; The first message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
38. The method of claim 36, wherein: The eighteenth message includes a first digital human identifier; The method further comprises: The third network side device sends a fourteenth message to the fourth network side device, where the fourteenth message includes the first digital human identifier; The third network-side device receives a seventeenth message from the fourth network-side device, where the seventeenth message includes the first address information.
39. A digital human communication method, comprising: During the establishment of the application data channel for digital human communication, the first UE sends an eighteenth message, where the eighteenth message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
40. The method of claim 39, wherein Before the first UE sends the eighteenth message, the method further includes: The first UE obtains the eighteenth message during the establishment of the guided data channel.
41. The method of claim 39, wherein The method further comprises: The first UE sends a sixth message to the first network side device, wherein the sixth message includes digital human related data of the first UE; or The first UE sends a twelfth message to the second UE, where the twelfth message includes digital human-related data of the first UE.
42. The method according to claim 41, wherein The digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
43. A digital human communication device, comprising: First acquisition module; The first acquisition module is used to acquire a first message during the process of establishing an application data channel for digital human communication. The first message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
44. The apparatus of claim 43, wherein: The first message includes the first address information, or the first message includes the first digital human identifier and the first address information; The device further includes: a first downloading module; The first downloading module is used to download the digital human image based on the first address information.
45. The apparatus of claim 43, wherein: The first message includes at least one of the first digital human identifier and the second address information; The device further includes: a first downloading module; The first acquisition module is further configured to acquire first address information corresponding to the first digital human identifier from a second network-side device or a third network-side device; The first downloading module is used to download the digital human image based on the first address information.
46. The apparatus according to claim 43 or 45, wherein The first message includes the first digital human identifier; The first acquisition module is further configured to acquire the first address information from a third network-side device.
47. The apparatus of claim 46, wherein: The first acquisition module is specifically used to receive a second message sent by the third network side device, where the second message includes the first address information. The first address information is obtained by the fourth network side device from the second network side device based on the first digital human identifier, and the second network side device is used to provide the first address information corresponding to the first digital human identifier.
48. The apparatus according to claim 43 or 45, wherein The first message includes the first digital human identifier and the second address information; The device further includes: a first downloading module; The first acquisition module is further configured to acquire the first address information from the second network side device; The first downloading module is used to download the digital human image based on the first address information; The second network-side device is used to provide first address information corresponding to the first digital human identifier.
49. The apparatus according to claim 48, wherein The device further includes: a first sending module; The first sending module is configured to send a third message to the second network-side device, where the third message carries the first digital human identifier; The first acquisition module is specifically configured to receive a fourth message sent by the second network-side device, where the fourth message includes the first address information.
50. The apparatus according to any one of claims 47 to 49, wherein The second network side device includes at least one address information of a download address of a digital human image corresponding to a digital human identifier; or The second network side device stores a correspondence between at least one digital human identifier and address information of a download address of at least one digital human image; The at least one digital human identification includes the first digital human identification.
51. The apparatus according to any one of claims 44 to 50, wherein The first downloading module is specifically configured to download the digital human image based on the first address information through the application data channel.
52. The apparatus according to any one of claims 43 to 51, wherein The apparatus further includes: a first negotiation module; The first negotiation module is used to negotiate with the first user equipment UE whether the first network side device performs digital human media rendering for the first UE based on at least one of the capability information and power information of the first user equipment UE and the capability information of the first network side device before the first acquisition module obtains the first message.
53. The apparatus of claim 52, wherein: The capability information of the first network side device is used to indicate whether the first network side device has the capability of rendering digital human media, and the capability information of the first network side device includes at least one of the following: computing power information, load information, and capability information of providing data channel services; At least one of the capability information and power information of the first UE is used to indicate whether the first UE has the capability to render digital human media, and the capability information of the first UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services.
54. The apparatus according to any one of claims 43 to 53, wherein: The device further includes: a first rendering module; The first rendering module is used to perform digital human media rendering after the application data channel is established.
55. The apparatus of claim 54, wherein: The device further includes: a first sending module; The first sending module is configured to send a fifth message to the second UE after the first rendering module performs digital human media rendering, where the fifth message includes the rendered digital human media.
56. The apparatus according to claim 54 or 55, wherein The first acquisition module is further configured to receive a sixth message sent by the first UE after the application data channel is established, wherein the sixth message includes digital human-related data of the first UE.
57. The apparatus of claim 56, wherein: The first rendering module is specifically configured to perform digital human media rendering on the digital human image based on the digital human related data of the user of the first UE.
58. The apparatus according to claim 56 or 57, wherein The digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
59. The apparatus of claim 56, wherein The device further includes: a first sending module; The first sending module is configured to send a seventh message to the first UE before the first acquiring module receives the sixth message sent by the first UE, where the seventh message is used to indicate that the downloading of the digital human image is complete.
60. A digital human communication device, comprising: Second acquisition module; The second acquisition module is configured to enable the second UE to acquire the eighth message during the process of establishing the application data channel for digital human communication; The eighth message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
61. The apparatus of claim 60, wherein The eighth message includes the first address information, or the eighth message includes the first digital human identifier and the first address information; The device further includes: a second download module; The second downloading module is used to download the digital human image based on the first address information.
62. The apparatus of claim 60, wherein: The eighth message includes the first digital human identifier and the second address information; The device further includes: a second download module; The second acquisition module is further configured to acquire the first address information from the second network side device or the fifth network side device; The second downloading module is used to download the digital human image based on the first address information.
63. The apparatus according to claim 60 or 62, wherein The eighth message includes a first digital human identifier; The second acquisition module is further configured to acquire the first address information from the fifth network-side device.
64. The apparatus of claim 63, wherein: The second acquisition module is specifically used to receive the ninth message sent by the fifth network side device, and the ninth message includes the first address information. The ninth message is obtained by the fifth network side device from the third network side device. The first address information is obtained by the fourth network side device from the second network side device based on the first digital human identifier and sent to the third network side device. The second network side device is used to provide the first address information corresponding to the first digital human identifier.
65. The apparatus of claim 60 or 62, wherein: The first information includes the first digital human identifier and the second address information; The device further includes: a second download module; The second acquisition module is further configured to acquire the first address information from the second network side device; The second downloading module is used to download the digital human image based on the first address information; The second network-side device is used to provide first address information corresponding to the first digital human identifier.
66. The apparatus of claim 65, wherein The device further includes: a second sending module; The second sending module is configured to send a tenth message to the second network-side device, where the tenth message carries the first digital human identifier; The second acquisition module is specifically configured to receive an eleventh message sent by the second network-side device, where the eleventh message includes the first address information.
67. The apparatus according to any one of claims 64 to 66, wherein The second network side device includes at least one address information of a download address of a digital human image corresponding to a digital human identifier; or The second network side device stores a correspondence between at least one digital human identifier and address information of a download address of at least one digital human image; The at least one digital human identification includes the first digital human identification.
68. The apparatus according to claims 61 to 67, wherein The second downloading module is specifically configured to download the digital human image based on the first address information through the application data channel.
69. The apparatus according to any one of claims 60 to 68, wherein The apparatus further includes: a second negotiation module; The second negotiation module is used to negotiate with the first UE and the first network side device whether the second UE performs digital human media rendering for the first UE based on at least one of the capability information and power information of the first UE, at least one of the capability information and power information of the second UE, and the capability information of the first network side device before the second acquisition module obtains the eighth message.
70. The apparatus of claim 69, wherein The capability information and power information of the second UE are used to indicate whether the second UE has the capability to render digital human media, and the capability information of the second UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services; The capability information and power information of the first UE are used to indicate whether the first UE has the capability to render digital human media. The capability information of the first UE includes at least one of the following: computing power information, load information, and capability information for providing data channel services.
71. The apparatus according to any one of claims 60 to 70, wherein The device further includes: a second rendering module; The second rendering module is used to perform digital human media rendering after the application data channel is established.
72. The apparatus of claim 71, wherein The second acquisition module is further configured to receive a twelfth message sent by the first UE after the application data channel is established, wherein the twelfth message includes digital human-related data of the first UE.
73. The apparatus of claim 72, wherein: The second rendering module is specifically configured to perform digital human media rendering on the digital human image based on the digital human related data of the first UE.
74. The apparatus of claim 72, wherein: The digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
75. The apparatus of claim 72, wherein The device further includes: a second sending module; The second sending module is configured to send a thirteenth message to the first UE before the second acquiring module receives the twelfth message sent by the first UE, where the thirteenth message is used to indicate that the downloading of the digital human image is complete.
76. A digital human communication device, comprising: The third acquisition module; The third acquisition module is configured to acquire a fourteenth message during the process of establishing the application data channel for digital human communication, wherein the fourteenth message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
77. The apparatus of claim 76, wherein The device further includes: a third sending module; The third sending module is configured to send a fifteenth message to the second network-side device after the third acquiring module acquires the fourteenth message, wherein the fifteenth message includes the first digital human identifier; The third acquisition module is further configured to receive a sixteenth message sent by the second network-side device, the sixteenth message including the first address information corresponding to the first digital human identifier; and the second network-side device is configured to provide the first address information corresponding to the first digital human identifier; The third sending module is further configured to send a seventeenth message to a third network-side device, where the seventeenth message includes the first address information.
78. A digital human communication device, wherein: The device includes: a fourth acquisition module; The fourth acquisition module is configured to acquire an eighteenth message during the process of establishing the application data channel for digital human communication, wherein the eighteenth message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
79. The apparatus of claim 78, wherein The device further includes: a fourth sending module; The fourth sending module is configured to send the first message to the first network side device after the fourth acquiring module acquires the eighteenth message; or The fourth sending module is configured to send an eighth message to the second UE via the fifth network-side device after the fourth acquiring module acquires the eighteenth message, wherein the eighth message is used to instruct the second UE to download a digital human image, wherein the digital human image is used for digital human communication; The first message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
80. The apparatus of claim 78, wherein The eighteenth message includes a first digital human identifier; The device further includes: a fourth sending module; The fourth sending module is configured to send a fourteenth message to a fourth network-side device, where the fourteenth message includes the first digital human identifier; The fourth acquisition module is further configured to receive a seventeenth message from the fourth network-side device, where the seventeenth message includes the first address information.
81. A digital human communication device, comprising: a fifth sending module; The fifth sending module is configured to send an eighteenth message during the process of establishing the application data channel for digital human communication, wherein the eighteenth message includes at least one of the following: a first digital human identifier, wherein the first digital human identifier is used to identify the image of the first digital human; First address information, the first address information is used to indicate an address for downloading the digital human image; Second address information, the second address information is used to indicate the address of a second network-side device, and the second network device stores the first digital human image.
82. The apparatus of claim 81, wherein The device further includes: a fifth acquisition module; The fifth acquiring module is configured to acquire the eighteenth message during the process of establishing the guided data channel before the fifth sending module sends the eighteenth message.
83. The apparatus of claim 81, wherein The fifth sending module is further configured to send a sixth message to the first network side device, wherein the sixth message includes the digital human related data of the first UE; or The fifth sending module is further configured to send a twelfth message to the second UE, where the twelfth message includes the digital human-related data of the first UE.
84. The apparatus of claim 83, wherein The digital human-related data of the first UE includes at least one of the following: gesture information of the user of the first UE, facial information of the user of the first UE, body movement information of the user of the first UE, and voice information of the user of the first UE.
85. A UE comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, implement the steps of the digital human communication method as described in any one of claims 18 to 33, or implement the steps of the digital human communication method as described in any one of claims 39 to 42.
86. A network side device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the digital human communication method as described in any one of claims 1 to 17 are implemented, or the steps of the digital human communication method as described in any one of claims 34 and 35 are implemented, or the steps of the digital human communication method as described in any one of claims 36 to 38 are implemented.
87. A readable storage medium storing a program or instruction, wherein the program or instruction, when executed by a processor, implements the steps of the digital human communication method as described in any one of claims 1 to 17, or implements the steps of the digital human communication method as described in any one of claims 18 to 33, or implements the steps of the digital human communication method as described in any one of claims 34 and 35, or implements the steps of the digital human communication method as described in any one of claims 36 to 38, or implements the steps of the digital human communication method as described in any one of claims 39 to 42.
88. A computer program product, wherein the computer program product is stored in a storage medium, and the computer program product is executed by at least one processor to implement the steps of the digital human communication method according to any one of claims 1 to 17, or the steps of the digital human communication method according to any one of claims 18 to 33, or the steps of the digital human communication method according to any one of claims 34 and 35, or the steps of the digital human communication method according to any one of claims 36 to 38, or the steps of the digital human communication method according to any one of claims 39 to 42.
Citation Information
Patent Citations
Augmented reality communication method, device and system
CN115134336A
Wireless communication method and device
WO2024036579A1