Communication method, apparatus and system
The transmission parameters of the terminal device are dynamically adjusted by network equipment to correspond to the second transmission channel, which solves the problem of wasted bandwidth and poor display effects when the terminal device transmits facial feature data, and achieves more efficient bandwidth utilization and better video display.
Patent Information
- Application Number
- PCT/CN2024/143394
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-09
- Filing Date
- 2024-12-27
- Publication Date
- 2025-07-17
AI Technical Summary
In the prior art, terminal devices cannot adjust transmission parameters when transmitting face feature data, resulting in wasted bandwidth resources or poor video display effect.
The network device determines the new transmission parameters of the first transmission channel, corresponds to the parameters of the second transmission channel, and instructs the terminal device to make calls based on the new transmission parameters to realize dynamic adjustment of the transmission parameters.
It reduces the waste of bandwidth resources, improves the video display effect on the second terminal device side, and improves the user experience.
Smart Images

Figure CN2024143394_17072025_PF_FP_ABST
Abstract
Description
Communication method, device and system
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of the People's Republic of China on January 9, 2024, with application number 202410034305.8 and application name "A Communication Method, Device and System", the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The present application relates to the field of communication technology, and in particular to a communication method, device, and system. Background Art
[0004] With the increasing prevalence of phone calls, more and more users are communicating with others through terminal devices (such as mobile phones). As shown in Figure 1, a call between two terminal devices (including terminal device A and terminal device B) is used as an example: During the call, terminal device A can act as the acquisition terminal to collect user A's facial feature data and provide it to the network. The network then drives a digital human (also called an avatar) model based on the received facial feature data to generate a video frame. The video frame includes user A's digital human image and is sent to user B's terminal device B for display, allowing user B to see user A's digital human image. Facial feature data indicates facial expressions, head movements, and other information.
[0005] Currently, the collection end uses pre-agreed transmission parameters to send facial feature data to the network side, and the transmission parameters cannot be adjusted. Summary of the Invention
[0006] The present application provides a communication method, apparatus, and system for adjusting the transmission parameters of a first transmission channel to reduce the waste of bandwidth resources or to improve the video display effect on the second terminal device side.
[0007] In a first aspect, an embodiment of the present application provides a communication method, which can be executed by a network device or by a component (such as a circuit or chip) in the network device. For example, in this method, a first transmission channel is a transmission channel between the network device and a first terminal device, and a second transmission channel is a transmission channel between the network device and a second terminal device; the first transmission channel and the second transmission channel are used for a call between the first terminal device and the second terminal device, wherein the first transmission channel is used to transmit facial feature data of a first user, and the second transmission channel is used to transmit a first video frame, and the first video frame includes a digital image corresponding to the facial feature data of the first user; the network device determines new transmission parameters of the first transmission channel, and the new transmission parameters correspond to the transmission parameters of the second transmission channel; the network device instructs the first terminal device to conduct the call according to the new transmission parameters.
[0008] Using the above method, the network device determines the new transmission parameters of the first transmission channel, which correspond to the transmission parameters of the second transmission channel, and instructs the first terminal device to make a call based on the new transmission parameters, thereby adjusting the transmission parameters of the first channel, thereby reducing the waste of bandwidth resources, or improving the video display effect on the second terminal device side.
[0009] In one possible design, determining new transmission parameters for the first transmission channel, where the new transmission parameters correspond to the transmission parameters of the second transmission channel, includes: when the transmission parameters of the second transmission channel change, determining new transmission parameters for the first transmission channel, where the new transmission parameters correspond to the changed transmission parameters of the second transmission channel; or, when the transmission parameters of the first transmission channel do not correspond to the transmission parameters of the second transmission channel, determining new transmission parameters for the first transmission channel, where the new transmission parameters correspond to the transmission parameters of the second transmission channel.
[0010] In this way, the network device can determine new transmission parameters when the transmission parameters of the second transmission channel change or when the transmission parameters of the first transmission channel do not correspond to the transmission parameters of the second transmission channel, thereby facilitating timely adjustment of the first transmission parameters.
[0011] In one possible design, the new transmission parameters are determined based on correspondence information, where the correspondence information is used to indicate a parameter correspondence between the first transmission channel and the second transmission channel, and the parameter correspondence meets the performance requirements of the call.
[0012] In this way, by introducing the correspondence information, the network device can determine the new transmission parameters according to the correspondence information, so that the determined new transmission parameters are more accurate.
[0013] In a possible design, the correspondence information is a list, which includes the correspondence between one or more transmission parameters of the first transmission channel and one or more transmission parameters of the second transmission channel.
[0014] In one possible design, the transmission parameters of the second transmission channel include a frame rate, and the transmission parameters of the first transmission channel include a transmission rate of the facial feature data.
[0015] In one possible design, the transmission parameters of the second transmission channel include type information of the digital image, and the transmission parameters of the first transmission channel include the number of facial feature points corresponding to the facial feature data.
[0016] In one possible design, the method further includes: obtaining one or more transmission parameters of the first transmission channel supported by the first terminal device, wherein the one or more transmission parameters supported by the first terminal device include the new transmission parameter.
[0017] In one possible design, the method further includes: selecting the new transmission parameter supported by the network device from the one or more transmission parameters supported by the first terminal device.
[0018] In this way, since the network device selects the new transmission parameter from one or more transmission parameters supported by the first terminal device, the problem of adjustment failure caused by adjustment to a transmission parameter not supported by the first terminal device can be avoided.
[0019] In one possible design, the first transmission channel is a data channel or a real-time transport protocol RTP channel; and / or the second transmission channel is an RTP channel.
[0020] In one possible design, before instructing the first terminal device to conduct the call according to the new transmission parameters, the method further includes: obtaining information that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device.
[0021] In this way, when it is known that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device, the network device can instruct the first terminal device to conduct the call according to the new transmission parameters; otherwise, the network device may not instruct the first terminal device to conduct the call according to the new transmission parameters.
[0022] In one possible design, the method also includes: establishing a third transmission channel between the network device and the first terminal device, and a fourth transmission channel between the network device and the second terminal device; the third transmission channel and the fourth transmission channel are used for the call, wherein the fourth transmission channel is used to transmit facial feature data of the second user, and the third transmission channel is used to transmit a second video frame, and the second video frame includes a digital image corresponding to the facial feature data of the second user.
[0023] In a second aspect, an embodiment of the present application provides a communication method, which can be executed by a first terminal device, or by a component (such as a circuit or chip) in the first terminal device. For example, in this method, a first transmission channel and a second transmission channel are used for a call between the first terminal device and the second terminal device; wherein the first transmission channel is used to transmit the facial feature data of the first user to the network device, and the second transmission channel is used to transmit a first video frame between the network device and the second terminal device, and the first video frame includes a digital image corresponding to the facial feature data of the first user; the first terminal device receives new transmission parameters of the first transmission channel from the network device, and the new transmission parameters correspond to the transmission parameters of the second transmission channel; the first terminal device conducts the call according to the new transmission parameters.
[0024] In one possible design, the new transmission parameters are determined based on correspondence information, where the correspondence information is used to indicate a parameter correspondence between the first transmission channel and the second transmission channel, and the parameter correspondence meets the performance requirements of the call.
[0025] In a possible design, the correspondence information is a list, which includes the correspondence between one or more transmission parameters of the first transmission channel and one or more transmission parameters of the second transmission channel.
[0026] In one possible design, the transmission parameters of the second transmission channel include a frame rate, and the transmission parameters of the first transmission channel include a transmission rate of the facial feature data.
[0027] In one possible design, the transmission parameters of the second transmission channel include type information of the digital image, and the transmission parameters of the first transmission channel include the number of facial feature points corresponding to the facial feature data.
[0028] In one possible design, the method further includes: sending one or more transmission parameters of the first transmission channel supported by the first terminal device to the network device, and the new transmission parameters are selected by the network device from the one or more transmission parameters supported by the first terminal device.
[0029] In one possible design, the first transmission channel is a data channel or an RTP channel; and / or the second transmission channel is an RTP channel.
[0030] In one possible design, before receiving new transmission parameters of the first transmission channel from the network device, the method also includes: sending capability information to the network device, wherein the capability information is used to indicate that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device.
[0031] It can be understood that the communication method provided in the above-mentioned second aspect corresponds to the first aspect, and the beneficial effects of the relevant technical features can refer to the description of the first aspect.
[0032] In a third aspect, the present application provides a communication method, in which a first transmission channel is a transmission channel between a network device and a first terminal device, and a second transmission channel is a transmission channel between the network device and a second terminal device; the first transmission channel and the second transmission channel are used for a call between the first terminal device and the second terminal device, wherein the first transmission channel is used to transmit facial feature data of a first user, and the second transmission channel is used to transmit a first video frame, and the first video frame includes a digital image corresponding to the facial feature data of the first user; the network device determines new transmission parameters of the first transmission channel, and the new transmission parameters correspond to the transmission parameters of the second transmission channel; the network device instructs the first terminal device to conduct the call according to the new transmission parameters; the first terminal device receives the new transmission parameters; and the first terminal device conducts the call according to the new transmission parameters.
[0033] In a fourth aspect, the present application provides a communication device, which has the functions of implementing the first or second aspect above. For example, the communication device includes a module or unit or means corresponding to the operations involved in the first or second aspect above. The module or unit or means can be implemented by software, or by hardware, or the corresponding software can be implemented by hardware.
[0034] In one possible design, the communication device includes a unit or module for performing the first or second aspect described above. For example, the communication device includes a processing unit and a communication unit. The communication unit can be used to send and receive signals to enable communication between the communication device and other devices; and the processing unit can be used to perform certain internal operations of the communication device. The functions performed by the processing unit and the communication unit can correspond to the operations involved in the first or second aspect described above.
[0035] In one possible design, the communication device includes a processor, which can be coupled to a memory. The memory can store the necessary computer programs or instructions for implementing the functions of the first or second aspect. The processor can execute the computer programs or instructions stored in the memory. When the computer programs or instructions are executed, the communication device implements the method of any possible design or implementation of the first or second aspect.
[0036] In one possible design, the communication device includes a processor and a memory, and the memory may store the necessary computer programs or instructions for implementing the functions involved in the first or second aspect. The processor may execute the computer program or instructions stored in the memory. When the computer program or instructions are executed, the communication device implements the method in any possible design or implementation of the first or second aspect.
[0037] In one possible design, the communication device includes a processor and an interface circuit, wherein the processor is used to communicate with other devices through the interface circuit and execute the method in any possible design or implementation of the first aspect or the second aspect above.
[0038] It can be understood that in the fourth aspect above, the processor can be implemented by hardware or by software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, etc.; when implemented by software, the processor can be a general-purpose processor, which is implemented by reading the software code stored in the memory. In addition, the above processors can be one or more, and the memories can be one or more. The memory can be integrated with the processor, or the memory and the processor can be set separately. In the specific implementation process, the memory can be integrated with the processor on the same chip, or can be set on different chips respectively. The embodiment of the present application does not limit the type of memory and the setting method of the memory and the processor.
[0039] In a fifth aspect, the present application provides a communication system, which may include a network device and a first terminal device; wherein the network device is configured to perform the method provided in the first aspect, and the first terminal device is configured to perform the method provided in the second aspect. Optionally, the communication system further includes a second terminal device configured to receive and display video frames from the network device.
[0040] In a sixth aspect, the present application provides a computer-readable storage medium, in which computer-readable instructions are stored. When a computer reads and executes the computer-readable instructions, the computer executes the method in any possible design of the first aspect or the second aspect mentioned above.
[0041] In a seventh aspect, the present application provides a computer program product, which, when read and executed by a computer, enables the computer to execute the method in any possible design of the first aspect or the second aspect above.
[0042] In an eighth aspect, the present application provides a chip, comprising a processor, wherein the processor is coupled to a memory and is configured to read and execute a software program stored in the memory to implement a method in any possible design of the first or second aspect above. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] FIG1 is a schematic diagram of a call between terminal device A and terminal device B provided in an embodiment of the present application;
[0044] FIG2 is a schematic diagram of a protocol stack provided in an embodiment of the present application;
[0045] Figures 3A, 3B, and 3C are schematic diagrams of network architectures provided in embodiments of the present application;
[0046] FIG4 is a flow chart of the communication method according to the first embodiment of the present application;
[0047] FIG5 is a schematic diagram of a first transmission channel and a second transmission channel provided in an embodiment of the present application;
[0048] FIG6 is a flow chart of the communication method according to the second embodiment of the present application;
[0049] FIG7 is a flow chart of the communication method according to the third embodiment of the present application;
[0050] FIG8 is a possible exemplary block diagram of a device involved in an embodiment of the present application;
[0051] FIG9 is a schematic diagram of a possible structure of the device involved in the embodiments of the present application. DETAILED DESCRIPTION
[0052] In order to make the purpose, technical solutions and advantages of this application more clear, the application will be further described in detail below with reference to the accompanying drawings. The specific operation methods in the method embodiments can also be applied to the device embodiments or system embodiments.
[0053] The following first explains the relevant terms involved in the embodiments of this application. When not specifically explained, these explanations are intended to support the meaning of the relevant terms and make the embodiments of this application easier to understand, and should not be regarded as strict limitations on the relevant terms in the scope of protection claimed by this application.
[0054] 1. Call
[0055] The call in the embodiment of the present application can also be called a communication service, which refers to a service such as a voice call, video call or data interaction between a terminal device as an originating party or a terminating party and one or more other terminal devices via a communication network. The communication network can be an Internet Protocol (IP) Multimedia Subsystem (IMS) network. The IMS network is an open system based on IP bearer and provides various multimedia services to users. A call can cover the entire process from call establishment (for example, dialing) to call termination, or it can cover a part of the process from call establishment to call termination. A call can be a one-to-one call or a one-to-many call (such as a conference); the embodiment of the present application takes a one-to-one call as an example, but the relevant solutions can be used for one-to-many calls.
[0056] 2. Digital Image
[0057] The digital image in the embodiments of the present application may refer to a digital human image. A digital human is a virtual character image with a digital appearance, which is displayed by a display device, such as a mobile phone, a television, augmented reality (AR) or virtual reality (VR) glasses. The digital human has a human-like or simulated appearance, with intuitive anthropomorphic features such as appearance, gender and personality. Driven by digital technology, the digital human can have human-like behavior, including expressive abilities such as language, expression and movement. It can even be enabled by artificial intelligence to have simple thoughts, recognize the external environment and communicate and interact with people. Digital humans are widely used in scenarios such as film and television production, virtual anchors, virtual teaching, game entertainment, virtual customer service, virtual tour guides and real-time communication.
[0058] 3. Facial feature data
[0059] In the embodiments of the present application, facial feature data is used to indicate facial expressions, head movements, and the like. Facial features can be expressed through facial feature points, which include key points on different parts of the face. For example, facial feature data corresponds to multiple facial feature points, and the facial feature data may include the coordinates of these multiple facial feature points, including key points on parts such as the two eyes, nose, mouth, and chin. It is understood that "facial feature data" can also be replaced with "facial feature point data."
[0060] 4. Digital Human Technology
[0061] Digital human technology mainly includes several technical links, such as the production and storage of digital human models (modeling), model driving and reconstruction after motion capture on the acquisition end (driving), and image presentation according to the observer's perspective (rendering). Among them, the modeling technology link is currently mainly offline production, which collects surface information of the modeling object through camera shooting, structured light scanning, light field reconstruction in dynamic scenes and other technologies, and generates a digital human model based on the collected surface information. The driving and reconstruction technology link drives the digital human model based on the collected facial feature data to generate the digital human's facial expressions and movements. The rendering technology link constructs virtual and real superimposed scenes based on parameters such as the observer's perspective, and renders the driven digital human model into an image frame by frame and displays it.
[0062] Because the driving process consumes significant computing power, and terminal devices are limited by various factors, such as hardware resources, size, weight, power consumption, and heat dissipation, they are unable to meet the required computing power. Therefore, the network side is currently typically responsible for driving the digital human. There are various ways to drive a digital human. For example, video-driven driving refers to the acquisition end sending video frames (which include the user's facial feature data) to the network side. The network side then drives the digital human model based on the received video frames, generating video frames that include the digital human's image. When the digital human is driven by video, the "transmission rate of facial feature data" in the following embodiments of this application can be understood as the frame rate of the video frames that include facial feature data.
[0063] A video can be composed of a series of coherent images (or pictures, photos, etc.) played continuously. The frame rate refers to the number of images played per second. For example, a frame rate of 20 frames per second (FPS) means 20 images are played per second. A video frame can be understood as an image, and a video frame can include data corresponding to an image (such as facial feature data).
[0064] 5. Transmission Channel
[0065] The transmission channel in the embodiments of the present application is used to transmit data in a call, such as data between terminal devices in a call, and / or data between a terminal device in a call and a communication network (i.e., a network device). A call can correspond to at least one transmission channel. A transmission channel can be understood as a logical connection between communication devices in a call, for example, it can be understood as a logical connection between terminal devices in a call, which can transmit data between terminal devices; or it can be understood as a logical connection between a terminal device in a call and a network device, which is used to transmit data between the terminal device and the network device.
[0066] Transmission channels can be divided into audio channels, video channels, and data channels. Audio channels can be used to transmit voice data, video channels can be used to transmit video data, and data channels can be used to transmit application data, such as data superimposed on audio / video calls (such as special effects images, etc.), or data independent of audio / video calls, such as geographic location data and screen sharing data.
[0067] To meet different data transmission requirements, different protocols can be configured for different transmission channels. A possible protocol stack is shown in Figure 2. In Figure 2, the bottom layer of the audio, video, and data channels is the Internet Protocol (IP), and above IP is the User Datagram Protocol (UDP). For the audio and video channels, above UDP is the Real-Time Transport Protocol (RTP). RTP can encapsulate payloads such as voice, video, or text, and above that sits the conversational multimedia application. Therefore, the audio and video channels can also be referred to as RTP channels. Furthermore, above UDP sits the RTP Control Protocol (RTCP), which also sits above RTCP, meaning that RTP channels are associated with RTCP channels. For the data channel, above UDP sits the Datagram Transport Layer Security (DTLS), above DTLS sits the Stream Control Transmission Protocol (SCTP), above SCTP sits the application data / application, and above that sits the conversational multimedia application.
[0068] It can be understood that UDP, RTP, RTCP, DTLS and SCTP protocols are all transport layer protocols. Therefore, the UDP / RTP protocol stack can be understood as a type of transport layer protocol stack for the media channel, the UDP / RTCP protocol stack can be understood as another type of transport layer protocol stack for the media channel, and the UDP / DTLS / SCTP protocol stack can be understood as the transport layer protocol stack for the data channel. In the embodiment of the present application, the symbol " / " used to describe the protocol stack represents the hierarchical relationship of the protocols in the protocol stack. For example, the UDP / DTLS / SCTP protocol stack means that the DTLS protocol is above UDP, and the SCTP protocol is above the DTLS protocol. In the embodiment of the present application, the transport layer protocol stack of the data channel is not limited to the "UDP / DTLS / SCTP" protocol stack shown in Figure 2, but can also be other protocol stacks, such as: "TCP / DTLS / SCTP" protocol stack, "UDP / QUIC" (QUIC is the abbreviation of quick UDP internet connection) protocol stack, "UDP / SCTP" protocol stack, etc.
[0069] Based on the introduction of the above related content, the embodiment of this application will study the related implementation of calls (such as digital human calls).
[0070] Take a call between two terminal devices (including terminal device A and terminal device B) as an example: during the call, if terminal device A does not use the digital human service, the call subject seen by user b (user b here refers to the user using terminal device B to make the call) in the call application interface of terminal device B is the real image of user a (user a here refers to the user using terminal device A to make the call); if terminal device A uses the digital human service, terminal device A can act as a collection end to collect user a's facial feature data and provide it to the network side; the network side drives the digital human model based on the received facial feature data to generate a video frame, which includes the digital human image of user a and is sent to user b's terminal device B for display, and then the call subject seen by user b in the call application interface of terminal device B is the digital human image of user a, as shown in Figure 1. Furthermore, during a call between terminal device A and terminal device B, if terminal device A uses the digital human service, the behavior of user a's digital human can change with the behavior of user a. For example, if user a raises his left hand, the digital human of user a also raises his left hand; if user a blinks, the digital human of user a also blinks, and so on.
[0071] However, in existing implementations, the collection end (ie, terminal device A) uses pre-agreed transmission parameters to send facial feature data to the network side, and the transmission parameters cannot be adjusted.
[0072] Based on this, an embodiment of the present application provides a communication method for adjusting the transmission parameters of the first transmission channel to reduce the waste of bandwidth resources or improve the video display effect on the second terminal device side.
[0073] The communication method provided in this application can be applied to various communication systems, such as: fifth-generation (5G) communication systems (also known as new radio (NR) systems), fourth-generation (4G) communication systems (also known as long-term evolution (LTE) systems), LTE frequency division duplex (FDD) systems, LTE time division duplex (TDD) systems, etc. The technical solutions provided in this application can also be applied to future communication systems, such as sixth-generation (6G) mobile communication systems.
[0074] The following describes a network architecture applicable to the communication method proposed in this application. See Figure 3A, which is a schematic diagram of a network architecture provided in an embodiment of this application. The network architecture shown in Figure 3A includes a first terminal device, a communication network, and a second terminal device. The first terminal device and the second terminal device can communicate via the communication network.
[0075] The communication network may be an IMS network, which may include one or more network devices. For example, as shown in FIG3B , the communication network may include a call session control function (CSCF) network element, an IMS access media gateway (AGW), a home subscriber server (HSS), an IMS application server (AS), and a media function (MF) network element. The communication network illustrated in FIG3C is based on the communication network illustrated in FIG3B , and additionally includes some data channel (DC)-related network elements, such as a data channel signaling function (DCSF) network element, a data channel application repository (DCAR), and a data channel application server (DC AS). Optionally, the communication system illustrated in FIG3C also includes a network exposure function (NEF) network element.
[0076] Here is a brief introduction to each network element (or referred to as a functional network element, functional entity, node, device, etc.) shown in Figures 3A to 3C:
[0077] 1. Terminal device: A terminal device can be referred to as user equipment (UE), terminal, terminal device, access terminal, user unit, user station, mobile station, mobile station (MS), mobile terminal (MT), remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent, or user device. It is a device with wireless or wired communication capabilities. For example, a terminal device can connect to a wireless access device via an air interface, or it can connect to a wired access device via a wired interface. In terms of product form, terminal devices can include handheld devices, vehicle-mounted devices, wearable devices, or computing devices with communication capabilities. Exemplarily, the terminal device may be a mobile phone, a tablet computer, a computer with wireless communication function (such as a laptop computer, a PDA, etc.), a mobile internet device (MID), a virtual reality (VR) terminal, an augmented reality (AR) terminal, a smart watch, a smart bracelet, smart glasses, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, a cellular phone, a cordless phone, a SIP phone, a wireless local loop (WLL) station, a personal digital assistant (PDA), a handheld device with wireless communication function, other processing devices connected to a wireless modem, a terminal in an Internet of Things (IoT) system, a desktop computer, or a 3rd Generation Partnership Project (3GP) system. project, 3GPP) standard specifications, etc., are not restricted.
[0078] 2. CSCF Network Element: The CSCF network element, also referred to as CSCF, is a functional entity within the IMS and the core of the entire IMS. It is primarily responsible for handling signaling control during multimedia call sessions. It manages IMS user authentication, the quality of service (QoS) of the IMS bearer plane, and collaborates with other network elements to control Session Initiation Protocol (SIP) sessions, as well as service negotiation and resource allocation. The CSCF can communicate with terminal devices and gateway devices. For example, the CSCF can select a gateway device for communication with the terminal device and allocate routing information, such as IP addresses or ports, to the terminal device and gateway device.
[0079] As an example and not a limitation, CSCF is divided into proxy CSCF (P-CSCF), interrogating CSCF (I-CSCF), serving CSCF (S-CSCF), etc. according to its function. Among them, P-CSCF is the entry node for users to access the IMS network, and is mainly responsible for forwarding SIP signaling between IMS users and their home networks. I-CSCF is the unified entry point for IMS users' home networks, and is responsible for allocating or querying S-CSCFs that serve users. S-CSCF is the unified entry point for IMS users' home networks, and is responsible for allocating or querying S-CSCFs that serve users. It can be understood that the above-mentioned P-CSCF, S-CSCF, and I-CSCF can be independently configured in different entities, or integrated into the same entity, and this application does not limit this.
[0080] The IMS control network element in the embodiments of the present application below may be a CSCF, and further, for example, an S-CSCF.
[0081] 3. IMS AGW: IMS AGW can provide IMS network access gateway and media gateway functions.
[0082] 4. DCSF: used to provide data channel signaling control function.
[0083] 5. Data Channel Application Repository (DCAR): The DCAR is a repository for data channel applications (DC Apps). After a developer completes a DC App, they upload it to the operator's DCS, which then stores it in the DCAR. The DCS then downloads the DC App from the DCAR to its local server for subsequent processing when needed.
[0084] The DC control network element in the embodiment of the present application includes a DCSF and optionally also includes a DCAR.
[0085] 6. HSS: The HSS is a database that stores user information in the IMS. Users save user data. By way of example and not limitation, user data may include information about data channel services that users have contracted with operators.
[0086] 7. IMS AS: IMS AS is the top-level application layer device in the IMS system, providing basic and supplementary services such as multimedia conferencing, converged communications, SMS gateway, and standard switchboard. The IMS network is an open system based on IP bearer that provides users with various multimedia services. The IMS AS interacts with the CSCF to trigger and execute various network services. In addition, the terminal device and the IMS AS are connected in communication, and the IMS AS can establish a data channel for the terminal device. For example, the IMS AS can be a multimedia telephony application server (MMTEL AS) or a telephony application server (TAS).
[0087] 8. DC AS: The DC AS provides data channel service logic. It is understood that the DC AS can be deployed within the IMS network. In this case, the DC AS can directly connect to other network elements in the IMS network through interfaces (such as service-based interfaces). Alternatively, the DC AS can be deployed outside the IMS network. In this case, the DC AS can connect to other network elements in the IMS network through network exposure function (NEF) network elements (or IMS edge network management).
[0088] 9. NEF network element: NEF network element is used to securely open various services of the 5GC network to third parties.
[0089] 10. MF network element: also known as a media server, is used to provide media resource management functions, including media resource management of media channels and media resource management of data channels.
[0090] It is understood that, assuming that the first terminal device is the calling party and the second terminal device is the called party, the IMS network providing services to the first terminal device can be referred to as the originating IMS network (originating IMS), and the IMS network providing services to the second terminal device can be referred to as the terminating IMS network (terminating IMS). Furthermore, for the first terminal device, the originating IMS network is the local IMS network (local IMS), and the terminating IMS network is the remote IMS network (remote IMS); for the second terminal device, the terminating IMS network is the local IMS network, and the originating IMS network is the remote IMS network.
[0091] The originating IMS network and the terminating IMS network may be the same IMS network, or the originating IMS network and the terminating IMS network may be different IMS networks. When the originating IMS network and the terminating IMS network may be different IMS networks, the IMS network illustrated in FIG. 3B or FIG. 3C may be understood as the local IMS network of the first terminal device. FIG. 3B or FIG. 3C may also include a remote IMS network. The network element architecture within the remote IMS network is similar to that within the local IMS network and will not be described in detail.
[0092] The above-mentioned network architecture applied to the embodiment of the present application is only an example, and the network architecture applicable to the embodiment of the present application is not limited thereto. Any network architecture that can realize the functions of the above-mentioned network elements is applicable to the embodiment of the present application, that is, the network architecture and business scenarios described in the embodiment of the present application are for the purpose of more clearly illustrating the technical solutions of the embodiment of the present application, and do not constitute a limitation on the technical solutions provided by the embodiment of the present application. A person of ordinary skill in the art will know that with the evolution of the network architecture and the emergence of new business scenarios, the technical solutions provided by the embodiment of the present application are also applicable to similar technical problems. The network elements or devices listed in the above-mentioned network architecture are only exemplary illustrations, and the network architecture applicable to the present application may also include other network elements or devices, which are not limited in this application. The naming of the above-mentioned network elements or devices is only defined for the convenience of distinguishing different functions and should not constitute any limitation on the present application.
[0093] The communication method provided by the embodiment of the present application is described in detail below in conjunction with Examples 1 to 3. The communication method provided by the embodiment of the present application involves interaction between a network device and one or more terminal devices. The network device may be a network element or device in an IMS network, such as a network device that is an MF network element in an IMS network. Unless otherwise specified, "terminal device" may refer to the terminal device itself or a component in the terminal device, such as a chip or a chip system; "network device" may refer to the network device itself or a component in the network device, such as a chip or a chip system.
[0094] Example 1
[0095] FIG4 is a flow chart of a communication method according to an embodiment of the present application. As shown in FIG4 , the method includes the following steps:
[0096] S401, a network device establishes a first transmission channel between the network device and a first terminal device, and a second transmission channel between the network device and a second terminal device, so that the first terminal device and the second terminal device can communicate through the first transmission channel and the second transmission channel.
[0097] For example, as shown in FIG5 , a first transmission channel and a second transmission channel are used for a call between a first terminal device and a second terminal device. The first transmission channel is used to transmit the facial feature data of the first user, and the second transmission channel is used to transmit a first video frame. The first video frame includes a digital image corresponding to the facial feature data of the first user. In other words, the first terminal device can act as an acquisition terminal to collect the facial feature data of the first user (i.e., the user using the first terminal device to make a call) and send the facial feature data to the network device via the first transmission channel. Accordingly, the network device can drive the digital human model based on the received facial feature data to generate a first video frame, and send the first video frame to the second terminal device via the second transmission channel for display, so that the second user (i.e., the user using the second terminal device to make a call) can see the digital human image of the first user.
[0098] Wherein, the first transmission channel is a data channel or an RTP channel; and / or, the second transmission channel is an RTP channel. The "data channel" in the embodiment of the present application may refer to an application data channel (ADC). Wherein, taking the first transmission channel as an example (the second transmission channel can be understood by reference), the first terminal device is one endpoint of the first transmission channel, and the network device is the other endpoint of the first transmission channel. The first transmission channel can also pass through other possible devices, such as shown in Figure 3B or Figure 3C. The first transmission channel can also pass through the IMS AGW, which is not limited in this embodiment of the present application. The specific implementation process of the network device establishing the first transmission channel and the second transmission channel can refer to the introduction in Example 2 or Example 3.
[0099] Optionally, as shown in FIG5 , an audio channel is further established between the first terminal device and the second terminal device, and the audio channel is used to transmit audio data during a call between the first terminal device and the second terminal device.
[0100] Optionally, as shown in FIG5 , the network device further establishes a third transmission channel between the network device and the first terminal device, and a fourth transmission channel between the network device and the second terminal device. The third and fourth transmission channels are used for calls between the first and second terminal devices, wherein the fourth transmission channel is used to transmit the facial feature data of the second user, and the third transmission channel is used to transmit a second video frame, where the second video frame includes a digital image corresponding to the facial feature data of the second user. In other words, the second terminal device can act as an acquisition terminal to collect the facial feature data of the second user and send the facial feature data to the network device via the fourth transmission channel. Accordingly, the network device can drive the digital human model based on the received facial feature data to generate a second video frame, and send the second video frame to the first terminal device via the third transmission channel for display, so that the first user can see the digital human image of the second user.
[0101] The third transmission channel is a data channel or an RTP channel; and / or the fourth transmission channel is an RTP channel. The specific implementation process of the network device establishing the third transmission channel and the fourth transmission channel can be referred to the description of "Network Device Establishing the First Transmission Channel and the Second Transmission Channel".
[0102] S402: The network device determines new transmission parameters of the first transmission channel, where the new transmission parameters correspond to transmission parameters of the second transmission channel.
[0103] The term “corresponding” here may be understood as “matching”, that is, the new transmission parameters match the transmission parameters of the second transmission channel.
[0104] In the embodiment of the present application, there are multiple scenarios for triggering the network device to determine the new transmission parameters of the first transmission channel. Two possible scenarios are described below in combination with scenario 1 and scenario 2.
[0105] (1) Scenario 1
[0106] In the case where the transmission parameters of the second transmission channel are changed, the network device determines new transmission parameters of the first transmission channel, where the new transmission parameters correspond to the changed transmission parameters of the second transmission channel.
[0107] As a possible implementation, the transmission parameters of the second transmission channel include a frame rate, and the transmission parameters of the first transmission channel include a transmission rate of facial feature data. In this case, when the frame rate changes, the network device can determine a new transmission rate, and the new transmission rate corresponds to the changed frame rate. There are many specific reasons for the change in frame rate. For example, the network device can adjust the frame rate according to the network quality between the network device and the second terminal device, causing the frame rate to change. Specifically, in the process of establishing the second transmission channel, the network device and the second terminal device can negotiate the frame rate, and after the negotiation is completed, the network device sends video frames to the second terminal device through the second transmission channel according to the negotiated frame rate; subsequently, if the network device detects that the network quality between the network device and the second terminal device has deteriorated, the frame rate can be reduced, or if the network device detects that the network quality between the network device and the second terminal device has improved, the frame rate can be increased.
[0108] As another possible implementation, the transmission parameters of the second transmission channel include type information of the digital image, and the transmission parameters of the first transmission channel include the number of facial feature points corresponding to the facial feature data; wherein the type information is used to indicate the type of the digital image, and the type of the digital image may include a cartoon data image, a digital image with general precision, and a digital image with ultra-high precision, without specific limitation. In this case, when the type of the digital image changes, the network device can determine the number of new facial feature points, and the number of new facial feature points corresponds to the type of the changed digital image. There are various specific reasons for the change in the type of the digital image. For example, the network device can adjust the type of the digital image according to the request of the first terminal device (for example, the first user wants to adjust the type of the digital image, which triggers the first terminal device to request the network device to adjust the type of the digital image), so that the type of the digital image changes.
[0109] (2) Scenario 2
[0110] In the case where the transmission parameters of the first transmission channel do not correspond to the transmission parameters of the second transmission channel, the network device determines new transmission parameters for the first transmission channel, and the new transmission parameters correspond to the transmission parameters of the second transmission channel. For example, after the network device establishes the first transmission channel and the second transmission channel, the network device receives facial feature data from the first terminal device through the first transmission channel, and sends the first video frame to the second terminal device through the second transmission channel. During this process, the network device can determine whether the transmission parameters of the first transmission channel correspond to the transmission parameters of the second transmission channel (that is, whether the parameter correspondence relationship is satisfied, and the parameter correspondence relationship can refer to the description below). If not, the new transmission parameters of the first transmission channel can be determined. For another example, after the network device establishes the first transmission channel and the second transmission channel, it determines the new transmission parameters of the first transmission channel corresponding to the transmission parameters of the second transmission channel based on the transmission parameters of the second transmission channel.
[0111] As a possible implementation, the transmission parameters of the second transmission channel include the frame rate, and the transmission parameters of the first transmission channel include the transmission rate of facial feature data. In this case, when the transmission rate does not correspond to the frame rate, the network device can determine a new transmission rate, and the new transmission rate corresponds to the frame rate.
[0112] As another possible implementation, the transmission parameters of the second transmission channel include type information of the digital image, and the transmission parameters of the first transmission channel include the number of facial feature points corresponding to the facial feature data. In this case, when the number of facial feature points does not correspond to the type of the digital image, the network device can determine the number of new facial feature points, and the new number of facial feature points corresponds to the type of the digital image.
[0113] The specific implementation of "network device determining new transmission parameters" is described below.
[0114] In one possible implementation, the network device determines new transmission parameters based on the correspondence information. The new transmission parameters may include a new transmission rate and / or a new number of facial feature points. The correspondence information indicates the parameter correspondence between the first transmission channel and the second transmission channel, and the parameter correspondence meets the call performance requirements.
[0115] For example, the parameter correspondence includes the correspondence between the transmission rate of facial feature data and the frame rate. When the transmission rate of facial feature data and the frame rate satisfy this correspondence, it can be considered that the transmission rate of facial feature data and the frame rate correspond. The correspondence between the transmission rate of facial feature data and the frame rate is: transmission rate of facial feature data = x * frame rate. Where x represents a coefficient. For example, if x = 0.5, then when the frame rate is 20 FPS, the transmission rate corresponding to the frame rate is 10 FPS.
[0116] For example, parameter correspondences include the relationship between the number of facial feature points and the type of digital image. When the number of facial feature points and the type of digital image satisfy this correspondence, it can be considered that the number of facial feature points corresponds to the type of digital image. The number of facial feature points directly affects the realism and subtlety of the digital human's expressions. For example, a small number of facial feature points will result in a rough and less subtle expression. For example, using only the feature points of the eyes and mouth to drive the digital human's expressions may only allow for simple smiles and tears, failing to express more complex and delicate expressions. A large number of facial feature points can make expressions more realistic and delicate. For example, using all facial feature points to drive the digital human's expressions can express very rich and delicate expressions, such as smiles, frowns, and blinks. Therefore, the relationship between the number of facial feature points and the type of digital image can be set based on this principle.
[0117] For example, the correspondence between the number of facial feature points and the type of digital image can be represented by a list. Table 1 is a possible list. As shown in Table 1, the types of digital images can include cartoon digital images, general-precision digital images, and ultra-high-precision digital images. The number of facial feature points corresponding to cartoon digital images is 21, the number of facial feature points corresponding to general-precision digital images is 68, and the number of facial feature points corresponding to ultra-high-precision digital images is 106.
[0118] Table 1: Correspondence between the number of facial feature points and the type of digital image
[0119] It is understood that the correspondence information may be pre-configured in the network device or may be pre-defined by the protocol, and this embodiment of the present application does not limit this. In this embodiment of the present application, the "correspondence between the transmission rate of facial feature data and the frame rate" and the "correspondence between the number of facial feature points and the type of digital image" are used as examples for description. In other possible examples, it may also be "the correspondence between the transmission rate of facial feature data, the number of facial feature points, and the frame rate", and this embodiment of the present application does not limit this.
[0120] Optionally, the network device may also obtain one or more transmission parameters of the first transmission channel supported by the first terminal device, such as the first terminal device sends one or more transmission parameters of the first transmission channel supported by the first terminal device to the network device, and then the network device may obtain one or more transmission parameters of the first transmission channel supported by the first terminal device. Furthermore, the network device may determine a third transmission parameter set based on the first transmission parameter set and the second transmission parameter set. The first transmission parameter set includes one or more transmission parameters of the first transmission channel supported by the first terminal device, the second transmission parameter set includes one or more transmission parameters of the first transmission channel supported by the network device, and the third transmission parameter set is the intersection of the first transmission parameter set and the second transmission parameter set. Taking the number of facial feature points as an example, the first transmission parameter set is {5, 21, 68, 106}, that is, the number of facial feature points supported by the first terminal device includes {5, 21, 68, 106}, the second transmission parameter set is {21, 68, 106}, that is, the number of facial feature points supported by the network device includes {21, 68, 106}, and the third transmission parameter set is {21, 68, 106}. It should be understood that the introduction of "set" here is only for ease of description, and in specific implementations, it can also be implemented in the form of "set".
[0121] In this case, the network device can select new transmission parameters from the third transmission parameter set that satisfy the parameter correspondence based on the correspondence information. In this way, through media negotiation between the first terminal device and the network device, the network device can ensure that the new transmission parameters determined based on the media negotiation results are not adjusted to transmission parameters that the first terminal device does not support, thereby preventing adjustment failures.
[0122] In addition, it can be understood that the above-mentioned "one or more transmission parameters supported by the first terminal device" may refer to one or more transmission parameters that can be supported by the capabilities of the first terminal device, or may also refer to one or more transmission parameters preferred by the first terminal device within the capabilities of the first terminal device, without specific limitation.
[0123] S403, the network device instructs the first terminal device to make a call according to the new transmission parameters; accordingly, the first terminal device makes the call according to the new transmission parameters.
[0124] Exemplarily, the network device sends instruction information to the first terminal device, instructing the first terminal device to conduct a call based on new transmission parameters. The instruction information may include the new transmission parameters; alternatively, the instruction information may include information used to determine the new transmission parameters, such as an offset between the new transmission parameters and the original transmission parameters. (The specific details are not limited here.) Accordingly, upon receiving the instruction information, the first terminal device may adjust the transmission parameters of the first channel to the new transmission parameters and send facial feature data to the network device based on the new transmission parameters.
[0125] In addition, there are many ways for the network device to send indication information to the first terminal device. For example, the network device can send indication information through the first transmission channel (see Example 3), or it can send indication information through other possible channels (see Example 2), without specific limitation.
[0126] Optionally, before S403, the network device may also learn that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device (or the first terminal device supports the network device instructing the first terminal device to adjust the transmission parameters of the first transmission channel). For example, the first terminal device may send capability information to the network device, and the capability information is used to indicate that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device, and then the network device may learn that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device based on the capability information. That is to say, when the network device learns that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device, it instructs the first terminal device to conduct the call according to the new transmission parameters. Otherwise (such as the first terminal device does not support the transmission parameters of the first transmission channel indicated by the network device), the network device may not instruct the first terminal device to conduct the call according to the new transmission parameters, or the network device may not determine the new transmission parameters.
[0127] Among them, the capability information and the above-mentioned "one or more transmission parameters of the first transmission channel supported by the first terminal device" can be carried in the same message, or can also be carried in different messages, and the embodiment of the present application does not limit this.
[0128] In existing implementations, the transmission parameters of the first transmission channel are pre-agreed transmission parameters and cannot be adjusted, which may result in a waste of bandwidth resources or poor display quality of the digital human video on the second terminal device. However, using the method in the embodiments of the present application, the network device can determine new transmission parameters for the first transmission channel, which correspond to the transmission parameters of the second transmission channel, and instruct the first terminal device to conduct a call based on the new transmission parameters, thereby adjusting the transmission parameters of the first channel, thereby reducing the waste of bandwidth resources or improving the video display quality on the second terminal device side.
[0129] For example, a first terminal device sends facial feature data to a network device at a first transmission rate, and the network device sends video frames to a second terminal device at a first frame rate. When the first transmission rate is too high and the first frame rate is too low, bandwidth resources will be wasted. However, using the method in the embodiment of the present application, the network device can determine a new transmission parameter (such as a second transmission rate, which is lower than the first transmission rate and corresponds to the first frame rate, such as satisfying the corresponding relationship above) and instruct the first terminal device to transmit according to the second transmission rate, thereby reducing the waste of bandwidth resources. When the first transmission rate is too low and the first frame rate is too high, the digital human video displayed on the second terminal device may be stuck, that is, the digital human video displayed on the second terminal device is not good, and the user experience is poor. However, using the method in the embodiment of the present application, the network device can determine a new transmission rate (referred to as the second transmission rate, which is higher than the first transmission rate and corresponds to the first frame rate, such as satisfying the corresponding relationship above) and instruct the first terminal device to transmit according to the second transmission rate, thereby ensuring that the digital human video displayed on the second terminal device is better.
[0130] For another example, a first terminal device collects facial feature data according to the number of facial feature points as a first number, and a network device sends a video frame to a second terminal device according to the type of the digital image as a first type. When the first number is large and the number of facial feature points required for the first type is small, bandwidth resources will be wasted. However, using the method in the embodiment of the present application, the network device can determine a new transmission parameter (such as a second number, the second number is less than the first number, the second number corresponds to the first type, such as satisfying the corresponding relationship above), and instruct the first terminal device to collect facial feature data according to the second number, thereby reducing the waste of bandwidth resources. When the first number is small and the number of facial feature points required for the first type is large, the expression of the digital image displayed by the second terminal device is not rich enough, that is, the effect of the digital human video displayed by the second terminal device is not good, and the user experience is poor. However, using the method in the embodiment of the present application, the network device can determine a new transmission parameter (such as a second number, the second number is greater than the first number, the second number corresponds to the first type, such as satisfying the corresponding relationship above), and instruct the first terminal device to collect facial feature data according to the second number, thereby ensuring that the effect of the digital human video displayed by the second terminal device is better.
[0131] Based on the description of the first embodiment above, two possible implementation processes are described below in conjunction with the second and third embodiments. In the second embodiment, the network architecture shown in FIG3B is used as an example to describe the first transmission channel as an RTP channel. In the third embodiment, the network architecture shown in FIG3C is used as an example to describe the first transmission channel as a data channel.
[0132] Example 2
[0133] FIG6 is a flow chart of a communication method according to an embodiment of the present application. As shown in FIG6 , the method includes the following steps:
[0134] S601: Establish an audio channel between a first terminal device and a second terminal device.
[0135] Here, the specific implementation of establishing the audio channel between the first terminal device and the second terminal device refers to the existing technology, such as establishing the audio channel through an initial invite process.
[0136] After establishing an audio channel between the first terminal device and the second terminal device, the first terminal device and the second terminal device conduct a voice call. During the voice call between the first terminal device and the second terminal device, if the first terminal device triggers the Digital Human service, the network device can establish a first transmission channel between the network device and the first terminal device, and a second transmission channel between the network device and the second terminal device. In this case, the first transmission channel and the second transmission channel can be established through a re-invite process.
[0137] It is understandable that, in other possible embodiments, the audio channel, the first transmission channel, and the second transmission channel may also be established through the initial invitation process, and the embodiment of the present application does not limit this.
[0138] The specific implementation of establishing the first transmission channel and the second transmission channel through the re-invite process will be described below in conjunction with S602 to S608.
[0139] S602: The first terminal device sends a re-invite request message to the IMS AS through the IMS control network element; accordingly, the IMS AS receives the re-invite request message.
[0140] Exemplarily, the re-invite request message may also be referred to as a re-negotiation request message, and the re-invite request message includes media negotiation information of the first terminal device, which may also be referred to as session description protocol (SDP) information. For example, the SDP information of the first terminal device includes the number of facial feature points supported by the first terminal device, the maximum transmission rate supported by the first terminal device, and optionally, capability information of the first terminal device, which is used to indicate that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device. In addition, the re-invite request message may also include other possible information, such as the identifier of the digital human call, the user identifier of the first terminal device, the user identifier of the second terminal device, etc.
[0141] See Table 2 for an example of the format of a re-invite request message.
[0142] Table 2: Example of the format of a re-invite request message
[0143] In the above Table 2, "From: XXX" means "the From field carries the user ID of the calling party (first terminal device)"; "To: XXX" means "the To field carries the user ID of the called party (second terminal device)".
[0144] "m = audio port number 1a transmission protocol media format description; c = network type address type connection address; a = XXX" represents the media negotiation information of the first terminal device for the audio channel. Among them, "port number 1a" represents the port number of the audio channel on the first terminal device side (for example, if port number 1a is 23468, it means that the port number of the audio channel on the first terminal device side is 23468). "Transport protocol" is, for example, RTP / Address Resolution Protocol (AVP). Other parameters can be referred to the explanations in existing protocols.
[0145] “m=application port number 1b transmission protocol metadata;c=network type address type connection address;a=3gpp:facial_expressions;feature_points:[5,21,68,106];facial_rate=50;label="avatar call";a=rtcp-fb:*3gpp-facial-adjust” indicates the media negotiation information of the first terminal device for the first transmission channel. Among them, “port number 1b” indicates the port number of the first transmission channel on the first terminal device side (for example, if port number 1b is 1001, it means that the port number of the first transmission channel on the first terminal device side is 1001). “Transport protocol” is, for example, RTP / AVP, and “metadata” indicates that the transmitted data is metadata, such as facial feature data. "feature_points:[5,21,68,106]" indicates that the first terminal device supports the number of facial feature points [5,21,68,106]. "facial_rate=50" indicates that the first terminal device supports a maximum transmission rate of 50 FPS. "label="avatar call"" indicates the identifier for a digital human call. "a=rtcp-fb:*3gpp-facial-adjust" indicates that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device.
[0146] It is understood that the parameters shown in Table 2 are only examples, and the re-invite request message may also include other possible parameters, which are not specifically limited. In addition, the parameter names shown in Table 2 are only examples, and the embodiments of the present application do not limit them.
[0147] S603: The IMS AS sends a request message to the MF network element according to the re-invite request message; correspondingly, the MF network element receives the request message.
[0148] For example, after receiving the re-invitation request message, the IMS AS can interact with the network repository function (NRF) to obtain the MF network element that supports specific media services (such as digital human services), and then call the enhanced Nmf_MRM_Create operation, that is, send a request message to the MF network element to request the creation of media resources connecting the first terminal device and the second terminal device on the MF network element (such as the port number of the first transmission channel on the MF network element, etc., the port number of the second transmission channel on the MF network element, etc.), and request to reserve media service computing resources (such as reserving digital human media processing resources).
[0149] See Table 3 for an example of the format of the request message. For ease of description, "Termination-1" and "Termination-2" are introduced in this application example. Termination-1 can be understood as the logical endpoint of the first transmission channel on the MF network element side, and Termination-2 can be understood as the logical endpoint of the second transmission channel on the MF network element side.
[0150] Table 3: Example of request message format
[0151] The parameters with the value "NULL" in Table 3 indicate that the values of these parameters are empty. The "remote" mentioned in Table 3 refers to the MF network element, that is, the MF network element side is the local end, and the first terminal device side and the second terminal device side are the remote ends.
[0152] Specifically, the request message includes a media service type (media_servive_type) parameter, and the media_servive_type parameter is used to indicate "digital human call".
[0153] Furthermore, the request message may also include a Termination-1 parameter, which includes a Termination-1 ID and a media stream description (expressed as a Media Stream Descriptor-1) parameter. The Media Stream Descriptor-1 parameter includes a media ID (such as A001), a remote specification (expressed as a Remote Mb Specification) parameter, a Media Type parameter, and a facial feature point parameter. The Remote Mb Specification parameter includes the port number and connection address of the first transmission channel on the first terminal device side, etc. The Media Type parameter is used to indicate metadata, i.e., it indicates that the first transmission channel is used to transmit metadata (such as facial feature data). The facial feature point parameter includes the number of facial feature points supported by the first terminal device, the maximum transmission rate supported by the first terminal device, etc.
[0154] In addition, the request message may also include a Termination-2 parameter, which includes a Termination-2 ID and a media stream description (expressed as Media Stream Descriptor-2) parameter. The Media Stream Descriptor-2 parameter includes a media ID (such as B002), a remote description (expressed as Remote Mb Specification) parameter, and a media type (Media Type) parameter, wherein the Media Type parameter is used to indicate video (that is, the second transmission channel is used to transmit video frames).
[0155] S604: The MF network element sends a response message to the IMS AS according to the request message; correspondingly, the IMS AS receives the response message.
[0156] For example, the MF network element may assign values to some parameters that take the value "NULL" in the request message, and additionally carry a uniform resource locator (URL) in the response message.
[0157] See Table 4 for an example of the format of the response message, wherein the "local end" mentioned in Table 4 refers to the MF network element side.
[0158] Table 4: Example of response message format
[0159] It is understood that the meanings of the corresponding parameters in Table 4 can be understood by referring to the description in Table 4.
[0160] S605. The IMS AS generates the second SDP information of the MF network element according to the response message, and sends a re-invite request message to the second terminal device, where the re-invite request message includes the second SDP information of the MF network element. Accordingly, the second terminal device receives the second SDP information of the MF network element.
[0161] Here, the second SDP information of the MF network element includes the port number and connection address of the second transmission channel on the MF network element side, and may also include other possible information, which is not specifically limited.
[0162] For example, there are multiple ways for the IMS AS to send the re-invite request message to the second terminal device. For example, the IMS AS can send the re-invite request message to the second terminal device through an IMS control network element. The specific implementation can refer to the existing technology and will not be repeated here.
[0163] S606. After receiving the second SDP information of the MF network element, the second terminal device sends a re-invitation response message (such as a 200OK message) to the IMS AS. The re-invitation response message includes the port number and connection address of the second transmission channel on the second terminal device side. Accordingly, the IMS AS receives the re-invitation response message.
[0164] S607: The IMS AS sends an update message to the MF network element. The update message includes the port number and connection address of the second transmission channel on the second terminal device side, that is, updates the Remote Mb Specification parameter in the Termination-2 parameter. Accordingly, the MF network element receives the update message.
[0165] In this way, since the MF network element learns the port number and connection address of the second transmission channel on the second terminal device side from the update message, and the second terminal device learns the port number and connection address of the second transmission channel on the MF network element side based on the second SDP information of the MF network element, the second transmission channel is established.
[0166] S608. The IMS AS generates the first SDP information of the MF network element based on the previously received response message, and sends a re-invite response message to the first terminal device, where the re-invite response message includes the first SDP information of the MF network element. Accordingly, the first terminal device receives the first SDP information of the MF network element.
[0167] Here, the first SDP information of the MF network element includes the port number and connection address of the second transmission channel on the MF network element side, and may also include the number of facial feature points supported by the MF network element (for example, [5, 21, 68]) and the maximum transmission rate supported by the MF network element (for example, 50 FPS).
[0168] See Table 5 for an example of the format of a re-invite response message.
[0169] Table 5: Example of the format of the re-invite response message
[0170] In this way, since the MF network element learns the port number and connection address of the first transmission channel on the first terminal device side from the request message, and the first terminal device learns the port number and connection address of the first transmission channel on the MF network element side based on the first SDP information of the MF network element, the first transmission channel is established.
[0171] S609: The IMS AS sends an instruction to the MF network element according to the URL in the response message (eg, Media_URL / A001). The instruction is used to instruct the MF network element to start digital human media processing.
[0172] For example, the embodiment of the present application does not limit the execution order of the three steps S607 to S609. For example, these three steps can be executed simultaneously, or can be executed in the order of S607, S608, and S609.
[0173] S610: The first terminal device sends facial feature data to the MF network element through the first transmission channel; accordingly, the MF network element receives the facial feature data.
[0174] S611: The MF network element drives the digital human model to generate video frames based on the facial feature data, and sends the video frames to the second terminal device through the second transmission channel.
[0175] S612: The MF network element determines new transmission parameters of the first transmission channel.
[0176] For example, the specific implementation of S612 may refer to S402 and will not be described in detail.
[0177] S613, the MF network element instructs the first terminal device to make a call according to the new transmission parameters; accordingly, the first terminal device makes a call according to the new transmission parameters.
[0178] For example, the MF network element sends indication information to the first terminal device via the RTCP channel associated with the first transmission channel (i.e., the RTP channel). The indication information is used to instruct the first terminal device to conduct a call based on the new transmission parameters. In other words, the indication information can be carried in an RTCP message. In embodiments of the present application, the RTCP message can be extended. For example, when the RTCP message carries the indication information, the extended type of the RTCP message is "Payload-Specific Feedback Messages."
[0179] Example 3
[0180] FIG7 is a flow chart of a communication method according to an embodiment of the present application. As shown in FIG7 , the method includes the following steps:
[0181] S701: Establish an audio channel between a first terminal device and a second terminal device.
[0182] S702: Establish a first transmission channel and a second transmission channel.
[0183] For example, the specific implementation of establishing the first transmission channel and the second transmission channel may refer to the related description of establishing the data channel and the video channel in the prior art, which will not be repeated here.
[0184] S703 : The first terminal device sends message 1 to the MF network element through the first transmission channel; accordingly, the MF network element receives message 1 .
[0185] Exemplarily, Message 1 includes one or more transmission parameters of the first transmission channel supported by the first terminal device, such as the number of facial feature points supported by the first terminal device (e.g., [5, 21, 68, 106]) and the maximum transmission rate of the first transmission channel supported by the first terminal device (e.g., 50 FPS). Optionally, Message 1 also includes capability information of the first terminal device.
[0186] S704, the MF network element sends message 2 to the first terminal device through the first transmission channel; accordingly, the first terminal device receives message 2.
[0187] Exemplarily, message 2 includes one or more transmission parameters of the first transmission channel supported by the MF network element, such as the number of facial feature points supported by the MF network element (such as [5, 21, 68]), and the maximum transmission rate of the first transmission channel supported by the MF network element (such as 50 FPS).
[0188] S705: The first terminal device sends facial feature data to the MF network element through the first transmission channel; accordingly, the MF network element receives the facial feature data.
[0189] S706: The MF network element drives the digital human model to generate video frames based on the facial feature data, and sends the video frames to the second terminal device through the second transmission channel.
[0190] S707: The MF network element determines new transmission parameters of the first transmission channel.
[0191] For example, the specific implementation of S707 may refer to S402 and will not be described in detail.
[0192] S708, the MF network element instructs the first terminal device to make a call according to the new transmission parameters; accordingly, the first terminal device makes a call according to the new transmission parameters.
[0193] For example, the MF network element sends indication information to the first terminal device through the first transmission channel, where the indication information is used to instruct the first terminal device to make a call according to the new transmission parameters.
[0194] With respect to the above embodiments, it can be understood that:
[0195] (1) In the various embodiments of this application, unless otherwise specified or logically conflicting, the terms and / or descriptions between different embodiments are consistent and may be referenced to each other. The technical features in different embodiments may be combined to form new embodiments based on their inherent logical relationships. In addition, within the same embodiment, different implementations or different examples may also reference or refer to each other.
[0196] (2) The various numerical numbers involved in this application are only for the convenience of description and are not intended to limit the scope of this application. The step numbers in the above flowcharts are only examples of the execution process and do not constitute a restriction on the order of execution of the steps. That is, the size of the step numbers does not mean the order of execution. The execution order of each step should be determined by its function and internal logic. In addition, not all the steps shown in the flowcharts are required to be executed. Some steps can be added or deleted based on actual needs.
[0197] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the interaction between the network device and the terminal device. It is understandable that in order to realize the above functions, the network device and the terminal device may include hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in a hardware or computer software driven hardware manner depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0198] In the embodiments of the present application, network devices and terminal devices can be divided into functional units according to the above method examples. For example, different functional units can be divided according to different functions, or two or more functions can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.
[0199] In the case of adopting an integrated unit, Figure 8 shows a possible exemplary block diagram of the device involved in the embodiments of the present application. As shown in Figure 8, the device 800 may include: a processing unit 802 and a communication unit 803. The processing unit 802 is used to control and manage the actions of the device 800. The communication unit 803 is used to support the communication between the device 800 and other devices. Optionally, the communication unit 803 is also called a transceiver unit, and may include a receiving unit and / or a sending unit, which are used to perform receiving and sending operations respectively. The device 800 may also include a storage unit 801 for storing program code and / or data of the device 800.
[0200] (1) The apparatus 800 may be the network device in the above-described embodiments, or may be a component (e.g., a circuit or chip) disposed within the network device. The processing unit 802 may support the apparatus 800 in executing the actions of the network device in the above-described method examples. Alternatively, the processing unit 802 primarily executes the internal actions of the network device in the method examples, and the communication unit 803 may support communication between the apparatus 800 and other devices.
[0201] For example, in one embodiment, the first transmission channel is a transmission channel between a network device and a first terminal device, and the second transmission channel is a transmission channel between the network device and a second terminal device; the first transmission channel and the second transmission channel are used for a call between the first terminal device and the second terminal device, wherein the first transmission channel is used to transmit facial feature data of a first user, and the second transmission channel is used to transmit a first video frame, and the first video frame includes a digital image corresponding to the facial feature data of the first user; the processing unit 802 is used to: determine new transmission parameters of the first transmission channel, and the new transmission parameters correspond to the transmission parameters of the second transmission channel; the communication unit 803 is used to: instruct the first terminal device to conduct the call according to the new transmission parameters.
[0202] In one possible design, the processing unit 802 is specifically used to: determine new transmission parameters of the first transmission channel when the transmission parameters of the second transmission channel change, and the new transmission parameters correspond to the changed transmission parameters of the second transmission channel; or, when the transmission parameters of the first transmission channel do not correspond to the transmission parameters of the second transmission channel, determine new transmission parameters of the first transmission channel, and the new transmission parameters correspond to the transmission parameters of the second transmission channel.
[0203] In one possible design, the new transmission parameters are determined based on correspondence information, where the correspondence information is used to indicate a parameter correspondence between the first transmission channel and the second transmission channel, and the parameter correspondence meets the performance requirements of the call.
[0204] In a possible design, the correspondence information is a list, which includes the correspondence between one or more transmission parameters of the first transmission channel and one or more transmission parameters of the second transmission channel.
[0205] In one possible design, the transmission parameters of the second transmission channel include a frame rate, and the transmission parameters of the first transmission channel include a transmission rate of the facial feature data.
[0206] In one possible design, the transmission parameters of the second transmission channel include type information of the digital image, and the transmission parameters of the first transmission channel include the number of facial feature points corresponding to the facial feature data.
[0207] In one possible design, the method further includes: obtaining one or more transmission parameters of the first transmission channel supported by the first terminal device, wherein the one or more transmission parameters supported by the first terminal device include the new transmission parameter.
[0208] In one possible design, the processing unit 802 is further used to select the new transmission parameter supported by the network device from the one or more transmission parameters supported by the first terminal device.
[0209] In one possible design, the first transmission channel is a data channel or a real-time transport protocol RTP channel; and / or the second transmission channel is an RTP channel.
[0210] In one possible design, before instructing the first terminal device to conduct the call according to the new transmission parameters, the processing unit 802 is further used to: obtain information that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device.
[0211] In one possible design, the processing unit 802 is also used to: establish a third transmission channel between the network device and the first terminal device, and a fourth transmission channel between the network device and the second terminal device; the third transmission channel and the fourth transmission channel are used for the call, wherein the fourth transmission channel is used to transmit facial feature data of the second user, and the third transmission channel is used to transmit a second video frame, and the second video frame includes a digital image corresponding to the facial feature data of the second user.
[0212] (2) The apparatus 800 may be the first terminal device in the above-described embodiment, or may be a component (e.g., a circuit or chip) disposed in the first terminal device. The processing unit 802 may support the apparatus 800 in executing the actions of the first terminal device in each of the above-described method examples. Alternatively, the processing unit 802 may primarily execute the internal actions of the first terminal device in the method examples, and the communication unit 803 may support communication between the apparatus 800 and other devices.
[0213] For example, in one embodiment, the processing unit 802 is used to: conduct a call with a second terminal device through a first transmission channel and a second transmission channel; wherein the first transmission channel is used to transmit facial feature data of a first user to a network device, and the second transmission channel is used to transmit a first video frame between the network device and the second terminal device, and the first video frame includes a digital image corresponding to the facial feature data of the first user; receive new transmission parameters of the first transmission channel from the network device, and the new transmission parameters correspond to the transmission parameters of the second transmission channel; and conduct the call according to the new transmission parameters.
[0214] In one possible design, the new transmission parameters are determined based on correspondence information, where the correspondence information is used to indicate a parameter correspondence between the first transmission channel and the second transmission channel, and the parameter correspondence meets the performance requirements of the call.
[0215] In a possible design, the correspondence information is a list, which includes the correspondence between one or more transmission parameters of the first transmission channel and one or more transmission parameters of the second transmission channel.
[0216] In one possible design, the transmission parameters of the second transmission channel include a frame rate, and the transmission parameters of the first transmission channel include a transmission rate of the facial feature data.
[0217] In one possible design, the transmission parameters of the second transmission channel include type information of the digital image, and the transmission parameters of the first transmission channel include the number of facial feature points corresponding to the facial feature data.
[0218] In one possible design, the communication unit 803 is used to: send one or more transmission parameters of the first transmission channel supported by the first terminal device to the network device, and the new transmission parameters are selected by the network device from the one or more transmission parameters supported by the first terminal device.
[0219] In one possible design, the first transmission channel is a data channel or an RTP channel; and / or the second transmission channel is an RTP channel.
[0220] In one possible design, before receiving new transmission parameters of the first transmission channel from the network device, the communication unit 803 is used to: send capability information to the network device, wherein the capability information is used to indicate that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device.
[0221] It should be understood that the division of units in the above device is merely a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. Moreover, the units in the device can all be implemented in the form of software calling through processing elements; or they can all be implemented in the form of hardware; or some units can be implemented in the form of software calling through processing elements, and some units can be implemented in the form of hardware. For example, each unit can be a separately established processing element, or it can be integrated into a certain chip of the device. In addition, it can also be stored in the memory in the form of a program, called by a certain processing element of the device and execute the function of the unit. In addition, all or part of these units can be integrated together, or they can be implemented independently. The processing element described here can also be a processor, which can be an integrated circuit with signal processing capabilities. In the implementation process, each operation of the above method or each unit above can be implemented by the integrated logic circuit of the hardware in the processor element or in the form of software calling through the processing element.
[0222] In one example, the unit in any of the above devices may be one or more integrated circuits configured to implement the above method, such as one or more application specific integrated circuits (ASICs), one or more digital singnal processors (DSPs), one or more field programmable gate arrays (FPGAs), or a combination of at least two of these integrated circuit forms. For another example, when the unit in the device can be implemented in the form of a processing element scheduler, the processing element can be a processor, such as a general-purpose central processing unit (CPU), or other processor that can call a program. For another example, these units can be integrated together and implemented in the form of a system-on-a-chip (SOC).
[0223] The above-mentioned receiving unit is an interface circuit of the device, which is used to receive signals from other devices. For example, when the device is implemented as a chip, the receiving unit is the interface circuit of the chip used to receive signals from other chips or devices. The above-mentioned sending unit is an interface circuit of the device, which is used to send signals to other devices. For example, when the device is implemented as a chip, the sending unit is the interface circuit of the chip used to send signals to other chips or devices.
[0224] 9 is a schematic diagram of a device according to an embodiment of the present application. Device 900 may be an IMS AS or DC control network element in the above embodiments, and is configured to implement the functions of the network device or the first terminal device in the above embodiments.
[0225] As shown in Figure 9, apparatus 900 may include a processor 901, a memory 902, and an interface circuit 903. Processor 901 may be used to process communication protocols and communication data, and to control apparatus 900. Memory 902 may be used to store programs and data, and processor 901 may execute the method performed by apparatus 900 in the embodiments of the present application based on the programs. Interface circuit 903 may be used for apparatus 900 to communicate with other devices. This communication may be wired or wireless. For example, this interface circuit may be a service-oriented interface.
[0226] The memory 902 may also be externally connected to the device 900, in which case the device 900 may include an interface circuit 903 and a processor 901. The interface circuit 903 may also be externally connected to the device 900, in which case the device 900 may include the memory 902 and the processor 901. When both the interface circuit 903 and the memory 902 are externally connected to the device 900, the device 900 may include the processor 901.
[0227] The apparatus 900 shown in FIG9 is capable of implementing the various processes related to the apparatus 900 in the above-described method embodiment. The operations and / or functions of the various modules in the apparatus 900 shown in FIG9 are respectively for implementing the corresponding processes in the above-described method embodiment. For details, please refer to the description of the above-described method embodiment. To avoid repetition, detailed descriptions are omitted here.
[0228] An embodiment of the present application further provides a communication system, comprising a network device and a first terminal device, wherein the network device is configured to perform operations related to the network device side of the aforementioned method embodiment, and the first terminal device is configured to perform operations related to the first terminal device side of the aforementioned method embodiment. Optionally, the communication system further comprises a second terminal device, configured to perform operations related to the second terminal device side of the aforementioned method embodiment.
[0229] The terms "system" and "network" in the embodiments of the present application can be used interchangeably. "At least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, "at least one of A, B or C" includes A, B, C, AB, AC, BC or ABC, and "at least one of A, B and C" can also be understood to include A, B, C, AB, AC, BC or ABC. And, unless otherwise specified, the ordinal numbers such as "first" and "second" mentioned in the embodiments of the present application are used to distinguish multiple objects and are not used to limit the order, timing, priority or importance of multiple objects.
[0230] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, optical storage, etc.) that contain computer-usable program code.
[0231] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or box in the flow chart and / or block diagram, as well as the combination of the flow chart and / or box in the flow chart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more flow charts and / or one or more boxes in the block diagram.
[0232] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0233] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0234] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.
Claims
1. A communication method, characterized in that, The method includes: Establishing a first transmission channel between a network device and a first terminal device, and a second transmission channel between the network device and a second terminal device; the first transmission channel and the second transmission channel are used for a call between the first terminal device and the second terminal device, wherein the first transmission channel is used to transmit face feature data of a first user, and the second transmission channel is used to transmit a first video frame, and the first video frame includes a digital image corresponding to the face feature data of the first user; Determining new transmission parameters of the first transmission channel, the new transmission parameters corresponding to the transmission parameters of the second transmission channel; Instructing the first terminal device to perform the call according to the new transmission parameters.
2. The method according to claim 1, characterized in that, Determining new transmission parameters of the first transmission channel, the new transmission parameters corresponding to the transmission parameters of the second transmission channel, includes: When the transmission parameters of the second transmission channel change, determining new transmission parameters of the first transmission channel, the new transmission parameters corresponding to the changed transmission parameters of the second transmission channel; or, When the transmission parameters of the first transmission channel do not correspond to the transmission parameters of the second transmission channel, determining new transmission parameters of the first transmission channel, the new transmission parameters corresponding to the transmission parameters of the second transmission channel.
3. The method according to claim 1 or 2, characterized in that, The new transmission parameters are determined according to corresponding relationship information, and the corresponding relationship information is used to indicate the parameter corresponding relationship between the first transmission channel and the second transmission channel, and the parameter corresponding relationship meets the performance requirements of the call.
4. The method according to claim 3, wherein The corresponding relationship information is a list, and the list includes the corresponding relationship between one or more transmission parameters of the first transmission channel and one or more transmission parameters of the second transmission channel.
5. The method according to any one of claims 1 to 4, characterized in that The transmission parameters of the second transmission channel include frame rate, and the transmission parameters of the first transmission channel include the transmission rate of the face feature data.
6. The method according to any one of claims 1 to 5, characterized in that The transmission parameters of the second transmission channel include the type information of the digital image, and the transmission parameters of the first transmission channel include the number of face feature points corresponding to the face feature data.
7. The method according to any one of claims 1 to 6, characterized in that, The method further includes: Obtaining one or more transmission parameters of the first transmission channel supported by the first terminal device, and the one or more transmission parameters supported by the first terminal device include the new transmission parameters.
8. The method according to claim 7, wherein The method further includes: Selecting the new transmission parameters supported by the network device from the one or more transmission parameters supported by the first terminal device.
9. The method according to any one of claims 1 to 8, characterized in that The first transmission channel is a data channel or a Real-Time Transport Protocol (RTP) channel; and / or, The second transmission channel is an RTP channel.
10. The method according to any one of claims 1 to 9, characterized in that Before instructing the first terminal device to perform the call according to the new transmission parameters, the method further includes: Obtaining that the first terminal device supports the transmission parameters of the first transmission channel indicated by the network device.
11. The method according to any one of claims 1 to 10, characterized in that, The method further includes: Establish a third transmission channel between the network device and the first terminal device, and a fourth transmission channel between the network device and the second terminal device; the third transmission channel and the fourth transmission channel are used for the call, wherein the fourth transmission channel is used to transmit the face feature data of the second user, and the third transmission channel is used to transmit a second video frame, and the second video frame includes a digital avatar corresponding to the face feature data of the second user.
12. A communication method, characterized in that, The method includes: Conduct a call with a second terminal device through a first transmission channel and a second transmission channel; wherein, the first transmission channel is used to transmit the face feature data of a first user to the network device, and the second transmission channel is used for the transmission of a first video frame between the network device and the second terminal device, and the first video frame includes a digital avatar corresponding to the face feature data of the first user; Receive new transmission parameters from the first transmission channel of the network device, and the new transmission parameters correspond to the transmission parameters of the second transmission channel; Conduct the call according to the new transmission parameters.
13. The method according to claim 12, characterized in that, The new transmission parameters are determined according to corresponding relationship information, and the corresponding relationship information is used to indicate the parameter corresponding relationship between the first transmission channel and the second transmission channel, and the parameter corresponding relationship meets the performance requirements of the call.
14. The method according to claim 13, characterized in that, The corresponding relationship information is a list, and the list includes the corresponding relationship between one or more transmission parameters of the first transmission channel and one or more transmission parameters of the second transmission channel.
15. The method according to any one of claims 12 to 14, characterized in that, The transmission parameters of the second transmission channel include a frame rate, and the transmission parameters of the first transmission channel include the transmission rate of the face feature data.
16. The method according to any one of claims 12 to 15, characterized in that, The transmission parameters of the second transmission channel include the type information of the digital avatar, and the transmission parameters of the first transmission channel include the number of face feature points corresponding to the face feature data.
17. The method according to any one of claims 12 to 16, characterized in that, The method further includes: Send one or more transmission parameters of the first transmission channel supported by the first terminal device to the network device, and the new transmission parameters are selected by the network device from the one or more transmission parameters supported by the first terminal device.
18. The method according to any one of claims 12 to 17, characterized in that, The first transmission channel is a data channel or an RTP channel; and / or, The second transmission channel is an RTP channel.
19. The method according to any one of claims 12 to 18, characterized in that Before receiving the new transmission parameters from the first transmission channel of the network device, the method further includes: Send capability information to the network device, and the capability information is used to indicate that the first terminal device supports the network device to indicate the transmission parameters of the first transmission channel.
20. A communication method, characterized in that, The method includes: The network device establishes a first transmission channel between the network device and a first terminal device, and a second transmission channel between the network device and a second terminal device; the first transmission channel and the second transmission channel are used for a call between the first terminal device and the second terminal device, wherein the first transmission channel is used to transmit the face feature data of a first user, and the second transmission channel is used to transmit a first video frame, and the first video frame includes a digital avatar corresponding to the face feature data of the first user; The network device determines new transmission parameters for the first transmission channel, where the new transmission parameters correspond to the transmission parameters of the second transmission channel; The network device instructs the first terminal device to perform the call according to the new transmission parameters; The first terminal device receives the new transmission parameters; The first terminal device performs the call according to the new transmission parameters.
21. A communication device, characterized in that, Comprising a processor, the processor is coupled to a memory, and a computer program is stored in the memory; the processor is configured to call the computer program in the memory, so that the information transfer device executes the method according to any one of claims 1 to 11.
22. A communication device, characterized in that, Comprising a processor, the processor is coupled to a memory, and a computer program is stored in the memory; the processor is configured to call the computer program in the memory, so that the information transfer device executes the method according to any one of claims 12 to 19.
23. A communication system, characterized in that, The information transfer system includes the device according to claim 21 and the device according to claim 22.
24. A computer-readable storage medium, characterized in that, A computer program or instruction is stored in the storage medium, and when the computer program or instruction is executed by a computer, the method according to any one of claims 1 to 11 is implemented, or the method according to any one of claims 12 to 19 is implemented.
25. A computer program product, characterized in that, When a computer reads and executes the computer program or instruction in the computer program product, the computer is caused to execute the method according to any one of claims 1 to 11, or the method according to any one of claims 12 to 19 is implemented.
Citation Information
Patent Citations
Video call data transmission method, system, server and video call device thereof
CN107295286A
Video call method and device, and storage medium
CN116471458A
Scalable avatar messaging
US20140267544A1
Virtual audience using low bitrate avatars and laughter detection
US20220086395A1