Video call method

Abstract

The invention discloses a video call method. The method comprises the following steps: receiving an interaction operation sent by a target terminal; wherein the target terminal comprises a first terminal or a second terminal, and the second terminal is a video call opposite terminal of the first terminal; the interaction operation is received by the target terminal based on a target applet; identifying the interaction operation based on a pre-configured target service, and determining an identification result; according to the identification result, synthesizing a media stream corresponding to the interaction operation; and sending the synthesized content to the target terminal.

Description

Technical Field

[0001] The present application belongs to the field of wireless communication technology, and specifically relates to a video calling method. Background Art

[0002] Video calls usually refer to a communication method based on the Internet that transmits users' voice and video in real time between terminals. In related technologies, in addition to transmitting basic audio and video, there may be business needs to expand existing video calls, such as making video calls more interesting and realizing fun video calls.

[0003] However, in order to expand business needs, some or all network elements of the network need to be redeployed, which makes the expansion of business needs complex and prone to errors. Summary of the invention

[0004] The embodiment of the present application provides a video calling method, which can solve the problem that the expansion of business requirements is complex and prone to errors.

[0005] In the first aspect, an embodiment of the present application provides a video call method, applied to a network side device, the method comprising: receiving an interactive operation sent by a target terminal; wherein the target terminal comprises a first terminal or a second terminal, and the second terminal is the video call counterpart of the first terminal; the interactive operation is received by the target terminal based on a target applet; the interactive operation is identified based on a preconfigured target service to determine an identification result; according to the identification result, the media stream corresponding to the interactive operation is synthesized; and the synthesized content is sent to the target terminal.

[0006] In the second aspect, an embodiment of the present application provides a video call method, applied to a target terminal, the method comprising: receiving an interactive operation based on a target applet; wherein the target applet is embedded with a target service; when the interactive operation is determined to be an available service based on the target service information corresponding to the target service, the interactive operation is sent to a network side device; receiving synthetic content sent by the network side device; wherein the synthetic content is obtained based on the synthesis of the media stream corresponding to the interactive operation by the network side device.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect, or implements the steps of the method described in the second aspect.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented, or the steps of the method described in the second aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instructions to implement the steps of the method described in the first aspect, or to implement the steps of the method described in the second aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, comprising a computer program stored on a non-transitory computer-readable storage medium, wherein the computer program comprises a program or instructions, and when the program or instructions are executed, the steps of the method described in the first aspect are implemented, or the steps of the method described in the second aspect are implemented.

[0011] In an embodiment of the present application, a network-side device receives an interactive operation sent by a target terminal; wherein the target terminal includes a first terminal or a second terminal, and the second terminal is the video call counterpart of the first terminal; the interactive operation is received by the target terminal based on a target applet, and the target applet has a target service embedded therein; the interactive operation is identified based on the target service, and an identification result is determined; according to the identification result, the media stream corresponding to the interactive operation is synthesized; and the synthesized content is sent to the target terminal. During a video call, for the target service that currently needs to be implemented, the network-side device preconfigures the target service, so that the interactive operation can be identified based on the target service, and then the media stream corresponding to the interactive operation is synthesized according to the identification result, to implement a video call based on the target service, while avoiding the redeployment of each network element in the network, and solving the problem of complex and error-prone implementation of service expansion. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 It is a structural diagram of a general networking provided by the prior art;

[0013] Figure 2 It is a structural diagram of a network provided in an embodiment of the present application;

[0014] Figure 3 It is a flowchart of a video calling method provided in an embodiment of the present application;

[0015] Figure 4 It is a flowchart of a method for synchronizing interesting call service information by an application server AS provided in an embodiment of the present application;

[0016] Figure 5 is a flowchart of another video calling method provided in an embodiment of the present application;

[0017] Figure 6 is a flowchart of another video calling method provided in an embodiment of the present application;

[0018] Figure 7 It is a flowchart of a method for a target terminal to download a target applet provided in an embodiment of the present application;

[0019] Figure 8 is a flowchart of another video calling method provided in an embodiment of the present application;

[0020] Fig. 9 is a flowchart of another video calling method provided in an embodiment of the present application;

[0021] Fig.10 is a flowchart of another video calling method provided in an embodiment of the present application;

[0022] Fig.11 is a flowchart of another video calling method provided in an embodiment of the present application;

[0023] Fig.12 is a flowchart of another video calling method provided in an embodiment of the present application;

[0024] Fig.13 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0026] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0027] The following is a detailed description of the fun video call method provided by the embodiment of the present application through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0028] Figure 1 A schematic diagram of a general networking structure provided by the prior art is shown. Figure 2 A schematic diagram of a network structure provided by an embodiment of the present application is shown in FIG. Figure 2 The network includes a first terminal 201, a second terminal 202, a third terminal 203, a first unified media function (UMF) 204, a second UMF 205, a third UMF 206, an application server (AS) 207, a new calling service control platform (NCP), an operation management platform and a media capability platform.

[0029] Among them, compared with Figure 1 The networking shown in the figure, the networking provided by the embodiment of the present application extracts the application servers AS originally belonging to each region into a new unified network element, namely, the application server AS207. Each terminal connects with a single application server AS through each corresponding unified media processing network element UMF to realize video calls for target services, which can solve the problems of difficulty in standardization, expansion and operation and maintenance of multiple application servers. In response to the expanded business needs, the target business is configured for the application server AS207, UMF and the terminal's applet, which can also avoid the redeployment of each network element in the networking, solving the problem of complex and error-prone implementation of business expansion.

[0030] Optionally, the target service may be intelligent translation, fun calls, intelligent customer service, content sharing, remote assistance, etc. In a fun video call, a three-dimensional character model or background is constructed in real time, a digital image of each call user (such as a cartoon avatar, etc.) is created, and emoticons (such as flowers, cakes, bombs, etc.) are sent during the video call, which are displayed on the pages of each terminal of the video call to increase the fun.

[0031] Figure 3 A schematic diagram of a video call method provided in an embodiment of the present application is shown, and the method is applied to a network side device. Figure 3 , the method may include the following steps.

[0032] Step 302: receiving an interactive operation sent by a target terminal.

[0033] Among them, the interactive operation is received by the target terminal based on the target applet and sent to the network side device; the target terminal includes a first terminal or a second terminal, and the second terminal is the video call counterpart of the first terminal.

[0034] The interactive operation may be making a sound or a gesture, that is, the target terminal receives audio, images or videos based on the target applet.

[0035] Step 304: Identify the interactive operation based on the preconfigured target service and determine an identification result.

[0036] The identification of the interaction operation based on the preconfigured target service may include identifying that the interaction operation triggers a corresponding function of the target service, and taking the identified function and how to implement the function as the identification result.

[0037] Step 306, synthesizing the media stream corresponding to the interactive operation according to the recognition result;

[0038] The media stream is a media stream triggered by the interactive operation based on the target service. For example, the target service is a fun video call, and one function of the target service is that a heart pattern can be displayed on the terminal by making a heart shape with fingers, and the media stream corresponding to the interactive operation is a heart pattern.

[0039] Step 308: Send the synthesized content to the target terminal.

[0040] In an embodiment of the present application, during a video call, the network side device pre-configures the target service that currently needs to be implemented, so that after receiving the interactive operation sent by the target terminal, it can identify the interactive operation based on the target service, and then synthesize the media stream corresponding to the interactive operation according to the identification result, thereby realizing a video call based on the target service and avoiding the redeployment of various network elements in the networking, thereby solving the problem of complex and error-prone implementation of service expansion.

[0041] In one implementation, before the above step 304 of identifying the interactive operation based on the preconfigured target service and determining the identification result, the method may further include the following steps.

[0042] Step 3031, obtaining the default service and the subscription service corresponding to the subscription operation from the operation management platform.

[0043] The default service is the default setting of the operation management platform; the subscription operation is received by the target terminal based on the target applet and sent to the operation management platform. The target service includes the default service provided by the operation management platform and the subscription service subscribed by the user.

[0044] Step 3032: Store the first configuration information corresponding to the default service and the second configuration information corresponding to the subscription service.

[0045] In the embodiment of the present application, the target service may include two parts, one is to obtain the default service from the operation management platform, and the other is to obtain the subscription service based on the user's subscription operation. After the network side device obtains the target service, it stores the first configuration information corresponding to the default service and the second configuration information corresponding to the subscription service, so that when the target service is applied, the target service is configured according to the stored first configuration information corresponding to the default service or the second configuration information corresponding to the subscription service, and the first configuration information corresponding to the default service and the second configuration information corresponding to the subscription service are sent to the target terminal and placed in the target applet, so that a video call can be realized based on the target service.

[0046] In one embodiment, taking the target service as a fun call service as an example, the network side device includes an application server AS. Figure 4 A flow chart of a method for synchronizing interesting call service information by an application server AS provided in an embodiment of the present application is shown, see Figure 4 , the method comprises the following steps.

[0047] Step 401: the application server AS sends a subscription request for the fun call service to the target terminal.

[0048] Step 402: In response to the user's subscription operation, the operation management platform synchronizes the subscription fun call service corresponding to the subscription operation to the application server AS.

[0049] Step 403: The application server AS sends a system-level setting synchronization request to the operation management platform.

[0050] Step 404: The operation management platform synchronizes the system-level setting data to the application server AS.

[0051] Through the embodiment of the present application, the application server AS obtains the subscription to the fun call service and the system-level setting data, and then sends the corresponding fun call service information to the target applet of the target terminal through the unified media processing network element UMF. The target applet is embedded with the target service, so that the user can learn about the currently available fun call service through the target applet of the target terminal, thereby triggering the fun video call service.

[0052] The above step 304 identifies the interactive operation based on the preconfigured target service and determines the identification result, which can be performed by the application server AS and the unified media processing network element UMF of the network side device, and includes the following steps.

[0053] Step 3041, the application server AS sends a call control message to the unified media processing network element UMF; wherein the call control message is used to instruct the unified media processing network element UMF to identify the interactive operation based on the target service.

[0054] Among them, the call control message can be an interesting call control message, which can be used to instruct the unified media processing network element UMF to identify the interactive operation based on the interesting call service.

[0055] Step 3042, the unified media processing network element UMF receives the call control message sent by the application server AS, identifies the interactive operation based on the target service, obtains an identification result, and sends the identification result to the application server AS.

[0056] Step 3043: The application server AS receives the identification result of the interaction operation by the unified media processing network element UMF.

[0057] In an embodiment of the present application, the application server AS sends a call control message to the unified media processing network element UMF to instruct the unified media processing network element UMF to identify the interactive operation based on the target service. After the unified media processing network element UMF identifies the interactive operation based on the target service and obtains an identification result, the application server AS receives the identification result sent by the unified media processing network element UMF, thereby identifying the interactive operation based on the pre-configured target service and determining the identification result.

[0058] The above-mentioned step 306 synthesizes the media stream corresponding to the interactive operation according to the recognition result, which can be performed by the application server AS and the unified media processing network element UMF of the network side device, and includes the following steps.

[0059] Step 3061: The application server AS sends a media stream synthesis request to the unified media processing network element UMF based on the identification result.

[0060] Step 3062: The unified media processing network element UMF receives the media stream synthesis request, and synthesizes the media stream corresponding to the interactive operation based on the media stream synthesis request.

[0061] In an embodiment of the present application, the unified media processing network element UMF identifies the interactive operation based on the target service and sends the identification result to the application server AS, so that the application server AS can send a media stream synthesis request to the unified media processing network element UMF based on the identification result. The unified media processing network element UMF synthesizes the media stream corresponding to the interactive operation based on the media stream synthesis request, and then sends the synthesized content to the target terminal, thereby realizing a video call based on the target service.

[0062] In one implementation, before the above step 304 of identifying the interactive operation based on the preconfigured target service and determining the identification result, the method further includes: step 310 of anchoring the media stream corresponding to the interactive operation.

[0063] The anchoring of the media stream corresponding to the interactive operation may be performed by the application server AS and the unified media processing network element UMF of the network side device, and includes the following steps.

[0064] Step 311: The application server AS sends a call control message to the unified media processing network element UMF; wherein the call control message is used to instruct the unified media processing network element UMF to anchor the media stream corresponding to the interactive operation.

[0065] Step 312: The unified media processing network element UMF receives the call control message sent by the application server AS, and anchors the media stream corresponding to the interactive operation based on the call control message.

[0066] In an embodiment of the present application, the application server AS sends a call control message to the unified media processing network element UMF to instruct the unified media processing network element UMF to anchor the media stream corresponding to the interactive operation. The unified media processing network element UMF receives the call control message sent by the application server AS, thereby anchoring the media stream corresponding to the interactive operation, ensuring the integrity of the media stream corresponding to the interactive operation, and enabling the media stream corresponding to the interactive operation to be transmitted stably.

[0067] In one implementation, the above step 306 synthesizes the media stream corresponding to the interactive operation according to the recognition result, which may include the following steps.

[0068] Step 3063: According to the ID corresponding to the media stream in the identification result, determine whether the media stream is stored in the local storage of the target terminal. The media stream is a media stream triggered by the interactive operation based on the target service.

[0069] The media stream corresponding to the interactive operation may have been stored in the local storage of the terminal, for example, the user pre-downloads the media stream corresponding to each interactive operation or the user has performed a certain interactive operation during a historical video call. The media stream corresponding to the interactive operation may also not be stored in the local storage of the terminal, for example, the user has not pre-downloaded the media stream corresponding to each interactive operation and the user has not performed a certain interactive operation during a historical video call. For these two situations, step 3064a or step 3064b is performed respectively.

[0070] Step 3064a, when the media stream is stored in the local storage of the target terminal, the media stream is obtained according to the ID corresponding to the media stream and synthesized;

[0071] Step 3064b: If the media stream is not stored in the local storage of the target terminal, the media stream is downloaded and synthesized according to the ID corresponding to the media stream.

[0072] In the embodiment of the present application, if the user pre-downloads the media streams corresponding to each interactive operation or the user has performed an interactive operation in the historical video call process, that is, the media streams corresponding to the interactive operation have been stored in the local storage of the terminal, then when the user performs or re-performs an interactive operation during the video call, it can be directly obtained and used for synthesis. If the user does not pre-download the media streams corresponding to each interactive operation and the user has not performed an interactive operation in the historical video call process, that is, the media streams corresponding to the interactive operation are not stored in the local storage of the terminal, then when the user performs an interactive operation during the video call, it needs to be downloaded in real time and used for synthesis.

[0073] Figure 5 A flow chart of another video calling method provided by an embodiment of the present application is shown in one implementation manner. The method may also include the following steps.

[0074] Step 510, establishing a data channel with the target terminal;

[0075] Step 512: receiving a mini-program download request sent by the target terminal through the data channel; wherein the mini-program download request carries user attribute information of the user;

[0076] Step 514, generating a candidate mini-program list according to the user attribute information;

[0077] Step 516: Send the candidate mini-program list to the target terminal through the data channel.

[0078] In an embodiment of the present application, when the target terminal initiates a video call, a data channel is established between the network side device and the terminal, and the target terminal sends a mini-program download request to the network side device through the data channel. The mini-program download request carries user attribute information of the user, so that the network side device generates a candidate mini-program list based on the user attribute information and sends it to the target terminal, so that the target terminal downloads the target mini-program from the candidate mini-program list.

[0079] In an implementation manner, the method may further include the following step: sending first configuration information corresponding to the default service and second configuration information corresponding to the subscription service to the target terminal.

[0080] In an embodiment of the present application, after the network side device obtains the default service and the subscription service corresponding to the subscription operation from the operation management platform and stores the first configuration information corresponding to the default service and the second configuration information corresponding to the subscription service, the first configuration information corresponding to the default service and the second configuration information corresponding to the subscription service are forwarded to the target terminal, so that the target terminal places the received first configuration information and the second configuration information into the target applet. When receiving an interactive operation based on the target applet, it can determine whether the interactive operation is an available service based on the target service information, and then perform subsequent video call processing steps.

[0081] Figure 6 FIG. 1 is a flow chart of another video call method provided in an embodiment of the present application, and the method is applied to a target terminal. Figure 6 , the method may include the following steps.

[0082] Step 602: receiving an interactive operation based on a target applet; wherein the target applet has a target business embedded therein.

[0083] In one implementation, the target service includes a default service and a subscription service, so that the method also includes: receiving first configuration information corresponding to the default service and second configuration information corresponding to the subscription service sent by the network side device, so that the default service and subscription service are placed in the target applet based on the received first configuration information and second configuration information to expand the service needs.

[0084] Step 604: When the interactive operation is determined to be an available service according to the target service information corresponding to the target service, the interactive operation is sent to a network side device;

[0085] Among them, the available services include the target services that the user has subscribed to and the default / free services. Optionally, if the user has not subscribed to the target service triggered by the interactive operation, the target applet jumps to the target service activation / billing page, the network side device pushes the activation / billing process to the target terminal, and the target terminal guides the user to complete the activation / billing of the target service.

[0086] Step 606: Receive the synthesized content sent by the network side device.

[0087] The synthesized content is obtained based on the network side device synthesizing the media stream corresponding to the interactive operation.

[0088] In an embodiment of the present application, the target terminal receives an interactive operation based on a target applet, and when the interactive operation is determined to be an available service according to the target business information corresponding to the target service, the interactive operation is sent to a network side device, and the network side device identifies the interactive operation based on the target service, determines an identification result, and then synthesizes the media stream corresponding to the interactive operation based on the identification result, and sends the synthesized content to the target terminal. Optionally, the network side device renders the synthesized content and then sends it to the target terminal, and displays it on the page of the target applet of the target terminal, thereby realizing a video call based on the target service.

[0089] In one implementation, before the above step 602 of receiving the interactive operation based on the target applet, the method further includes the following steps.

[0090] Step 6021, establishing a data channel with the network side device;

[0091] Step 6022: Acquire and download the target applet from the network side device through the data channel.

[0092] In one implementation, step 6022 may include:

[0093] Step 6022a, sending a mini-program download request to the network-side device through the data channel; wherein the mini-program download request carries user attribute information of the user;

[0094] Step 6022b, receiving a candidate mini-program list generated by the network-side device according to the user attribute information;

[0095] Step 6022c, downloading the target mini-program from the candidate mini-program list.

[0096] In an embodiment of the present application, when the target terminal initiates a video call, a data channel is established between the network side device and the target terminal. The target terminal sends a mini-program download request to the network side device through the data channel. The mini-program download request carries the user attribute information of the user. The network side device generates a candidate mini-program list based on the user attribute information and sends it to the target terminal. The target terminal downloads the target mini-program from the candidate mini-program list, thereby completing the download of the target mini-program.

[0097] Figure 7 A flowchart of a method for a target terminal to download a target applet provided in an embodiment of the present application is shown. Figure 7 The method is applied to the terminal, the VoNR+ media plane network element and the VoNR+ capability network element. Taking the target service as the fun video call service as an example, the method may include the following steps.

[0098] Step 701: The target terminal initiates a fun video call and establishes a data channel with the VoNR+ media plane network element and the VoNR+ capability network element.

[0099] Step 702: The target terminal requests the VoNR+ media plane network element to download a boot program through a data channel.

[0100] Step 703: The VoNR+ media plane network element obtains a bootstrap program from the VoNR+ capability network element and sends a response to the target terminal through a data channel.

[0101] Step 704: The target terminal requests the VoNR+ media plane network element to download the list of mini-programs through the data channel. The target terminal sends the request for downloading the list of mini-programs to the VoNR+ media plane network element based on the instruction of the bootstrap program.

[0102] Step 705: The VoNR+ media plane network element requests the VoNR+ capability network element for a list of mini-programs, and the VoNR+ capability network element generates the list of mini-programs in real time according to user attributes.

[0103] Step 706: The VoNR+ capable network element returns the mini-program list to the target terminal through the data channel.

[0104] Step 707a: When the target applet is an applet with an automatic download attribute, the target terminal automatically obtains the download program of the target applet from the VoNR+ media plane network element and downloads it upon receiving the applet list.

[0105] Step 707b, when the target applet is a applet with non-automatic download attributes, upon receiving the applet list, the target terminal responds to the user's trigger operation, obtains the download program of the target applet from the VoNR+ media plane network element, and downloads it.

[0106] The target terminal includes a first terminal or a second terminal, and the second terminal is a video call counterpart of the first terminal. That is, the method for the target terminal to download the target applet can be applied to the first terminal or the second terminal.

[0107] In one embodiment, Figure 8 A schematic diagram showing another video calling method provided by an embodiment of the present application is shown. Figure 8 The method is applied to terminal A, terminal B, VoNR+ media plane network element, VoNR+ capability network element and application server AS, and terminal A and terminal B do not support data channel (Data, Channel, DC). Taking the target service as fun video call service as an example, the application scenario of the method is to set the terminal to enable background replacement by default. The method may include the following steps.

[0108] Step 801-Step 804: Terminal A or Terminal B initiates a call, and the session is connected.

[0109] Step 805: The VoNR+ capable network element reports a session response event to the application server AS, indicating that the session is a video call and that both ends of the session do not support DC.

[0110] The application server AS assumes that the terminal does not support DC based on the fact that the reported session response event does not include information on whether the terminal supports DC.

[0111] Step 806: The application server AS sends a call control message to the VoNR+ media plane network element, wherein the call control message is used to instruct the VoNR+ media plane network element to anchor the media stream.

[0112] Step 807: The VoNR+ media plane network element anchors the media stream.

[0113] Step 808: The media stream received by terminal A flows through the VoNR+ media plane network element and then to terminal B.

[0114] Step 809: The application server AS sends a dual tone multi-frequency (DTMF) detection request to the VoNR+ capable network element.

[0115] Step 810: The VoNR+ media plane network element interacts with the VoNR+ capability network element to complete DTMF detection.

[0116] Step 811: When determining that the system setting of terminal A is to enable background replacement by default, the application server AS sends a background replacement request to the VoNR+ capable network element. The background replacement request carries the media stream ID and the download address of the media stream.

[0117] Step 812: After receiving a successful response from the VoNR+ capable network element, the application server AS starts background replacement of the call record.

[0118] Step 813: The VoNR+ media plane network element interacts with the VoNR+ capability network element to complete the background replacement. When the VoNR+ media plane network element determines that there is no content corresponding to the media stream ID in the local storage of terminal B, it downloads it in real time according to the download address of the media stream. If there is, it can be used directly.

[0119] Step 814: Send the processed media stream of terminal A to terminal B.

[0120] Step 815 (optional), the application server AS determines whether there is a configuration for pushing prompt information to the terminal A or the terminal B. If there is, the push of the prompt information is triggered.

[0121] In one embodiment, Fig. 9 A schematic diagram showing another video calling method provided by an embodiment of the present application is shown. Fig. 9 The method is applied to terminal A, terminal B, VoNR+ media plane network element, VoNR+ capability network element, application server AS and media capability platform, and terminal A and terminal B do not support data channel (Data, Channel, DC). Taking the target service as fun video call service as an example, the application scenario of the method is to set the terminal to enable expression rain / gesture animation by default. The method may include the following steps.

[0122] Step 901 to step 910 are the same as step 801 to step 810 in the above embodiment, and the details can be found in the above description.

[0123] Step 911, when the application server AS determines that the system setting of terminal A is to enable the expression rain / gesture effect by default, it sends a media stream copy request to the VoNR+ media plane network element.

[0124] Step 912: The VoNR+ media plane network element completes the media stream replication and reports the media stream replication result to the application server AS, wherein the media stream replication result carries the media control address URL1.

[0125] Step 913: The application server AS sends a fun call control message to the media capability platform. The fun call control message is used to instruct the media capability platform to enable expression rain recognition / gesture dynamic effect recognition. The fun call control message carries a receiving address URL2 of the recognition result.

[0126] Step 914: After receiving a successful response from the media capability platform, the application server AS starts recording the expression rain / gesture animation call record.

[0127] Step 915 (optional): the application server AS determines whether there is a configuration for pushing prompt information to the terminal A or the terminal B. If there is, the push of the prompt information is triggered.

[0128] Step 916: Terminal A receives the expression / gesture made by the user.

[0129] Step 917: The media capability platform identifies the expression rain / gesture dynamic effect from the copied result, and reports the identification result to the receiving address URL2, where the receiving address is the address of the application server AS.

[0130] Step 918: The application server AS matches the media stream corresponding to the expression rain / gesture effect according to the recognition result.

[0131] Step 919: The application server AS sends a media stream synthesis request to the VoNR+ capable network element, wherein the media stream synthesis request carries information such as the media stream ID and download address corresponding to the matched expression rain / gesture animation.

[0132] Step 920: The VoNR+ capability network element instructs the VoNR+ media plane network element to synthesize the media stream corresponding to the expression rain / gesture effect based on the media stream synthesis request.

[0133] When the VoNR+ media plane network element determines that there is no content corresponding to the media stream ID in the local storage of terminal A or terminal B, it downloads it in real time according to the download address of the media stream. If there is, it can be used directly.

[0134] In one embodiment, Fig.10 A schematic diagram showing another video calling method provided by an embodiment of the present application is shown. Fig.10 The method is applied to terminal A, terminal B, VoNR+ media plane network element, VoNR+ capability network element and application server AS, and terminal A and terminal B do not support DC. Taking the target service as the fun video call service as an example, the application scenario of the method is to set the terminal to enable background replacement by default, and to disable background replacement by detecting DTMF signals during the video call. The method may include the following steps. It should be noted that the steps of this embodiment are Figure 8 The illustrated embodiment is then executed.

[0135] Step 1001: Terminal A receives a key command input by a user, requesting to close background replacement.

[0136] Step 1002: After the VoNR+ media plane network element detects the DTMF command, it reports it to the VoNR+ capability network element.

[0137] Step 1003: The VoNR+ capable network element reports the DTMF command to the application server AS according to the DTMF command configuration file.

[0138] Step 1004: the application server AS determines to close the background replacement according to the DTMF command and stops recording the background replacement call records.

[0139] Step 1005: The application server AS sends a service control message to the VoNR+ capable network element, wherein the service control message is used to notify the VoNR+ capable network element to stop background replacement.

[0140] Step 1006 (optional): the application server AS determines whether there is a configuration for pushing prompt information to the terminal A or the terminal B. If there is, the push of the prompt information is triggered.

[0141] In one embodiment, Fig.11A schematic diagram showing another video calling method provided by an embodiment of the present application is shown. Fig.11 The method is applied to terminal A, terminal B, VoNR+ media plane network element, VoNR+ capability network element, application server AS and media capability platform, and terminal A and terminal B do not support DC. Taking the target service as the fun video call service as an example, the application scenario of the method is to set the terminal to turn on the expression rain / gesture effect by default, and turn off the expression rain / gesture effect by detecting the DTMF signal during the video call. The method may include the following steps. It should be noted that the steps of this embodiment are Fig. 9 The illustrated embodiment is then executed.

[0142] Step 1101: Terminal A receives a key command input by a user, requesting to turn off the expression rain / gesture effect.

[0143] Step 1102: After the VoNR+ media plane network element detects the DTMF command, it reports it to the VoNR+ capability network element.

[0144] Step 1103: The VoNR+ capable network element reports the DTMF command to the application server AS according to the DTMF command configuration file.

[0145] Step 1104, the application server AS determines to turn off the expression rain / gesture effect according to the DTMF command, and stops recording the expression rain / gesture effect call records.

[0146] Step 1105: the application server AS sends a service control message to the VoNR+ capable network element, wherein the service control message is used to notify the VoNR+ capable network element to stop the expression rain / gesture effect, and instruct the VoNR+ capable network element to stop copying the media stream corresponding to the expression rain / gesture effect.

[0147] Step 1106 (optional), the application server AS determines whether there is a configuration for pushing prompt information to the terminal A or the terminal B. If there is, the push of the prompt information is triggered.

[0148] In one embodiment, Fig.12 A schematic diagram showing another video calling method provided by an embodiment of the present application is shown. Fig.12 The method is applied to terminal A, terminal B, VoNR+ media plane network element, VoNR+ capability network element, application server AS and media capability platform, wherein terminal A and terminal B support DC, and terminal A and terminal B can download the fun call applet. Taking the target service as the fun video call service as an example, the application scenario of the method is that the terminal turns on the expression rain / gesture animation based on the DC technology. The method may include the following steps.

[0149] Step 1201, terminal A and terminal B establish a call, and complete the download of the mini program. The specific process of the terminal downloading the mini program can be found in Figure 7 The embodiment shown.

[0150] Step 1202: The fun call applet of terminal A sends a request for obtaining the fun call service subscription information of the current user to the VoNR+ media plane network element through the new call SDK.

[0151] In step 1203, the VoNR+ media plane obtains the interesting call service subscription information from the application server AS, and sends the obtained interesting call service subscription information to the new call software development kit (Software Development Kit, SDK) through the DC, and displays it in the interesting call applet.

[0152] Step 1204, receiving the user's triggering operation on the expression rain / gesture animation function.

[0153] Step 1205: When the fun call applet of terminal A determines that the user has not subscribed to the fun call service of expression rain / gesture dynamic effects, it jumps to the fun call service subscription / billing page, and the application server guides the user to complete the activation / billing process. When the fun call applet of terminal A determines that the user has subscribed to the fun call service of expression rain / gesture dynamic effects, it executes step 1206.

[0154] Step 1206: The fun call applet of terminal A sends a request to enable the expression rain / gesture effect to the VoNR+ media plane network element through the new call SDK.

[0155] Step 1207: The VoNR+ media plane network element reports the request to enable the expression rain / gesture animation to the application server AS.

[0156] Step 1208: The application server AS instructs the VoNR+ media plane network element to initiate media stream anchoring and media stream replication corresponding to the expression rain / gesture animation effect.

[0157] Step 1209: The VoNR+ media plane network element completes the media stream replication and reports the media stream replication result to the application server AS, wherein the media stream replication result carries the media control address URL1.

[0158] Step 1210: the application server AS sends a fun call control message to the media capability platform. The fun call control message is used to instruct the media capability platform to enable expression rain recognition / gesture dynamic effect recognition. The fun call control message carries a receiving address URL2 for the recognition result.

[0159] Step 1211, the application server AS starts recording the expression rain / gesture effect call record after receiving a successful response from the media capability platform.

[0160] Step 1212, terminal A displays a prompt message indicating that the expression rain / gesture animation function is successfully enabled.

[0161] Step 1213: Terminal A receives the expression / gesture made by the user.

[0162] Step 1214: the media capability platform identifies the expression rain / gesture dynamic effect from the copied result, and reports the identification result to the receiving address URL2, where the receiving address is the address of the application server AS.

[0163] Step 1215: the application server AS matches the media stream corresponding to the expression rain / gesture animation according to the recognition result.

[0164] Step 1216: The application server AS sends a media stream synthesis request to the VoNR+ capable network element, wherein the media stream synthesis request carries information such as the media stream ID and download address corresponding to the matched expression rain / gesture animation.

[0165] Step 1217: The VoNR+ capability network element instructs the VoNR+ media plane network element to synthesize the media stream corresponding to the expression rain / gesture effect based on the media stream synthesis request.

[0166] When the VoNR+ media plane network element determines that there is no content corresponding to the media stream ID in the local storage of terminal A or terminal B, it downloads it in real time according to the download address of the media stream. If there is, it can be used directly.

[0167] Step 1218: The VoNR+ capable network element renders the synthesized media stream and sends it to terminal A and terminal B.

[0168] Through the embodiments of the present application, based on a single application server AS and each terminal or unified media processing network element UMF (VoNR+capability network element, VoNR+media plane network element) docking, it is possible to achieve background replacement and recognize the user's expression / gesture to start expression rain / gesture effects during a video call, and it is also possible to determine the subscription status of the fun call service based on the mini-program downloaded in the terminal. If subscribed, the terminal, the unified media processing network element UMF and the application server AS interact to achieve a fun video call.

[0169] The embodiment of the present application also provides an electronic device, which is used to execute the above-mentioned video call method. Fig.13A schematic diagram of the structure of an electronic device for implementing various embodiments of the present application. The electronic device may have relatively large differences due to different configurations or performances, and may include a processor 1301, a communications interface 1302, a memory 1303, and a communication bus 1304, wherein the processor 1301, the communications interface 1302, and the memory 1303 communicate with each other through the communication bus 1304. The processor 1301 can call a computer program stored in the memory 1303 and can be run on the processor 1301 to execute the various steps of the above-mentioned video call method embodiment, and can achieve the same technical effect, so it will not be repeated here to avoid repetition.

[0170] It should be noted that the electronic devices in the embodiments of the present application include: servers, terminals, or other devices except terminals.

[0171] The above electronic device structure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. For example, the input unit may include a graphics processing unit (GPU) and a microphone, and the display unit may be configured with a display panel in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit includes a touch panel and at least one of other input devices. The touch panel is also called a touch screen. Other input devices may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0172] The memory can be used to store software programs and various data. The memory may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory may include a volatile memory or a non-volatile memory, or the memory may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct memory bus random access memory (DRRAM).

[0173] The processor may include one or more processing units; optionally, the processor integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor.

[0174] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned video call method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0175] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0176] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned video call method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0177] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0178] An embodiment of the present application also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes a program or instructions. When the program or instructions are executed, the various processes of the above-mentioned video call method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they will not be repeated here.

[0179] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0180] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0181] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A video calling method, characterized in that: Applied to network-side devices, including: Receiving an interactive operation sent by a target terminal; wherein the target terminal includes a first terminal or a second terminal, and the second terminal is a video call counterpart of the first terminal; the interactive operation is received by the target terminal based on a target applet; Identify the interactive operation based on the preconfigured target service and determine an identification result; synthesizing a media stream corresponding to the interactive operation according to the recognition result; The synthesized content is sent to the target terminal.

2. The method according to claim 1, characterized in that Before identifying the interaction operation based on the preconfigured target service and determining the identification result, the method further includes: Obtaining a default service and a subscription service corresponding to a subscription operation from an operation management platform; wherein the default service is a default setting of the operation management platform; the subscription operation is received by the target terminal based on the target applet and sent to the operation management platform; the target service includes the default service and the subscription service; The first configuration information corresponding to the default service and the second configuration information corresponding to the subscription service are stored.

3. The method according to claim 1, characterized in that The synthesizing the media stream corresponding to the interactive operation according to the recognition result includes: According to the ID corresponding to the media stream in the identification result, determining whether the media stream is stored in the local storage of the target terminal; wherein the media stream is a media stream triggered by the interactive operation based on the target service; In the case where the media stream is stored in the local storage of the target terminal, acquiring the media stream according to the ID corresponding to the media stream and synthesizing the media stream; In the case that the media stream is not stored in the local storage of the target terminal, the media stream is downloaded and synthesized according to the ID corresponding to the media stream.

4. The method according to claim 1, characterized in that: The method further comprises: Establishing a data channel with the target terminal; Receiving a mini-program download request sent by the target terminal through the data channel; wherein the mini-program download request carries user attribute information of the user; Generate a candidate mini-program list according to the user attribute information; The candidate mini-program list is sent to the target terminal through the data channel.

5. The method according to claim 2, characterized in that: The method further comprises: The first configuration information corresponding to the default service and the second configuration information corresponding to the subscription service are sent to the target terminal.

6. The method according to claim 1, characterized in that Before identifying the interaction operation based on the preconfigured target service and determining the identification result, the method further includes: Anchoring the media stream corresponding to the interactive operation.

7. A video calling method, characterized in that: Applied to target terminals, including: Receiving an interactive operation based on a target applet; wherein the target applet has a target business embedded therein; In a case where the interactive operation is determined to be an available service according to the target service information corresponding to the target service, sending the interactive operation to a network side device; Receive the synthesized content sent by the network side device; wherein the synthesized content is obtained based on the network side device synthesizing the media stream corresponding to the interactive operation.

8. The method according to claim 7, characterized in that Before receiving the interactive operation based on the target applet, the method further includes: Establishing a data channel with the network side device; The target applet is obtained and downloaded from the network side device through the data channel.

9. The method according to claim 8, characterized in that The acquiring and downloading the target applet from the network side device through the data channel includes: Sending a mini-program download request to the network-side device through the data channel; wherein the mini-program download request carries user attribute information of the user; Receiving a candidate mini-program list generated by the network-side device according to the user attribute information; The target applet is downloaded from the candidate applet list.

10. The method according to claim 7, characterized in that The target service includes a default service and a subscription service; the method further includes: Receive first configuration information corresponding to the default service and second configuration information corresponding to the subscription service sent by the network side device.

Images