Video call control method, communication device, and storage medium

The video call control method addresses 5G user interaction challenges by integrating an avatar service within the communication network, allowing seamless avatar video calls without additional user learning, thus enhancing user experience and adapting to technological evolution.

JP2025524591AActive Publication Date: 2025-07-30ZTE CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2025500295
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-07-08
Filing Date
2023-07-06
Publication Date
2025-07-30
Estimated Expiration
2043-07-06

AI Technical Summary

Technical Problem

5G user calls lack active guidance and fail to sense user needs, leading to complex system designs, cumbersome operations, and reduced user interest due to the need for learning new system customization functions.

Method used

Implement a video call control method using a voice over new radio platform connected to an avatar service unit, call session control function unit, and base station unit, which processes video calls to replace target objects with avatar images, enabling seamless avatar video data transmission between terminals without requiring users to learn new interfaces.

Benefits of technology

Enables smooth transition of call services across evolving communication technologies, reducing user burden and enhancing user experience by providing adaptive avatar services at conventional call interfaces.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025524591000001_ABST
    Figure 2025524591000001_ABST
Patent Text Reader

Abstract

Embodiments of this application provide a video call control method, a communication device, and a storage medium. The method includes: obtaining a video call connection request of a first terminal sent from a call session control function unit (step S100); sending the video call connection request to an avatar service unit and obtaining an avatar image corresponding to the first terminal sent from the avatar service unit (step S200); performing a replacement process on a target object in the video based on the avatar image to obtain avatar video data (step S300); and sending the avatar video data to a base station unit, and sending the avatar video data to a second terminal by the base station unit (step S400).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application is filed based on a Chinese patent application with the application number 202210800411.3 and the filing date of July 8, 2022, and claims the priority of this Chinese patent application. All the contents of this application are incorporated herein by reference.

[0002] The embodiments of this application relate to the communication field, but are not limited thereto. In particular, they relate to a video call control method, a communication device, and a storage medium.

Background Art

[0003] Currently, 5G users' calls belong to passive response interactions, lacking the ability to guide and sense user needs, with complex system designs, cumbersome operation flows, single prompt methods, which hinder the development of self-service interaction services. During the calls of 5G users, there is a lack of interest in both parties' conversations. Even if a new system customization function for the user call interest is developed, after the successful development of the system customization function, users need to learn and understand the new system customization function so as to master the usage methods of the new product and new function, which causes a psychological burden on users, reduces users' interest in experiencing the new product, and is disadvantageous to the popularization and application of the service.

Summary of the Invention

Problems to be Solved by the Invention

[0004] The following is an overview of the themes described in detail in this specification. This overview is not intended to limit the scope of the claims.

[0005] The main objective of the embodiments of this application is to provide a video call control method, a communication device, and a storage medium.

Means for Solving the Problems

[0006] According to a first aspect, an embodiment of the present application provides a video call control method for use in a voice over new radio platform installed in a communication network. The voice over new radio platform is respectively connected to an avatar service unit, a call session control function unit, and a base station unit in the communication network. The method includes obtaining a video call connection request of a first terminal transmitted from the call session control function unit, transmitting the video call connection request to the avatar service unit, obtaining an avatar image corresponding to the first terminal transmitted from the avatar service unit, performing a replacement process on a target object in the video based on the avatar image to obtain avatar video data, and transmitting the avatar video data to the base station unit, and transmitting the avatar video data to a second terminal by the base station unit.

[0007] According to a second aspect, there is provided a video call control method for a first terminal connected to a communication network. The communication network includes a Voice over New Radio platform, an avatar service unit connected to the Voice over New Radio platform, a call session control function unit, and a base station unit. Here, the method includes: sending a video call connection request characterizing a video call with a second terminal to the base station unit, and sequentially sending the video call connection request to the avatar service unit via the base station unit, the call session control function unit, and the Voice over New Radio platform, so that the Voice over New Radio platform obtains an avatar image corresponding to the first terminal via the avatar service unit, performing a replacement process on a target object in the video based on the avatar image to obtain avatar video data, sending the avatar video data to the second terminal via the base station unit by the Voice over New Radio platform, and obtaining the avatar video data sent from the first base station unit.

[0008] According to a third aspect, an embodiment of the present application provides a communication device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the video call control method described in the first aspect is realized, or when the computer program is executed, the video call control method described in the second aspect is realized.

[0009] According to a fourth aspect, there is provided a computer-readable storage medium storing computer-executable instructions, and the computer-executable instructions are used to execute the video call control method described in the first aspect or the video call control method described in the second aspect.

[0010] Other features and advantages of the present application will be described in the following specification, and will become apparent in part from the specification or will be understood by practicing the present application. The objectives and other advantages of the present application can be realized and obtained by the structure particularly shown in the specification, the claims and the drawings.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Embodiments for Carrying Out the Invention

[0012] To make the purpose, technical solution and advantages of the present application clearer, the present application will be described in more detail below with reference to the drawings and embodiments. The embodiments described herein are only used for interpreting the present application and are not intended to limit the present application.

[0013] In the device schematic diagram, functional modules are divided, and in the flowchart, the logical order is shown. However, in some cases, different module divisions from the device may be used, or the steps shown or described may be executed in an order different from the flowchart. Terms such as "first", "second", etc. in the specification, claims or the above drawings are for distinguishing similar objects and are not necessarily for describing a specific order or sequence.

[0014] Embodiments of the present application provide a video call control method, a communication device, and a storage medium. The video call control method includes: obtaining a video call connection request of a first terminal sent from a call session control function unit; sending the video call connection request to an avatar service unit, and obtaining an avatar image corresponding to the first terminal sent from the avatar service unit; performing a replacement process on a target object in the video based on the avatar image to obtain avatar video data; and sending the avatar video data to a base station unit, and sending the avatar video data to a second terminal by the base station unit. In the technical solution of this embodiment, a voice over new radio platform and an avatar service unit are added on a conventional communication network, and an avatar video call service can be realized at a conventional call interface on the terminal, without the need for the user to learn again when using it. This implementation solution can adapt to the subsequent evolution route of communication technology, achieve a smooth transition of the call service, and effectively reduce the impact on the network and terminal users.

[0015] Hereinafter, embodiments of the present application will be further described with reference to the drawings.

[0016] As shown in FIG. 1, FIG. 1 is a schematic diagram of an overall networking architecture for executing a video call control method according to an embodiment of the present application.

[0017] In the embodiment of FIG. 1, the entire networking architecture for executing the video call control method includes a VONR+ platform, an avatar service unit, a developer platform, a network management system, a Voice over Long-Term Evolution Application Server (VOLTE AS+) module, a target voice solution (Voice over New Radio, VoNR+) media plane of a 5G network, an Artificial Intelligence (AI) media component, a Call Session Control Function (CSCF) unit, and a Telephone Number Mapping working group / Domain Name System (ENUM / DNS) unit. The VONR+ platform is respectively connected to the avatar service unit, the developer platform, the network management system, the VoNR+ media plane, the VOLTE AS+ module, and the ENUM / DNS unit. The VoNR+ media plane is respectively connected to the AI media component and the VOLTE AS+ module. The call session control function unit is respectively connected to the VOLTE AS+ module and the ENUM / DNS unit.

[0018] Here, the voice-over new radio platform includes an application management unit, a terminal application support unit, an embedded conflict processing unit, a service framework module, a secondary development module, a general service management mini-application, a maintenance management unit, and a communication service module. The service framework module includes a service scheduling unit, a service registration unit, a service monitoring unit, and an arrangement combination unit. The secondary development module includes an integrated development unit, an automatic test unit, a mini-program management unit, and an automatic deployment unit. The communication service module includes an audio-video unit, a data transmission DC channel, and an artificial intelligence AI unit.

[0019] In one embodiment, the avatar service unit receives user call events reported from the VoLTE AS+ platform and is used to activate the avatar service. The audio-video unit in the communication service module of the VoNR+ platform controls the VoNR+ media plane to complete media negotiation, media anchoring, and media stream replication operations for the terminal user. The VoNR+ platform controls the AI media component to complete encoding, decoding, translation, and transcription operations on the terminal user media stream, and identifies moving images for the user's video stream, replaces them with the preset avatar icon, and finally completes all the flows of the avatar service.

[0020] The avatar service unit simultaneously supports two types of terminals based on video call technology and IMS DC technology, and provides avatar service for the two types of terminals simultaneously based on the user terminal information reported from the VoNR+ platform.

[0021] The main module functions of the VoNR+ platform are as follows. The service framework module provides the basic component units of the microservice architecture. The communication service module adapts to the interface with the external capability system, has the processing logic of the service module within the real-time communication platform, provides the API interface for microservice calls, and is used for the access and call of other services. The secondary development module is used to provide the integrated development, automatic testing, and automatic deployment modules of new call service applications for developers.

[0022] As shown in FIG. 2, FIG. 2 is a schematic diagram of a network composed of network elements for executing a video call control method according to an embodiment of the present application. The network in FIG. 2 includes a VoLTE AS network element, a first Inquiry / Service Call Session Control Function (I / S-CSCF) network element, a VoLTE Session Border Controller (SBC) network element, a High / Low Diameter Routing Agent (H / LDRA) network element, an IP Multimedia Subsystem-Home Subscriber Server (IMS HSS) network element, a Voice over New Radio platform, an avatar service unit, a second I / S-CSCF network element, a 5GNC SBC network element, a VoLTE UE, and a DC UE. Here, the VoLTE AS network element, the first I / S-CSCF network element, the VoLTE SBC network element, the H / LDRA network element, and the IMS HSS network element are network elements in a conventional VoLTE network. The VoLTE AS network element, the I / S-CSCF network element, and the VoLTE SBC network element are connected in sequence via an information interaction channel. The H / LDRA network element and the IMS HSS network element are connected via an information interaction channel. The VoLTE SBC network element and the VoLTE UE are connected via an information interaction channel.The voice-over new radio platform, the avatar service unit, the second I / S-CSCF network element, and the 5G NC SBC network element are a network structure obtained by modifying the present application based on the conventional VoLTE network to realize the avatar service. The VONR+ platform includes a call capability module, a service platform module, and a media module. The call capability module establishes information interaction channels with the first I / S-CSCF network element, the H / LDRA network element, the second I / S-CSCF network element, the service platform module, and the media module respectively. The second I / S-CSCF network element and the H / LDRA network element are connected via an information interaction channel. The avatar service unit, the service platform module, the media module, the 5G NC SBC network element, and the DC UE are connected in sequence via a data transmission channel. VoLTE UE refers to a terminal that does not support a data channel, and DC UE refers to a terminal that supports a data channel. The VoLTE UE and the DC UE may have other functions, and the present embodiment does not limit them thereto.

[0023] The network in FIG. 2 is modified based on the networking architecture of the network in FIG. 1, mainly by modifying the communication service side and the terminal side. The content of the modification includes, but is not limited to, the content described below.

[0024] 1) Modify the VoNR+ media plane and the AI media component in FIG. 1 to obtain a media module. The media module supports translation and transcription, background blur, background replacement, icon replacement, and the ability to identify moving images.

[0025] 2) Modify the VOLTE AS+ module in FIG. 1, add the call capability of the VOLTE AS+ module to obtain a call capability module, and the call capability module supports media negotiation, media anchor, and media replication capabilities.

[0026] 3) Modify the audio / video unit in the communication service module in FIG. 1 to enable the audio / video unit to support the access capability of the avatar service AS.

[0027] 4) Modify the conventional terminal to add a data protocol stack and a webview component.

[0028] 5) Modify the VoLTE SBC network element to add the data transmission Data Channel channel capability.

[0029] Based on the network composed of the VoLTE SBC network element for executing the video call control method in FIG. 1 above, and the network element for executing the video call control method in FIG. 2, the following proposes each embodiment of the video call control method of the present application for solving the problems in the above embodiments.

[0030] As shown in FIG. 3, FIG. 3 is a flowchart of a video call control method according to an embodiment of the present application. The video call control method of the embodiment of the present application is used in a voice over new radio platform and may include, but is not limited to, step S100, step S200, and step S300.

[0031] Step S100: Obtain the video call connection request and participant information of the first terminal sent from the call session control function unit.

[0032] In some embodiments, when the first terminal needs to perform Voice over New Radio (VoNR) communication with the second terminal, it sends a video call connection request to the base station unit. In this case, the base station unit forwards this video call connection request to the call session control function unit. The call session control function unit queries the subscriber information from the home subscriber user server based on this video call connection request, generates a video call connection request based on the video call connection request, and then the call session control function unit sends the video call connection request and subscriber information of the first terminal to the Voice over New Radio platform. At this time, the Voice over New Radio platform receives the video call connection request and subscriber information.

[0033] The first terminal may be the calling terminal or the called terminal, and it is not specifically limited in this embodiment. When the first terminal is the calling terminal, the second terminal is the called terminal, or when the first terminal is the called terminal, the second terminal is the calling terminal.

[0034] Step S200: Send the video call connection request to the avatar service unit and obtain the avatar image corresponding to the first terminal sent from the avatar service unit.

[0035] In some embodiments, the Voice over New Radio platform sends the video call connection request to the avatar service unit. The avatar service unit searches in the pre-set correspondence table between the avatar image and the terminal based on the video call connection request to obtain the avatar image corresponding to the first terminal, and sends the avatar image corresponding to the first terminal to the Voice over New Radio platform. At this time, the Voice over New Radio platform receives the avatar image corresponding to the first terminal sent from the avatar service unit.

[0036] Step S300: Perform replacement processing on the target object in the video based on the avatar image to obtain the avatar video data.

[0037] In some embodiments, upon receiving an avatar image, a replacement process is performed on a target object in a video generated in a video call between a first terminal and a second terminal, and the target object in the video is replaced with the avatar image to obtain avatar video data including the avatar image.

[0038] Step S400: Transmit the avatar video data to a base station unit based on the subscriber information, and the base station unit transmits the avatar video data to the second terminal.

[0039] In some embodiments, the voice over new radio platform determines a base station unit connected to the second terminal based on the subscriber information, transmits the avatar video data to the base station unit, and the base station unit transmits the avatar video data to the second terminal, so that the avatar image of the first terminal can be displayed in the video of the video call between the second terminal and the first terminal, and the avatar video call service can be realized on the call interface on the second terminal, without the need for the user to learn again when using it. This implementation solution can adapt to the subsequent evolution route of communication technology, achieve a smooth transition of the call service, and effectively reduce the impact on the network and terminal users.

[0040] In one embodiment, obtain a video call connection request of a first terminal sent from a call session control function unit, send the video call connection request to an avatar service unit, obtain an avatar image corresponding to the first terminal sent from the avatar service unit, perform a replacement process on a target object in the video based on the avatar image to obtain avatar video data, send the avatar video data to a base station unit, and the base station unit sends the avatar video data to a second terminal. In the technical solution of this embodiment, a voice over new radio platform and an avatar service unit are added on a conventional communication network, and an avatar video call service can be realized at a conventional call interface on the terminal, without the need for the user to learn again when using it. This implementation solution is adaptable to the subsequent evolution route of communication technology, can achieve a smooth transition of the call service, and effectively reduce the impact on the network and terminal users.

[0041] In one embodiment, referring to FIG. 4, the calling terminal starts a video call connection request to the first base station unit. The first base station unit transfers this video call connection request to the call session control function unit. The service call session control function unit queries the home subscriber user server for subscriber information based on this video call connection request, generates a video call connection request based on the video call connection request, and then the call session control function unit sends the video call connection request and subscriber information of the first terminal to the Voice over New Radio platform. The Voice over New Radio platform sends the video call connection request to the avatar service unit. The avatar service unit searches in the pre-set correspondence table between the avatar image and the terminal based on the video call connection request to obtain the avatar image corresponding to the first terminal, and sends the avatar image corresponding to the first terminal to the Voice over New Radio platform. The Voice over New Radio platform performs a replacement process on the target object in the video generated in the video call between the first terminal and the second terminal, replaces the target object in the video with the avatar image to obtain avatar video data including the avatar image. The Voice over New Radio platform forwards the video call connection request to the service call session control function unit. The service call session control function unit routes the call to the called home session control function unit. The called home session control function unit transfers the video call connection request to the second base station unit on the called side, addresses the called user using a standard VoLTE call. The second base station unit on the called side transfers the video call connection request to the second terminal that is the called party. When the second terminal rings and goes off-hook, the Voice over New Radio platform and the calling and called terminals complete the media negotiation of the video call and send the avatar video data to the first terminal and the second terminal. The first terminal that is the calling party starts a voice call and activates the simultaneous interpretation function, copies the media stream to the automatic voice recognition technology for voice recognition, obtains the text after voice recognition, overlays the text on the avatar video data and plays it back to the user.

[0042] An avatar service is set for the first terminal, and it is not necessary to set an avatar service for the second terminal. In this case, avatar video data is generated only for the video stream of the first terminal. Alternatively, an avatar service may be set for both the first terminal and the second terminal. In this case, it is necessary to generate avatar video data for the video streams of the first terminal and the second terminal. Alternatively, an avatar service is set for the second terminal, and it is not necessary to set an avatar service for the first terminal. In this case, avatar video data is generated for the video stream of the second terminal. This embodiment is not specifically limited thereto.

[0043] In addition to being used in a video call scenario between two users, the video call control method of this embodiment may also be used in a video call scenario between three or more users. This embodiment is not specifically limited thereto.

[0044] As shown in FIG. 5, FIG. 5 is a flowchart of a video call control method according to another embodiment of the present application. Step S300 includes, but is not limited to, steps S510 and S520.

[0045] Step S510: Obtain video setting requirement information of the first terminal by the avatar service unit.

[0046] Step S520: Based on the video setting requirement information, perform a replacement process on the target object in the video based on the avatar image to obtain avatar video data.

[0047] In some embodiments, before making a video call, the first terminal needs to set avatar service-related information in the avatar service unit. The information that needs to be set includes at least one of the following: the avatar image that needs to be uploaded / selected, the object to be replaced by the avatar image, setting whether the background of the video needs to be blurred, setting whether the avatar service is in a static mode or a dynamic mode, etc. When the avatar service unit receives the setting information of the first terminal, it generates video setting requirement information corresponding to the first terminal. In this case, when the first terminal initiates a video call connection request, the Voice over New Radio platform obtains the video setting requirement information of the first terminal from the avatar service unit, and based on the video setting requirement information, performs a replacement process on the target object in the video based on the avatar image to obtain avatar video data.

[0048] In one embodiment, the Voice over New Radio platform may determine the target object in the video that needs to be replaced based on the video setting requirement information. The target object is the background and / or icon in the video. Based on the avatar image, a replacement process is performed on the target object to obtain avatar video data. That is, the Voice over New Radio platform may partially or completely replace the screen in the video based on the video setting requirement information corresponding to the first terminal. This embodiment is not specifically limited thereto.

[0049] As shown in FIG. 6, FIG. 6 is a flowchart of a video call control method according to another embodiment of the present application. The Voice over New Radio platform includes a service module, a call capability module, and a media module. The video call control method includes, but is not limited to, step S610, step S620, step S630, and step S640.

[0050] Step S610: The call capability module receives a video call connection request of the first terminal from the call session control function unit, and sends the video call connection request to the avatar service unit by the service module.

[0051] Step S620: The service module sends the avatar image corresponding to the first terminal obtained from the avatar service unit to the media module.

[0052] Step S630: The media module performs replacement processing on the target object in the video with the avatar image to obtain avatar video data, and sends the avatar video data to the second terminal by the base station unit.

[0053] In one embodiment, referring to FIG. 7, a first terminal that is making a call starts a video call connection request for a second terminal, receives a response from the second terminal, and the call capability module obtains the video call connection request of the first terminal by the call session control function unit, and sends the video call connection request to the avatar service unit by the service module. Then, the call capability module anchors the audio and video stream to the VoNR+ media plane of the media module based on the avatar service unit / service module (VoNR+ platform) instruction. After the anchoring is completed, the call capability module returns the audio and video media resource URL of the VoNR+ media plane of the media module. Since the first terminal has already set a background or a virtual icon before the call, the avatar service unit determines the video setting requirement information, and instructs the service module (VoNR+ platform) to start a background replacement or a virtual icon replacement to carry the background or virtual icon ID. The service module (VoNR+ platform) notifies the VoNR+ media plane of the media module to start a background replacement or a virtual icon replacement to carry the background or virtual icon ID, and the VoNR+ media plane of the media module replaces the video background or the icon with the specified background or virtual icon.

[0054] In one embodiment, after the replacement is completed, the first terminal may further blur the background by DTMF settings. The VoNR+ media plane of the media module reports the detected DTMF result to the service module (VoNR+ platform). The service module (VoNR+ platform) reports the DTMF result to the avatar service unit. The avatar service unit instructs the VoNR+ platform / VoNR+ media plane to execute the setting result prompt flow. The avatar service unit instructs the service module (VoNR+ platform) to perform background blurring processing, or the service module (VoNR+ platform) instructs the VoNR+ media plane to perform background blurring processing on the local video stream to make the user's avatar icon more prominent.

[0055] As shown in FIG. 8, FIG. 8 is a flowchart of a video call control method according to another embodiment of the present application.

[0056] The video call control method of the embodiment of the present application is used in a first terminal and may include, but is not limited to, step S810 and step S820.

[0057] Step S810: Send a video call connection request characterizing a video call with a second terminal to a base station unit, and sequentially send the video call connection request to an avatar service unit via the base station unit, a call session control function unit, and a voice over new radio platform, so that the voice over new radio platform obtains an avatar image corresponding to the first terminal via the avatar service unit, performs replacement processing on a target object in the video based on the avatar image to obtain avatar video data, and the voice over new radio platform sends the avatar video data to the second terminal via the base station unit.

[0058] Step S820: Obtain video data corresponding to the second terminal transmitted from the base station unit.

[0059] In some embodiments, the calling terminal initiates a video call connection request to the first base station unit. The first base station unit transfers this video call connection request to the call session control function unit. The service call session control function unit queries the home subscriber user server for subscriber information based on this video call connection request, generates a video call connection request based on the video call connection request, and then the call session control function unit transmits the video call connection request and subscriber information of the first terminal to the Voice over New Radio platform. The Voice over New Radio platform transmits the video call connection request to the avatar service unit. The avatar service unit searches in the pre-set correspondence table between the avatar image and the terminal based on the video call connection request to obtain the avatar image corresponding to the first terminal, and transmits the avatar image corresponding to the first terminal to the Voice over New Radio platform. The Voice over New Radio platform performs a replacement process on the target object in the video generated in the video call between the first terminal and the second terminal, replaces the target object in the video with the avatar image, and obtains avatar video data including the avatar image. The Voice over New Radio platform sends the video call connection request to the service call session control function unit. The service call session control function unit routes the call to the called home session control function unit. The called home session control function unit transfers the video call connection request to the second base station unit on the called side, addresses the called user using a standard VoLTE call. The second base station unit on the called side transfers the video call connection request to the second terminal that is the called party. When the second terminal rings and goes off-hook, the Voice over New Radio platform and the calling and called terminals complete the media negotiation of the video call, and the base station units corresponding to the first terminal and the second terminal transmit the avatar video data to the first terminal and the second terminal.

[0060] Before step S810, the first terminal needs to set avatar service-related information in the avatar service unit. For example, it sends the avatar picture and the number information of the first terminal to the avatar service unit. Also, for example, it sends the avatar picture, the number information of the first terminal, and the video setting requirement information to the avatar service unit. Here, the video setting requirement information includes one of the following: replacing the icon in the video with the avatar picture, replacing the background in the video with the avatar picture, replacing the icon in the video with the avatar picture and performing a blurring process on the background in the video, and replacing the icon in the video with the avatar picture and performing an animation effect process on the replaced avatar icon.

[0061] In one embodiment, referring to FIG. 9, the video setting requirement information is to replace the icon in the video with the avatar picture to realize a static avatar service. First, the first terminal adopts a method of opening the 5G new call mini-program tray to trigger the avatar mini-program and enter the home page of the avatar mini-program, where the effects of the avatar and voice announcement are added to the home page. When the first terminal clicks on the service content link to jump to the avatar picture selection page, it selects the avatar picture to fill the video stream, completes the function of the avatar, and may add a voice announcement effect.

[0062] In one embodiment, referring to FIG. 10, the video setting requirement information is to replace the icon in the video with an avatar picture and perform animation effect processing on the replaced avatar icon, so that a dynamic avatar service can be realized. First, a third-party call cloud flow may be introduced. The user can dial the third-party call cloud by the first terminal, thereby triggering the avatar service, starting a video call. The third-party call cloud and the voice over new radio platform complete the creation of the audio / video / DC channel, lower the cloud H5 page during the call. This page inherits the static avatar function, and at the same time, continuously adds a dynamic avatar service to the H5 page, and introduces background replacement and animation effect identification media capabilities. When the first terminal receives the H5 page, it interacts with the avatar service unit. The avatar service unit encodes and decodes the user's video stream based on the virtual character icon selected by the user, identifies the position of the user's face on the screen, zooms the virtual character icon to the same size, and replaces the user's face by adopting an image replacement method. Then, the virtual character image realizes the dynamic avatar service by identifying the moving direction and width of the user icon and performing matching and following.

[0063] In one embodiment, the avatar service can interoperate on different terminals. When the second terminal is a terminal that supports a data channel, the voice over new radio platform transmits the avatar video data to the second terminal through the data transmission channel by the base station unit. Or, when the second terminal is a terminal that does not support a data channel, the voice over new radio platform performs conversion processing on the format of the avatar video data by the base station unit, and transmits the avatar video data after format conversion processing to the second terminal through the video transmission channel.

[0064] In one embodiment, referring to FIG. 11, in a scenario where an avatar service call is realized between a DC terminal and a non-DC terminal (VoLTE terminal), a DC channel is established between the DC terminal and the network, and a real-time video stream transmission channel (RTP over UDP) is established between the non-DC terminal (VoLTE terminal) and the network. The network associates these two transmission channels and realizes the transmission of interaction data between the DC terminal and the non-DC terminal (VoLTE terminal) by format-converting the data in one channel and then transmitting it in another channel.

[0065] In addition, one embodiment of the present application provides a communication device, which includes a processor and a memory. Here, the processor and the memory can be connected by a bus or other means. This embodiment takes the connection by a bus as an example.

[0066] The memory may be used as a non-transitory computer-readable storage medium for storing non-transitory software programs and non-transitory computer-executable programs. Note that the memory may include high-speed random access memory, and may further include non-transitory memory, for example, at least one magnetic disk memory device, a flash memory device, or other non-transitory solid-state memory devices. In some embodiments, the memory may include memory installed remotely from the processor, and these remote memories may be connected to this communication device via a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0067] This communication device may be used in a 5G communication network system and subsequent evolved mobile communication network systems, etc. This embodiment is not specifically limited thereto.

[0068] The communication device of this embodiment does not constitute a limitation to the embodiments of this application, and may include more or fewer members than the number of members shown in the figure, or some combination of members, or different arrangements of members.

[0069] The non-temporary software programs and instructions necessary for implementing the video call control method of the above embodiment are stored in a memory and, when executed by a processor, execute the video call control method of the above embodiment. For example, it executes steps S100 to S400 of the method in FIG. 3, steps S510 to S520 of the method in FIG. 5, steps S610 to S630 of the method in FIG. 6, and steps S810 to S820 of the method in FIG. 8 described above.

[0070] In addition, one embodiment of this application further provides a computer-readable storage medium, in which computer-executable instructions are stored. The computer-executable instructions are used to execute the video call control method of the above embodiment. For example, they are used to execute steps S100 to S400 of the method in FIG. 3, steps S510 to S520 of the method in FIG. 5, steps S610 to S630 of the method in FIG. 6, and steps S810 to S820 of the method in FIG. 8 described above.

[0071] The embodiments of the present application include obtaining a video call connection request of a first terminal sent from a call session control function unit, sending the video call connection request to an avatar service unit, obtaining an avatar image corresponding to the first terminal sent from the avatar service unit, performing a replacement process on a target object in the video based on the avatar image to obtain avatar video data, sending the avatar video data to a base station unit, and sending the avatar video data to a second terminal by the base station unit. In the technical solution of this embodiment, a voice over new radio platform and an avatar service unit are added on a conventional communication network, and an avatar video call service can be realized at a conventional call interface on the terminal, without the need for the user to learn again when using it. This implementation solution can adapt to the subsequent evolution route of communication technology, achieve a smooth transition of the call service, and effectively reduce the impact on the network and terminal users.

[0072] All or part of the steps in the method disclosed above, the system may be implemented as software, firmware, hardware, and appropriate combinations thereof. Some physical components or all components may be implemented as software executed by a processor such as a central processing unit, a digital signal processing device, or a microprocessor, or as hardware, or as an integrated circuit such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium). As is well known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is computer-accessible, but is not limited thereto. It should be noted that, as is well known to those skilled in the art, communication media generally includes computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information transmission medium.

[0073] The above has described some implementations of the present application. However, the present application is not limited to the above embodiments. Those skilled in the art may make various equivalent modifications or replacements under the condition of not violating the scope of the present application, and these equivalent modifications or replacements are all included within the scope defined by the claims of the present application.

Claims

1. A video call control method used for a voice over new radio platform installed in a communication network, wherein the voice over new radio platform is respectively connected to an avatar service unit, a call session control function unit, and a base station unit in the communication network, The method includes: Obtaining a video call connection request of a first terminal sent from the call session control function unit; Sending the video call connection request to the avatar service unit and obtaining an avatar image corresponding to the first terminal sent from the avatar service unit; Performing a replacement process on a target object in the video based on the avatar image to obtain avatar video data; Sending the avatar video data to the base station unit, and transmitting the avatar video data to a second terminal by the base station unit. Video call control method.

2. The step of performing a replacement process on a target object in the video based on the avatar image to obtain avatar video data includes: Obtaining video setting requirement information of the first terminal by the avatar service unit; Performing a replacement process on a target object in the video with the avatar image based on the video setting requirement information to obtain avatar video data. The video call control method according to Claim 1.

3. The step of performing a replacement process on a target object in the video with the avatar image based on the video setting requirement information to obtain avatar video data includes: Determining a target object that needs to be replaced in the video based on the video setting requirement information, where the target object is a background and / or an icon in the video; Performing a replacement process on the target object based on the avatar image to obtain avatar video data. The video call control method according to Claim 2.

4. The step of performing a replacement process on a target object in the video with the avatar image based on the video setting requirement information to obtain avatar video data includes: Performing a replacement process on the icons in the video with the avatar image based on the video setting requirement information, and performing a blurring process on the background in the video to obtain avatar video data, The video call control method according to claim 2.

5. The voice over new radio platform includes a service module, a call capability module, and a media module. The method includes: The call capability module receives a video call connection request of a first terminal by the call session control function unit, and transmits the video call connection request to the avatar service unit by the service module. The service module transmits the avatar image corresponding to the first terminal obtained from the avatar service unit to the media module. The media module performs a replacement process on the target object in the video with the avatar image to obtain avatar video data, and transmits the avatar video data to a second terminal by the base station unit. The video call control method according to claim 1.

6. The step of transmitting the avatar video data to the base station unit and transmitting the avatar video data to a second terminal by the base station unit is: When the second terminal is a terminal that supports a data channel, transmitting the avatar video data to the base station unit, and transmitting the avatar video data to the second terminal via a data transmission channel by the base station unit. Or, when the second terminal is a terminal that does not support a data channel, transmitting the avatar video data to the base station unit, performing a conversion process on the format of the avatar video data by the base station unit, and transmitting the avatar video data after the format conversion process to the second terminal via a video transmission channel. The video call control method according to claim 1.

7. A video call control method used for a first terminal connected to a communication network, where the communication network includes a Voice over New Radio platform, an avatar service unit connected to the Voice over New Radio platform, a call session control function unit, and a base station unit. The method includes: Sending a video call connection request characterizing a video call with a second terminal to the base station unit, and sequentially sending the video call connection request to the avatar service unit via the base station unit, the call session control function unit, and the Voice over New Radio platform, so that the Voice over New Radio platform obtains an avatar image corresponding to the first terminal via the avatar service unit, and performs replacement processing on a target object in the video based on the avatar image to obtain avatar video data, and then the Voice over New Radio platform sends the avatar video data to the second terminal via the base station unit; Obtaining video data corresponding to the second terminal sent from the base station unit. A video call control method.

8. Before sending the video call connection request characterizing a video call with a second terminal to the base station unit as described above, The method further includes: Sending an avatar picture and number information of the first terminal to the avatar service unit. The video call control method according to claim 7.

9. Sending the avatar picture and number information of the first terminal to the avatar service unit as described above includes: Sending an avatar picture, number information of the first terminal, and video setting requirement information to the avatar service unit. The video call control method according to claim 8.

10. The video setting requirement information includes: Replacing an icon in the video with the avatar picture; Replacing a background in the video with the avatar picture; Replacing an icon in the video with the avatar picture and performing a blurring process on the background in the video. Replacing the icon in the video with an avatar picture and performing an animation effect process on the replaced avatar icon, including one of them. The video call control method according to claim 9.

11. When the voice over new radio platform transmits the avatar video data to the second terminal by the base station unit, When the second terminal is a terminal that supports a data channel, the voice over new radio platform transmits the avatar video data to the second terminal via a data transmission channel by the base station unit. Or, when the second terminal is a terminal that does not support a data channel, the voice over new radio platform performs a conversion process on the format of the avatar video data, and transmits the avatar video data after the format conversion process to the second terminal via a video transmission channel. The video call control method according to claim 7.

12. A communication device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, it realizes the video call control method according to any one of claims 1 to 6, or realizes the video call control method according to any one of claims 7 to 11. Communication device.

13. A computer-readable storage medium, storing computer-executable instructions, and the computer-executable instructions are used to execute the video call control method according to any one of claims 1 to 6, or execute the video call control method according to any one of claims 7 to 11. Computer-readable storage medium.

Citation Information

Patent Citations

  • AR-based instant audio and video communication method and device

    CN106803921A

  • Image converter, image conversion method, and image conversion program

    JP2007213364A

  • Controller, mobile communication system, and communication terminal

    JP2008270913A

  • Modification of video streams with supplemental content for video conferencing - Patent Application 20070122999

    JP2021524187A

  • System and method for video call with game character in virtual world

    KR100836882B1