Method for reversely providing 5G new call enhancement function

Abstract

The invention discloses a method for reversely providing a 5G new call enhancement function, which comprises the following steps: taking a 5G new call mobile phone and a local side 5G new call enhancement function module as senders, and taking a common mobile phone as a receiver; the sender establishes a video call with the receiver, the sender performs a 5G new call, and the receiver performs a traditional video call; and the sender provides the video processing capability of the 5G new call for the receiver and pays for the receiver, but the sender does not use the processed video, and the receiver receives the processed video by using the traditional video call. According to the method, the capability of reversely controlling the 5G new call enhancement function is provided for the actual user scene, the method can be triggered by the initiator, video processing is performed at the initiator, the final video is sent to the opposite side, and payment is paid for the opposite side, so that the method is more in line with the actual user scene, is particularly friendly to the operation of the old, and is beneficial to popularization of the 5G new call enhancement function.

Description

Technical Field

[0001] The present invention belongs to the technical field of 5G new calls, and in particular relates to a method for reversely providing 5G new call enhanced functions. Background Art

[0002] At the media level, 5G new calls allow the current audio and video streams to be copied to the real-time stream processor for processing and synthesis, thus realizing the modification of audio and video content. Its typical application is that the elderly have poor hearing and cannot hear the mobile phone audio clearly, so the audio content is recognized in real time, converted into subtitles, and superimposed with the original video, such as Figure 1 As shown, it is convenient for the elderly to communicate.

[0003] The enhanced functions of 5G new calls are based on the principle of whoever turns it on, benefits from it, and pays for it in the current technical specifications of various operators. Therefore, in actual scenarios, it can only work if the recipient, such as the elderly, uses a mobile phone that supports 5G new calls, turns on the corresponding enhanced functions, and knows how to turn them on. This is inconsistent with the fact that in real life, the elderly have older mobile phones and do not know how to use the new functions of their mobile phones. Summary of the invention

[0004] The technical problem to be solved by the present invention is to address the deficiencies of the above-mentioned prior art and provide a method for reversely providing 5G new call enhancement functions. The 5G enhancement function is triggered by the sender (such as a child), video processing is performed on the sending side, and finally the processing result is sent to the receiver (such as an elderly person). The sender is charged for this service function, and the receiver only needs an ordinary mobile phone that can accept the video function to enjoy the convenience of the 5G new call enhancement function, which greatly improves the scope of application in actual scenarios.

[0005] In order to achieve the above technical objectives, the technical solution adopted by the present invention is:

[0006] A method for reversely providing 5G new call enhancement function, comprising the following steps:

[0007] The 5G new call mobile phone and the 5G new call enhanced function module at the local end are used as the sender, and the ordinary mobile phone is used as the receiver;

[0008] The sender and the receiver establish a video call. The sender makes a new 5G call, and the receiver makes a traditional video call.

[0009] The sender provides the receiver with the video processing capability of the new 5G call and pays the receiver, but the sender does not use the processed video. Instead, the receiver uses a traditional video call to receive the processed video.

[0010] To optimize the above technical solutions, the specific measures taken also include:

[0011] The above-mentioned ordinary mobile phone is a mobile phone that only supports video calls.

[0012] The above-mentioned 5G new call enhancement function module includes media plane, capability network element, capability platform and billing unit;

[0013] The media plane is used to send and receive audio and video media on the mobile phone side, and forward the media to the capability network element for processing under the control of the capability platform, and then receive the processed media;

[0014] The capability network element is used to process the received media, including a variety of video processing capabilities, including but not limited to recognizing the audio of the media and converting it into subtitles and then synthesizing it into the original video of the media, triggering animation effects through voice or action, and then returning the processed media;

[0015] The capability platform, as a control plane, is used to receive the user's DTMF key presses and determine the specific service; notify the billing unit to start billing; find the corresponding capability network element according to the service, notify it to start the function, and obtain its media receiving address; notify the media plane of the capability network element media receiving address;

[0016] The billing unit is used to bill the corresponding functions of the service.

[0017] There are multiple network elements for the above capabilities, and each network element is responsible for different functions, including but not limited to subtitle conversion, background replacement, and animation effects.

[0018] Taking the reverse video-to-text function as an example, the enabling process is as follows:

[0019] The receiver's ordinary mobile phone establishes a video call with the sender's 5G new call mobile phone;

[0020] The 5G new call phone turns on the video-to-text function through the reverse audio-to-text button switch;

[0021] The capability platform of the 5G new call enhancement function module recognizes the activation behavior;

[0022] The capability platform notifies the billing unit to start billing;

[0023] The capability platform finds the corresponding capability network element according to the service, notifies it to start the function, and obtains its media receiving address;

[0024] The capability platform notifies the media plane of the capability network element media receiving address.

[0025] Taking the reverse video-to-text function as an example, the reverse video-to-text process is as follows:

[0026] The audio and video streams of the sender's 5G new call mobile phone arrive at the media plane of the 5G new call enhanced function module;

[0027] The media plane forwards the introduced audio and video streams to the capability network element;

[0028] The capability network element converts speech into text, generates subtitles from the text, merges them into the original video, and then returns the video to the media plane;

[0029] The media side sends the video to the recipient's traditional video call, and finally it is delivered to the recipient's ordinary mobile phone.

[0030] The above-mentioned billing unit charges the sender's 5G new call mobile phone the functional fee for the 5G new call function after the call ends.

[0031] The present invention has the following beneficial effects:

[0032] Aiming at actual user scenarios, the present invention proposes the ability to reversely control the enhanced function of 5G new calls. The ability can be triggered by the initiator, perform video processing at the initiator, send the final video to the other party, and pay the other party. This is more in line with the actual user scenarios, especially friendly to the elderly, and is conducive to the promotion of the enhanced function of 5G new calls. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 A schematic diagram of real-time subtitle generation and overlay for new 5G calls;

[0034] Figure 2 Provide a schematic diagram of the audio-to-text process for new 5G calls;

[0035] Figure 3 Provides a reverse audio-to-text flow diagram for new 5G calls. DETAILED DESCRIPTION

[0036] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0037] Although the steps in the present invention are arranged with numbers, they are not used to limit the order of the steps. Unless the order of the steps is clearly stated or the execution of a certain step requires other steps as a basis, the relative order of the steps can be adjusted. It is understood that the term "and / or" used in this article involves and covers any and all possible combinations of one or more of the associated listed items.

[0038] A method for reversely providing a 5G new call enhancement function of the present invention comprises the following steps:

[0039] The 5G new call mobile phone and the 5G new call enhanced function module at the local end are used as the sender, and the ordinary mobile phone is used as the receiver;

[0040] The sender and the receiver establish a video call. The sender makes a new 5G call, and the receiver makes a traditional video call.

[0041] The sender provides the receiver with the video processing capability of the new 5G call and pays the receiver, but the sender does not use the processed video. Instead, the receiver uses a traditional video call to receive the processed video.

[0042] In the embodiment, the ordinary mobile phone is a mobile phone that only supports video calls.

[0043] The 5G new call enhancement function module includes a media plane, a capability network element, a capability platform and a billing unit;

[0044] The media plane is used to send and receive audio and video media on the mobile phone side, and forward the media to the capability network element for processing under the control of the capability platform, and then receive the processed media;

[0045] The capability network element is used to process the received media, including a variety of video processing capabilities, including but not limited to recognizing the audio of the media and converting it into subtitles and then synthesizing it into the original video of the media, triggering animation effects through voice or action, and then returning the processed media;

[0046] The capability platform, as a control plane, is used to receive the user's DTMF key presses and determine the specific service; notify the billing unit to start billing; find the corresponding capability network element according to the service, notify it to start the function, and obtain its media receiving address; notify the media plane of the capability network element media receiving address;

[0047] The billing unit is used to bill the corresponding functions of the service.

[0048] There are multiple capability network elements, each of which is responsible for different functions, including but not limited to subtitle conversion, background replacement, and animation effects.

[0049] Taking the reverse video-to-text function as an example, the enabling process is as follows:

[0050] The receiver's ordinary mobile phone establishes a video call with the sender's 5G new call mobile phone;

[0051] The 5G new call phone turns on the video-to-text function through the reverse audio-to-text button switch;

[0052] The capability platform of the 5G new call enhancement function module recognizes the activation behavior;

[0053] The capability platform notifies the billing unit to start billing;

[0054] The capability platform finds the corresponding capability network element according to the service, notifies it to start the function, and obtains its media receiving address;

[0055] The capability platform notifies the media plane of the capability network element media receiving address.

[0056] Taking the reverse video-to-text function as an example, the reverse video-to-text process is as follows:

[0057] The audio and video streams of the sender's 5G new call mobile phone arrive at the media plane of the 5G new call enhanced function module;

[0058] The media plane forwards the introduced audio and video streams to the capability network element;

[0059] The capability network element converts speech into text, generates subtitles from the text, merges them into the original video, and then returns the video to the media plane;

[0060] The media side sends the video to the recipient's traditional video call, and finally it is delivered to the recipient's ordinary mobile phone.

[0061] The billing unit charges the sender's 5G new call mobile phone a functional fee for the 5G new call function after the call ends.

[0062] The following uses a call between an elderly person and his children as an example to compare and illustrate the traditional 5G new call enhancement function method and the method of reversely providing the 5G new call enhancement function of the present invention. However, in fact, it is not limited to this enhancement function, but is applicable to all 5G new call enhancement functions.

[0063] 5G New Call is a new generation of call products based on 5G networks. Based on the ultra-clear voice calls, video calls and related value-added services of 5G networks, 5G New Call provides a series of innovative call enhancement functions and innovative applications.

[0064] The 5G new call module includes the following parts:

[0065] Media plane: responsible for sending and receiving audio and video media on the mobile phone side, forwarding the media to the capability network element for processing under the control of the capability platform, and then receiving the processed media.

[0066] Capability network element: Performs various modifications to the media, mainly identifying audio, converting it into subtitles, and synthesizing it into the original video. There are many capability network elements in the existing network, each responsible for different functions, in addition to subtitles in this example, there are also background replacements, etc.

[0067] Capability platform: As the control plane, it receives the user's DTMF key presses and maps them to specific services; it notifies the billing module to start billing; it finds the corresponding capability network element based on the service, notifies it to start the function, and obtains its media receiving address; it notifies the media plane of the capability network element's media receiving address.

[0068] Billing unit: Billing for corresponding functions.

[0069] Since traditional video calls do not provide video processing functions, they can be understood as only existing on the media side and simply forwarding videos.

[0070] For the traditional 5G new call enhancement method, its forward control process is as follows: Figure 2 As shown, in Figure 2 The middle-aged and elderly people are using mobile phone A, which supports the new 5G call function, while their children are using mobile phone B, which does not support the new 5G call function but only supports the video call function.

[0071] For the convenience of description, the processing flow has been partially simplified and merged, but it does not affect the patent description.

[0072] The traditional forward opening process is:

[0073] Elderly person A must use a mobile phone that supports 5G new calls to establish a video call with his child who uses an ordinary mobile phone B;

[0074] The elderly person turns on the function by pressing the audio-to-text switch (see Table 1 below for China Telecom specifications), and the capability platform on the user A side recognizes the user's turning-on behavior;

[0075] Table 1

[0076]

[0077] The capability platform notifies the billing unit to start billing;

[0078] The capability platform finds the corresponding capability network element according to the service, notifies it to start the function, and obtains its media receiving address;

[0079] The capability platform notifies the media plane of the capability network element media receiving address.

[0080] The traditional forward video processing flow is:

[0081] The children’s audio and video streams reach traditional video calls;

[0082] The children’s audio and video streams reach the media surface;

[0083] The audio and video streams are copied to the capability network element;

[0084] The capability network element is responsible for converting speech into text, and then generating subtitles from the text and merging them into the original video;

[0085] The modified video was sent back to the media;

[0086] The modified video is sent to A.

[0087] After the call ends, the elderly will be charged for the new 5G call function.

[0088] It can be seen that the new 5G call method of audio-to-text conversion can only work if the recipient, such as the elderly, uses a mobile phone that supports the new 5G call, has activated the corresponding enhanced function, and knows how to turn on the function. This contradicts the real life that the elderly have older mobile phones and do not know how to use the new functions of the mobile phones.

[0089] Figure 3 The reverse start timing diagram described in the method for reversely providing 5G new call enhancement function of the present invention is based on Figure 3 It can be seen that the core of the reverse process of the present invention is to move the video processing and charging to the non-using side (that is, the children), so that the using side (the elderly) can also enjoy the audio-to-text process of the new 5G call using an old mobile phone.

[0090] The enabling process is:

[0091] The elderly person uses an ordinary mobile phone A to establish a video call with his child B who uses the new 5G phone.

[0092] The child turns on the function by pressing the reverse audio-to-text key switch (which needs to be different from the forward *21#, and can be defined as **21# or other non-conflicting combinations), and the capability platform on the user B side recognizes the user's turning-on behavior;

[0093] The capability platform notifies the billing unit to start billing;

[0094] The capability platform finds the corresponding capability network element according to the service, notifies it to start the function, and obtains its media receiving address;

[0095] The capability platform notifies the media plane of the capability network element media receiving address.

[0096] The media flow is:

[0097] The children’s audio and video streams reach the media interface of the new 5G call;

[0098] The media plane forwards it to the capability network element;

[0099] The capability network element is responsible for converting speech into text, and then generating subtitles from the text and merging them into the original video;

[0100] The modified video was sent back to the media;

[0101] The media side sends a traditional video call to the elderly side;

[0102] The media eventually reached the elderly side.

[0103] After the call, the child will be charged for the new 5G call function.

[0104] It can be seen that the ability of reverse control of the 5G new call enhancement function proposed by the present invention for actual user scenarios can be triggered by the initiator, perform video processing at the initiator, send the final video to the other party, and pay the other party. It is more in line with the actual user scenario, especially friendly to the elderly, and is conducive to the promotion of the 5G new call enhancement function.

[0105] It will be apparent to those skilled in the art that the invention is not limited to the details of the exemplary embodiments described above and that the invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is intended that all variations falling within the meaning and scope of the equivalent elements of the claims be included in the invention. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.

[0106] In addition, it should be understood that although the present specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

Claims

1. A method for reversely providing 5G new call enhancement functions, characterized in that: The specific steps include: The 5G new call mobile phone and the 5G new call enhanced function module at the local end are used as the sender, and the ordinary mobile phone is used as the receiver; The sender and the receiver establish a video call. The sender makes a new 5G call, and the receiver makes a traditional video call. The sender provides the receiver with the video processing capability of the new 5G call and pays the receiver, but the sender does not use the processed video. Instead, the receiver uses a traditional video call to receive the processed video.

2. A method for reversely providing 5G new call enhancement functions according to claim 1, characterized in that: The ordinary mobile phone is a mobile phone that only supports video calls.

3. The method for reversely providing 5G new call enhancement function according to claim 1, characterized in that: The 5G new call enhancement function module includes a media plane, a capability network element, a capability platform and a billing unit; The media plane is used to send and receive audio and video media on the mobile phone side, and forward the media to the capability network element for processing under the control of the capability platform, and then receive the processed media; The capability network element is used to process the received media, including a variety of video processing capabilities, including but not limited to recognizing the audio of the media and converting it into subtitles and then synthesizing it into the original video of the media, triggering animation effects through voice or action, and then returning the processed media; The capability platform, as a control plane, is used to receive the user's DTMF key presses and determine the specific service; notify the billing unit to start billing; find the corresponding capability network element according to the service, notify it to start the function, and obtain its media receiving address; notify the media plane of the capability network element media receiving address; The billing unit is used to bill the corresponding functions of the service.

4. The method for reversely providing 5G new call enhancement function according to claim 3, characterized in that: There are multiple capability network elements, each of which is responsible for different functions, including but not limited to subtitle conversion, background replacement, and animation effects.

5. The method for reversely providing 5G new call enhancement function according to claim 3, characterized in that: Taking the reverse video-to-text function as an example, the enabling process is as follows: The receiver's ordinary mobile phone establishes a video call with the sender's 5G new call mobile phone; The 5G new call phone turns on the video-to-text function through the reverse audio-to-text button switch; The capability platform of the 5G new call enhancement function module recognizes the activation behavior; The capability platform notifies the billing unit to start billing; The capability platform finds the corresponding capability network element according to the service, notifies it to start the function, and obtains its media receiving address; The capability platform notifies the media plane of the capability network element media receiving address.

6. A method for reversely providing 5G new call enhancement functions according to claim 3, characterized in that: Taking the reverse video-to-text function as an example, the reverse video-to-text process is as follows: The audio and video streams of the sender's 5G new call mobile phone arrive at the media plane of the 5G new call enhanced function module; The media plane forwards the introduced audio and video streams to the capability network element; The capability network element converts speech into text, generates subtitles from the text, merges them into the original video, and then returns the video to the media plane; The media side sends the video to the recipient's traditional video call, and finally it is delivered to the recipient's ordinary mobile phone.

7. A method for reversely providing 5G new call enhancement functions according to claim 6, characterized in that: The billing unit charges the sender's 5G new call mobile phone a functional fee for the 5G new call function after the call ends.

Images