Methods, devices, equipment, storage media, and software products for the fusion of media streaming and voice calls.

Abstract

The embodiment of the present application discloses a media stream and call fusion method, device, equipment, storage medium and program product, the method comprises the following steps: receiving a media stream control request sent by an AS after the process of media anchoring and media negotiation related to a call service is completed; requesting a media content management network element for a media stream address and processing configuration information of the media stream; obtaining a media resource after receiving the media stream address and the processing configuration information of the media stream returned by the media content management network element; determining an address of a playable media stream according to the media resource; and feeding back the address of the playable media stream to the AS, so that the AS sends a media playback request carrying the address of the playable media stream to a communication system core network element, and the communication system core network element is used for sending the playable media stream to at least a calling terminal of the call service according to the address of the playable media stream.

Description

Technical Field

[0001] This application belongs to the field of media streaming technology, and specifically relates to a method, apparatus, device, storage medium, and program product for integrating media streaming and voice calls. Background Technology

[0002] In related technologies, various live streaming services are booming, and various live streaming media resources are emerging in an endless stream. However, at present, media streaming resources are all distributed on various OTT (Over The Top) platforms and the Internet, and have not yet been effectively integrated with communication networks and services. Summary of the Invention

[0003] This application provides a method, apparatus, device, storage medium, and program product for integrating media streaming and voice calls.

[0004] This application provides a method for fusing media streams and voice calls, applied in a media capability platform. The method includes:

[0005] After the media anchoring and media negotiation process related to the call service is completed, a media flow control request is received from the Application Server (AS).

[0006] Request the media stream address and media stream processing configuration information from the media content control network element;

[0007] After receiving the media stream address and the media stream processing configuration information returned by the media content control network element, the media resources are obtained;

[0008] The address of the playable media stream is determined based on the media resources;

[0009] The address of the playable media stream is fed back to the AS, so that the AS sends a media playback request carrying the address of the playable media stream to the core network element of the communication system. The core network element of the communication system is used to send the playable media stream to at least the calling terminal of the call service according to the address of the playable media stream.

[0010] In some embodiments, the media flow control request is a request sent by the AS after the called terminal of the call service goes off-hook.

[0011] In some embodiments, the media flow control request is sent after the AS receives a media insertion instruction during a call.

[0012] In some embodiments, obtaining media resources after receiving the media stream address and the media stream processing configuration information returned by the media content management network element includes: after receiving the media stream address and the media stream processing configuration information, in response to being able to establish a connection based on the media stream address, obtaining the media resources based on the established connection.

[0013] In some embodiments, the method further includes: in response to receiving the media stream address of the backup media stream and the processing configuration information of the backup media stream returned by the media content control network element, obtaining the backup media stream according to the media stream address of the backup media stream, and determining the backup media stream as the media resource.

[0014] In some embodiments, determining the address of a playable media stream based on the media resource includes: processing the media resource according to the processing configuration information to obtain processed media resources; and determining the address of the playable media stream in the processed media resource.

[0015] This application embodiment also provides another method for integrating media streams and voice calls, applied in a media content management network element, the method comprising:

[0016] The system receives a request from the media capability platform to obtain the media stream address and media stream processing configuration information. The media capability platform is used to receive a media stream control request from the AS after the media anchoring and media negotiation process related to the call service is completed, and is used to send a request to obtain the media stream address and media stream processing configuration information after receiving the media stream control request.

[0017] The media capability platform sends the media stream address and the media stream processing configuration information to the media capability platform. Upon receiving the media stream address and the media stream processing configuration information, the media capability platform acquires media resources, determines the address of a playable media stream based on the media resources, and feeds back the address of the playable media stream to the AS, causing the AS to send a media playback request carrying the address of the playable media stream to the core network element of the communication system. The core network element of the communication system sends the playable media stream to at least the calling terminal of the call service based on the address of the playable media stream.

[0018] In some embodiments, sending the media stream address to the media capability platform includes:

[0019] When an available connection exists in the preset media stream connection pool of the media capability platform, the media stream address corresponding to the available connection is sent to the media capability platform; when no available connection exists in the preset media stream connection pool of the media capability platform, in response to the ability to establish a connection with a third-party media source, the media stream address is created based on the connection established with the third-party media source, and the media stream address is sent to the media capability platform.

[0020] The method further includes: in response to the inability to establish a connection with the third-party media source, activating a backup media stream according to a preset strategy, and sending the media stream address of the backup media stream and the processing configuration information of the backup media stream to the media capability platform.

[0021] This application also provides a media streaming and call fusion device, applied in a media capability platform, the device comprising:

[0022] The first receiving module is used to receive a media flow control request sent by the AS after the media anchoring and media negotiation process related to the call service has ended.

[0023] The first processing module is used to request the media stream address and media stream processing configuration information from the media content management network element; after receiving the media stream address and media stream processing configuration information returned by the media content management network element, it obtains media resources; and determines the address of the playable media stream based on the media resources.

[0024] The second processing module is used to feed back the address of the playable media stream to the AS, so that the AS sends a media playback request carrying the address of the playable media stream to the core network element of the communication system. The core network element of the communication system is used to send the playable media stream to at least the calling terminal of the call service according to the address of the playable media stream.

[0025] This application embodiment also provides another media streaming and call fusion device, applied in a media content management network element, the device comprising:

[0026] The second receiving module is used to receive a request from the media capability platform to obtain the media stream address and the media stream processing configuration information. The media capability platform is used to receive the media stream control request sent by the AS after the media anchoring and media negotiation process related to the call service is completed, and is used to send a request to obtain the media stream address and the media stream processing configuration information after receiving the media stream control request.

[0027] The third processing module is used to send the media stream address and the media stream processing configuration information to the media capability platform. After receiving the media stream address and the media stream processing configuration information, the media capability platform is used to acquire media resources, determine the address of the playable media stream based on the media resources, and feed back the address of the playable media stream to the AS, so that the AS sends a media playback request carrying the address of the playable media stream to the core network element of the communication system. The core network element of the communication system is used to send the playable media stream to at least the calling terminal of the call service based on the address of the playable media stream.

[0028] This application also provides an electronic device, which includes a processor and a memory for storing a computer program that can run on the processor; wherein the processor is used to run the computer program to perform any of the above-described media streaming and call fusion methods.

[0029] This application also provides a computer storage medium storing a computer program that, when executed by a processor, implements any of the above-described methods for merging media streams and calls.

[0030] This application also provides a computer program product, including a computer program that, when executed by a processor, implements any of the above-described methods for merging media streams and calls.

[0031] It can be seen that after the media anchoring and media negotiation process related to the call service is completed, the media capability platform can request the media stream address and media stream processing configuration information from the media content control network element to obtain media resources. After determining the address of the playable media stream based on the media resources, the playable media stream can be sent to the called terminal through the AS and the core network element of the communication system, so that the called terminal can play the media stream, thus realizing the effective integration of media stream and call. Attached Figure Description

[0032] Figure 1A This is a schematic diagram of the media stream and call fusion system in an embodiment of this application;

[0033] Figure 1B This is a schematic diagram of the media stream and call fusion system in the embodiments of this application. Figure 2 ;

[0034] Figure 2 This is a flowchart illustrating a method for fusing media streams and calls applied to a media capability platform, as described in an embodiment of this application.

[0035] Figure 3This is a flowchart illustrating a method for fusing media streams and calls applied to a media content control network element according to an embodiment of this application;

[0036] Figure 4 The flowchart illustrates the interaction process of the method for fusing media streams and call services when a user goes off-hook, as provided in this embodiment of the application.

[0037] Figure 5 An interactive flowchart illustrating the method for fusing media streams and call services during a user call, as provided in an embodiment of this application.

[0038] Figure 6 This is a flowchart illustrating the interaction between the media capability platform, the media content control network element, and the third-party media source in this embodiment of the application.

[0039] Figure 7 This is a schematic diagram of the structure of a media streaming and call fusion device applied to a media capability platform according to an embodiment of this application;

[0040] Figure 8 This is a schematic diagram of the structure of a media stream and call fusion device applied to a media content management network element according to an embodiment of this application;

[0041] Figure 9 This is a schematic diagram of the composition structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0042] Currently, live streaming media resources are distributed across various OTT (Over The Top) platforms and the Internet, and have not yet been effectively integrated with communication networks and services.

[0043] In some embodiments, with the development of video call services by mobile operators, multimedia technologies and content are widely used. Currently, the main services in operator call services that integrate multimedia technologies and content include: 1) pre-call video ringback tones and enterprise ringback tones in 2B and 2C scenarios; 2) 2B services. For example, 2B services may include video customer service, media insertion during calls, and Interactive Voice and Video Response (IVVR) services. When integrating the above services with multimedia technologies and content, editing, processing, and generation steps can be performed on media resources in advance. After generating and storing static media resources that can be integrated, they can be managed and subscribed to through content uploading or called by the service AS after business logic orchestration and played on the user terminal (UE). Playing these on the terminal screen before a call can replace the ordinary ringback tone or replace Dual Tone Multi Frequency (DTMF) during a call for new video interactive interaction.

[0044] The aforementioned solution for integrating call services with multimedia services has at least the following drawbacks: Firstly, there are limitations in both the generation and timeliness of multimedia content. This manifests in: 1) After a user subscribes to a ringback tone service, whether subscribing to a single ringback tone or multiple ringback tones and enabling random mode, the ringback tone resources, once agreed upon before the call, will repeatedly cycle through the ringing process. This leads to aesthetic fatigue for the caller, preventing them from focusing on the content. 2) To maintain content updates, users must manually update their subscriptions or ringback tone materials, but few customers actively perform these changes. These two points combined gradually diminish user attention to the screen content. Secondly, a large amount of high-quality live streaming content, such as slow-motion live streaming, has not been effectively integrated. The ever-changing scenery and content are only disseminated online and not integrated into the communication network and call services.

[0045] To address the aforementioned technical problems, this application proposes a technical solution based on embodiments of the present application. The technical solution provided in this application can integrate live streaming media content with pre-call and in-call services. It provides a live streaming content integration service. For C-end users, users subscribe to different live streaming media content. When acting as the called party, the caller will see real-time live streaming media content during the ringing phase, and the live streaming media content can continue playing during the call, serving as the terminal's screen background content. For B-end users, B-end users can set up live streaming media content with enterprise characteristics, continuously playing the content before and during the call for promotion, marketing, and other business purposes.

[0046] The embodiments of this application will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the embodiments provided herein are merely illustrative of the embodiments of this application and are not intended to limit the embodiments of this application. Furthermore, the embodiments provided below are some embodiments for implementing this application, and not all embodiments for implementing this application. Unless otherwise specified, the technical solutions described in the embodiments of this application can be implemented in any combination.

[0047] It should be noted that, in the embodiments of this application, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a method or apparatus that includes a list of elements includes not only the elements expressly described, but also other elements not expressly listed, or elements inherent to implementing the method or apparatus. Without further limitations, an element defined by the phrase "comprising a..." does not exclude the presence of other related elements (e.g., steps in the method or units in the apparatus, such as portions of circuitry, processors, programs, or software, etc.) in the method or apparatus that includes that element.

[0048] The media stream and call fusion method provided in this application includes a series of steps. However, the media stream and call fusion method provided in this application is not limited to the steps described. Similarly, the media stream and call fusion apparatus provided in this application includes a series of modules. However, the apparatus provided in this application is not limited to the modules explicitly described, but may also include modules that need to be set up for obtaining relevant information or processing based on information.

[0049] The technical solutions of this application embodiment can be implemented based on a media streaming and call fusion system. In one implementation, refer to... Figure 1A The converged system for media streaming and calls may include a calling UE 101, a calling party UE 102, a core network element of the communication system 103, an AS 104, a media capability platform 105, a media content management network element 106, and a third-party media source 107. The calling UE 101 may be the calling terminal, and the calling party UE 102 may be the called terminal. The core network element of the communication system 103 may include one or more of the following: a Voice over Long-Term Evolution (VoLTE) AS, a combination of VoNR and capability network elements, and a combination of Ultra-High Definition Audio / Video Calling (VoNR) and the media plane. The media capability platform 105 is a core media processing platform, the AS 104 is a control plane network element in this embodiment, and the media content management network element 106 is the core media management component corresponding to the third-party media source 107.

[0050] In another implementation, refer to Figure 1B The converged media streaming and call system may include AS104, user-side service operation platform 108, management-side service operation platform 109, media capability platform 105, core network element of the communication system 103, media content control network element 106, and third-party media source 107. Among them, AS104, user-side service operation platform 108, management-side service operation platform 109, and media capability platform 105 are new network elements added to implement business logic; user-side service operation platform 108 and management-side service operation platform 109 are platforms that support business operations; media content control network element 106 integrates core components such as media content operation, media transmission, and assurance services, and interfaces with third-party media source 107 to complete functions such as content operation, processing configuration, and orchestration; media capability platform 105 is the core media processing platform, responsible for managing and calling media processing capabilities, and processing media according to configuration through a processing pipeline, ultimately achieving business convergence through interface with core network elements.

[0051] Figure 2 This is a flowchart illustrating a method for fusing media streams and calls applied to a media capability platform, as described in an embodiment of this application. Figure 2 As shown, the process may include:

[0052] Step 201: After the media anchoring and media negotiation process related to the call service is completed, receive the media flow control request sent by the AS.

[0053] In some embodiments, after the called terminal in a call goes off-hook, the core network element of the communication system can interact with the called terminal to complete audio and video anchoring and media negotiation. In some embodiments, during a call between the calling terminal and the called terminal, the core network element of the communication system can interact with the called terminal to complete audio and video anchoring and media negotiation.

[0054] Step 202: Request the media stream address and media stream processing configuration information from the media content control network element.

[0055] Step 203: After receiving the media stream address and media stream processing configuration information returned by the media content control network element, obtain the media resources.

[0056] In this embodiment, the media resource can be a playable audio or video media stream. In some embodiments, the media capability platform can obtain media resources from a third-party media source, or it can identify a backup media stream as the media resource.

[0057] Step 204: Determine the address of the playable media stream based on the media resources.

[0058] In this embodiment of the application, the media resource may carry the address of a playable media stream.

[0059] Step 205: Feed back the address of the playable media stream to the AS, so that the AS sends a media playback request carrying the address of the playable media stream to the core network element of the communication system. The core network element of the communication system is used to send the playable media stream to at least the calling terminal of the call service according to the address of the playable media stream.

[0060] In some embodiments, the core network element of the communication system is also used to send a playable media stream to the called terminal of the call service according to the address of the playable media stream.

[0061] In practical applications, steps 201 to 205 can be implemented based on a processor, which can be at least one of the following: Application Specific Integrated Circuit (ASIC), Digital Signal Processor (DSP), Digital Signal Processing Device (DSPD), Programmable Logic Device (PLD), Field Programmable Gate Array (FPGA), Central Processing Unit (CPU), Controller, Microcontroller, and Microprocessor.

[0062] It can be seen that after the media anchoring and media negotiation process related to the call service is completed, the media capability platform can request the media stream address and media stream processing configuration information from the media content control network element to obtain media resources. After determining the address of the playable media stream based on the media resources, the playable media stream can be sent to the called terminal through the AS and the core network element of the communication system, so that the called terminal can play the media stream, thus realizing the effective integration of media stream and call.

[0063] Furthermore, the aforementioned media resources can be live media resources, so that live streaming content can be displayed on the calling terminal, thereby integrating the live streaming content into the communication network and call services.

[0064] In some embodiments of this application, the media stream control request is sent by the AS after the called terminal in the call service goes off-hook. It can be seen that when the called terminal in the call service goes off-hook, the technical solution of this application embodiment can have the AS send the media stream control request. After the AS sends the media stream control request, the media capability platform can request the media stream address and media stream processing configuration information from the media content management network element. Upon receiving the media stream address and media stream processing configuration information returned by the media content management network element, media resources are obtained, and then a playable media stream can be sent to the calling terminal in the call service according to the media resources, thus realizing the playback of the media stream. That is, this application embodiment can achieve effective fusion of the media stream and the call when the called terminal in the call service goes off-hook.

[0065] In some embodiments of this application, the media stream control request is sent after the AS receives a media insertion instruction during a call. It can be seen that after the AS receives the media insertion instruction during a call, the technical solution of this application embodiment can have the AS send a media stream control request. After the AS sends the media stream control request, the media capability platform can request the media stream address and media stream processing configuration information from the media content management network element. Then, after receiving the media stream address and media stream processing configuration information returned by the media content management network element, it can obtain media resources and then send a playable media stream to the calling terminal of the call service according to the media resources, thus realizing the playback of the media stream. In summary, the embodiments of this application can effectively integrate the media stream and the call service during a call.

[0066] In some embodiments of this application, the step of obtaining media resources after receiving the media stream address and the media stream processing configuration information returned by the media content management network element includes: after receiving the media stream address and the media stream processing configuration information, in response to the ability to establish a connection based on the media stream address, obtaining media resources based on the established connection. It can be seen that, when a connection can be established based on the media stream address, the embodiments of this application can relatively easily obtain media resources based on the established connection.

[0067] In some embodiments of this application, the method further includes: in response to receiving the media stream address of the backup media stream and the processing configuration information of the backup media stream returned by the media content control network element, obtaining the backup media stream according to the media stream address of the backup media stream, and determining the backup media stream as the media resource.

[0068] For example, if a connection cannot be established based on the media stream address, the media capability platform can request the media stream address of the backup media stream and the processing configuration information of the backup media stream from the media content management network element.

[0069] It can be seen that even when a connection cannot be established based on the media stream address, the embodiments of this application can obtain media resources based on the media stream address and processing configuration information of the backup media stream returned by the media content control network element, thereby improving the reliability and stability of obtaining media resources.

[0070] In some embodiments of this application, determining the address of a playable media stream based on the media resource includes: processing the media resource according to processing configuration information to obtain processed media resources; and determining the address of a playable media stream in the processed media resource.

[0071] In this embodiment of the application, the media capability platform can request the media stream address corresponding to the current service and the media stream processing configuration information from the media content management network element. Here, the current service can be the communication service or call service corresponding to the off-hook, and the media stream processing configuration information can represent the media stream processing method. For example, the media stream processing configuration information can represent the media operation processing method such as subtitle synthesis, content inversion, and resolution conversion of the media stream.

[0072] As can be seen, the embodiments of this application can process media resources based on the processing configuration information returned by the media content control network element, thereby determining the address of the playable media stream more accurately.

[0073] Figure 3 This is a flowchart of a media stream and call fusion method applied to a media content management network element according to an embodiment of this application, such as... Figure 3 As shown, the process may include:

[0074] Step 301: Receive a request from the media capability platform to obtain the media stream address and media stream processing configuration information; the media capability platform is used to receive the media stream control request sent by the AS after the media anchoring and media negotiation process related to the call service is completed, and to send a request to obtain the media stream address and media stream processing configuration information after receiving the media stream control request.

[0075] Step 302: Send the media stream address and the media stream processing configuration information to the media capability platform. After receiving the media stream address and the media stream processing configuration information, the media capability platform obtains media resources, determines the address of the playable media stream based on the media resources, and feeds back the address of the playable media stream to the AS, so that the AS sends a media playback request carrying the address of the playable media stream to the core network element of the communication system. The core network element of the communication system sends the playable media stream to at least the calling terminal of the call service based on the address of the playable media stream.

[0076] In practical applications, steps 301 to 302 can be implemented based on a processor, which can be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor.

[0077] It can be seen that after the media anchoring and media negotiation process related to the call service is completed, the media capability platform can request the media stream address and media stream processing configuration information from the media content control network element to obtain media resources. After determining the address of the playable media stream based on the media resources, the playable media stream can be sent to the called terminal through the AS and the core network element of the communication system, so that the called terminal can play the media stream, thus realizing the effective integration of media stream and call.

[0078] In some embodiments of this application, sending the media stream address to the media capability platform includes: when there is an available connection in the preset media stream connection pool of the media capability platform, sending the media stream address corresponding to the available connection to the media capability platform; when there is no available connection in the preset media stream connection pool of the media capability platform, in response to the ability to establish a connection with a third-party media source, creating a media stream address based on the connection established with the third-party media source, and sending the media stream address to the media capability platform.

[0079] The method further includes:

[0080] In response to the inability to establish a connection with a third-party media source, a backup media stream is activated according to a preset strategy, and the media stream address of the backup media stream and the processing configuration information of the backup media stream are sent to the media capability platform.

[0081] It can be seen that regardless of whether there are available connections in the media stream connection pool of the media capability platform, the media content management network element can send the media stream address to the media capability platform. In the case that a connection cannot be established with a third-party media source, it can also send the media stream address of the backup media stream and the processing configuration information of the backup media stream to the media capability platform, so that the media capability platform can obtain the backup media stream. In summary, in a variety of practical scenarios, the media capability platform can obtain media resources, thereby enabling the playback of media streams on the terminal and improving the reliability of media stream playback to a certain extent.

[0082] The technical solutions of the embodiments of this application can be applied to service scenarios such as 5G new calls, personal and family services, video, media streaming, media, and live streaming. The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings.

[0083] Figure 4 This is an interactive flowchart of the method for fusing media streams and call services when a user goes off-hook, as provided in the embodiments of this application. Figure 4 As shown, the process may include:

[0084] Step 41: UE-A initiates a call to UE-B.

[0085] In this embodiment of the application, UE-A is the calling terminal of the call service, and UE-B is the called terminal of the call service.

[0086] Step 42: UE-B goes off the receiver.

[0087] Step 43: The core network element of the communication system sends a call event notification to the AS, and the AS sends a response to the call event notification to the core network element of the communication system.

[0088] Step 44: AS sends a call event control request to the core network element of the communication system.

[0089] Here, the call event control request is a request to control the media stream. For example, after receiving a call event notification, if the AD determines that the service triggering conditions are met, it sends a call event control request to the core network element of the communication system to instruct bidirectional audio and video anchoring to be performed. The service triggering conditions can be conditions related to audio and video calls, terminal support, preconditions, etc.

[0090] Step 45: The core network element of the communication system sends an off-hook response to the UE-B.

[0091] Step 46: The core network element of the communication system sends a media renegotiation request to the UE-B.

[0092] Step 47: UE-B sends a response to the media renegotiation request to the core network element of the communication system.

[0093] Step 48: The core network element of the communication system creates media stream resources.

[0094] Here, the media stream resources created can be audio and video stream resources of the calling terminal and the called terminal.

[0095] Step 49: After successfully creating media stream resources, the core network element of the communication system determines to negotiate one-way audio and video service requests with the calling terminal.

[0096] Step 410: The core network element of the communication system sends a media update request to the UE-A.

[0097] Step 411: UE-A sends a media update response to the core network element of the communication system.

[0098] Step 412: The core network element of the communication system updates the audio and video stream information.

[0099] Step 413: The core network element of the communication system sends a response message for media renegotiation to the UE-B.

[0100] Step 414: The core network element of the communication system sends an off-hook notification to the UE-A.

[0101] Step 415: UE-A sends an off-hook response to the core network element of the communication system.

[0102] Step 416: The core network element of the communication system reports the call control result notification to the AS, indicating that the audio and video media stream operation was successful.

[0103] Step 417: AS sends a media flow control request to the media capability platform.

[0104] Step 418: The media capability platform requests the media stream address and media stream processing configuration information from the media content control unit.

[0105] In this embodiment of the application, the media capability platform can obtain media resources through interaction with the media content management unit and third-party media sources; by processing the media resources, the address of a playable media stream can be obtained.

[0106] Step 419: The media capability platform notifies AS of the address of the playable media stream.

[0107] Step 420: AS sends a request to the core network element of the communication system to play audio and video.

[0108] Here, the request to play audio or video includes the address of the playable media stream.

[0109] Step 421: The core network element of the communication system sends a response to the AS requesting the playback of audio and video.

[0110] Step 422: The core network element of the communication system sends an audio / video playback status notification to the AS.

[0111] Here, the core network element of the communication system can send an audio / video playback status notification to the AS after sending the processed audio / video media stream to the calling terminal and the called terminal.

[0112] In the above Figure 4 In the steps shown, steps 46 to 413 are the process of the communication system core network element interacting with the terminal to complete audio and video anchoring and media negotiation, and step 418 is the core process, which can be achieved through... Figure 6 The following steps are explained: Step 418 is triggered after receiving a media stream control request, and Step 419 returns the address of the playable media stream to the AS.

[0113] Figure 5The flowchart illustrates the interaction between the media stream and call services fusion method provided in this application embodiment. Figure 5 As shown, the process may include:

[0114] Step 51: The implementation method is the same as that of step 41.

[0115] Step 52: Call event notification control and off-hook response.

[0116] The implementation method for this step is the same as steps 42 to 47.

[0117] Step 53: Create media stream resources and update audio and video stream information.

[0118] The implementation method for this step is the same as steps 48 to 422.

[0119] Step 54: AS confirms that it has received the media insertion instruction.

[0120] Here, the AS determines that it has received a media insertion instruction (i.e., identifies the current service as a media insertion service) by signaling triggering through DTMF, IVVR or other means.

[0121] Step 55: AS sends a call event control request to the core network element of the communication system.

[0122] Here, the call event control request is a request to control the media stream; for example, after receiving the call event notification, if the AD determines that the service triggering conditions are met, it sends a call event control request to the core network element of the communication system to instruct bidirectional audio and video anchoring to be performed.

[0123] Steps 56 to 58: These can be implemented by referring to steps 46 to 48.

[0124] Steps 59 to 512 can be implemented by referring to steps 410 to 413.

[0125] Steps 513 to 518 can be implemented in the same way as steps 416 to 422.

[0126] In the above Figure 5 In the steps shown, steps 56 to 512 are the process of the communication system core network element interacting with the terminal to complete audio and video anchoring and media negotiation, and step 515 is the core process, which can be achieved through... Figure 6 The following steps are explained: Step 515 is triggered after receiving a media stream control request, and Step 516 returns the address of the playable media stream to the AS.

[0127] Figure 6 This is a flowchart illustrating the interaction between the media capability platform, the media content control network element, and the third-party media source in this embodiment of the application. Figure 6 As shown, the interaction process may include:

[0128] Step 61: The media capability platform requests the media stream address and media stream processing configuration information from the media content control network element.

[0129] Here, the media capability platform requests the media stream address and media stream processing configuration information corresponding to the current service from the media content management network element.

[0130] Step 62: Media content control network element checks the preset media stream connection pool.

[0131] Here, the media content control network element checks the preset media stream connection pool. If an available active connection exists in the preset media stream connection pool, it sends the media stream address corresponding to the available connection to the media capability platform. If a connection cannot be established with a third-party media source, a backup media stream is activated according to a preset policy, and the media stream address and processing configuration information of the backup media stream are returned to the media capability platform.

[0132] Step 63: The media content control network element retrieves the processing configuration information of the media stream.

[0133] Here, the media content management network element retrieves the processing configuration information of the media stream corresponding to the current service.

[0134] Step 64: The media content control network element reports the media stream address and media stream processing configuration information to the media capability platform.

[0135] Step 65: The media capability platform establishes media connections and performs preprocessing.

[0136] For example, the media capability platform performs one or more of the following preprocessing steps on the established media connection: content review, quality requirement detection, and resolution adaptation.

[0137] Step 66: When a connection cannot be established with a third-party media source, enable the backup media stream according to the preset policy.

[0138] Here, when a connection cannot be established with a third-party media source, a backup media stream can be obtained based on the media stream address of the backup media stream.

[0139] Step 67: Process the media stream according to the processing configuration information.

[0140] Step 68: Notify the media content control network element of the address of the processed media stream.

[0141] Step 69: The media content control network element updates the backup media stream according to the preset strategy.

[0142] This application provides a fusion solution based on live streaming and other media content with call services, proposes a business logic design scheme for media content management network elements, and provides a quality assurance method during the fusion process of media content and call services. Using the technical solution of this application, slow-motion live streaming media, such as animal themes, scenic spots, and beautiful villages, can be provided to C-end and B-end users, as well as fast-motion live streaming, such as event announcements, sports broadcasts, and comprehensive entertainment scenarios. Based on the platform and business capabilities, including third-party media sources, the business can be expanded to broader data and media sources, such as video websites, IPTV, music, images, and even content generation services, organically combining media acquisition / generation, media processing, and media review with call services.

[0143] In a context where live streaming media emphasizes more real-time and dynamic content, this application's embodiments enable the integration of live streaming media with voice calls. The playable media stream content possesses greater scalability, flexibility, and variability, allowing for organic integration with existing voice call services. During the service integration process, the security of the streaming media content itself, as well as the security of the network and services, is fully considered, ensuring stable quality assurance during the implementation of integrated services. By designing media content control network elements, the scalability of future business function development and the possibility of building a content ecosystem are guaranteed.

[0144] The technical solutions of this application have a wide range of applications in the personal user market, enabling the integration and development of richer content resources with call service scenarios. The technical solutions of this application also have a wide range of applications in the B2C market, including cultural tourism, marketing, and customer service, where they can be combined with existing streaming media content resources on the B-end to expand the content ecosystem and develop specific B-end businesses. The technical solutions of this application can be combined with Artificial Intelligence Generated Content (AIGC) services, offering significant commercial potential for scenarios where content is dynamically generated through user interaction and integrated with call services. When using the technical solutions of this application, the product service process offers significant room for innovation and development in content-based social scenario mining and interactive business development.

[0145] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0146] Figure 7 This is a schematic diagram of the structure of a media streaming and call fusion device applied to a media capability platform according to an embodiment of this application, as shown below. Figure 7 As shown, the device includes:

[0147] The first receiving module 701 is used to receive a media flow control request sent by the AS after the media anchoring and media negotiation process related to the call service has ended.

[0148] The first processing module 702 is used to request a media stream address and media stream processing configuration information from the media content management network element; after receiving the media stream address and media stream processing configuration information returned by the media content management network element, it obtains media resources; and determines the address of a playable media stream based on the media resources.

[0149] The second processing module 703 is used to feed back the address of the playable media stream to the AS, so that the AS sends a media playback request carrying the address of the playable media stream to the core network element of the communication system. The core network element of the communication system is used to send the playable media stream to at least the calling terminal of the call service according to the address of the playable media stream.

[0150] In some embodiments, the media flow control request is a request sent by the AS after the called terminal of the call service goes off-hook.

[0151] In some embodiments, the media flow control request is sent after the AS receives a media insertion instruction during a call.

[0152] In some embodiments, the first processing module 702 is configured to acquire media resources after receiving the media stream address and the media stream processing configuration information returned by the media content control network element, including:

[0153] Upon receiving the media stream address and the media stream processing configuration information, the system is able to establish a connection based on the media stream address and obtain the media resources based on the established connection.

[0154] In some embodiments, the first processing module 702 is further configured to, in response to receiving the media stream address of the backup media stream and the processing configuration information of the backup media stream returned by the media content control network element, obtain the backup media stream according to the media stream address of the backup media stream and determine the backup media stream as the media resource.

[0155] In some embodiments, the first processing module 702 is configured to determine the address of a playable media stream based on the media resource, including:

[0156] The media resources are processed according to the processing configuration information to obtain processed media resources; the address of the playable media stream is determined from the processed media resources.

[0157] In practical applications, the first receiving module 701, the first processing module 702, and the second processing module 703 can be implemented based on a processor and a communication device.

[0158] Figure 8 This is a schematic diagram of the structure of a media stream and call fusion device applied to a media content management network element according to an embodiment of this application, as shown below. Figure 8 As shown, the device includes:

[0159] The second receiving module 801 is used to receive a request from the media capability platform to obtain the media stream address and the media stream processing configuration information; the media capability platform is used to receive the media stream control request sent by the application server AS after the media anchoring and media negotiation process related to the call service is completed, and is used to send a request to obtain the media stream address and the media stream processing configuration information after receiving the media stream control request.

[0160] The third processing module 802 is used to send the media stream address and the media stream processing configuration information to the media capability platform. After receiving the media stream address and the media stream processing configuration information, the media capability platform is used to acquire media resources, determine the address of the playable media stream based on the media resources, and feed back the address of the playable media stream to the AS, so that the AS sends a media playback request carrying the address of the playable media stream to the core network element of the communication system. The core network element of the communication system is used to send the playable media stream to at least the calling terminal of the call service based on the address of the playable media stream.

[0161] In some embodiments, the third processing module 802 is configured to send the media stream address to the media capability platform, including: when there is an available connection in the preset media stream connection pool of the media capability platform, sending the media stream address corresponding to the available connection to the media capability platform; when there is no available connection in the preset media stream connection pool of the media capability platform, in response to the ability to establish a connection with a third-party media source, creating the media stream address based on the connection established with the third-party media source, and sending the media stream address to the media capability platform;

[0162] The third processing module 802 is further configured to, in response to the inability to establish a connection with the third-party media source, activate a backup media stream according to a preset strategy and send the media stream address of the backup media stream and the processing configuration information of the backup media stream to the media capability platform.

[0163] In practical applications, the second receiving module 801 and the third processing module 802 can be implemented based on a processor and a communication device.

[0164] It should be noted that the description of the above device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0165] It should be noted that, in the embodiments of this application, if the above methods are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a terminal, server, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.

[0166] Correspondingly, this application embodiment further provides a computer program product, the computer program product including computer executable instructions, which are used to implement any of the media stream and call fusion methods provided in this application embodiment.

[0167] Accordingly, this application embodiment further provides a computer storage medium storing computer-executable instructions, which are used to implement any of the media stream and call fusion methods provided in the above embodiments.

[0168] This application also provides an electronic device. Figure 9 This is a schematic diagram of the composition structure of an electronic device provided in an embodiment of this application, as shown below. Figure 9 As shown, the electronic device 90 may include:

[0169] Memory 901 is used to store executable instructions;

[0170] The processor 902 is used to execute the executable instructions stored in the memory 901 to implement any of the above-mentioned methods for integrating media streams and calls applied to a media capability platform, or any of the above-mentioned methods for integrating media streams and calls applied to a media content management network element.

[0171] The processor 902 mentioned above can be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor.

[0172] The aforementioned computer-readable storage medium and memory 901 may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM), etc.; or it may be various terminals that include one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0173] In some embodiments, the functions or modules of the apparatus provided in this application can be used to perform the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0174] The description of the various embodiments above tends to emphasize the differences between the various embodiments. The similarities or similarities between them can be referred to, and for the sake of brevity, they will not be repeated here.

[0175] The methods disclosed in the various method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0176] The features disclosed in the various product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0177] The features disclosed in the various method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.

[0178] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0179] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims. All of these forms are within the protection scope of this application.

Claims

1. A method of media stream and call convergence, the method comprising: Applied to a media capability platform, the method comprises: After a process of media anchoring and media negotiation related to a call service ends, receiving a media stream control request sent by an application server AS; Requesting a media content management network element for a media stream address and processing configuration information of the media stream; After receiving the media stream address and the processing configuration information of the media stream returned by the media content management network element, obtaining media resources; Determining an address of a playable media stream according to the media resources; Feeding back the address of the playable media stream to the AS, so that the AS issues a media playing request carrying the address of the playable media stream to a communication system core network element, which is configured to send the playable media stream to at least a calling terminal of the call service according to the address of the playable media stream.

2. The method of claim 1, wherein, The media stream control request is a request sent by the AS after a called terminal of the call service goes off hook.

3. The method of claim 1, wherein, The media stream control request is sent by the AS after the AS receives a media interjection instruction in a call process.

4. The method of claim 1, wherein, The method further comprises: After receiving the media stream address and the processing configuration information of the media stream, obtaining the media resources based on a connection established in response to that the connection can be established based on the media stream address.

5. The method of claim 1, wherein, The method further comprises: In response to receiving a media stream address of a backup media stream and processing configuration information of the backup media stream returned by the media content management network element, obtaining the backup media stream according to the media stream address of the backup media stream, and determining the backup media stream as the media resources.

6. The method according to any one of claims 1 to 5, characterized in that, The method further comprises: Processing the media resources according to the processing configuration information to obtain processed media resources, and determining the address of the playable media stream in the processed media resources.

7. A method of converging media streaming and a call, the method comprising: Applied to a media content management network element, the method comprises: Receiving a request for obtaining a media stream address and processing configuration information of a media stream sent by a media capability platform, the media capability platform being configured to receive a media stream control request sent by an application server AS after a process of media anchoring and media negotiation related to a call service ends, and to send a request for obtaining a media stream address and processing configuration information of a media stream after receiving a media stream control request; Sending the media stream address and the processing configuration information of the media stream to the media capability platform, the media capability platform being configured to obtain media resources after receiving the media stream address and the processing configuration information of the media stream, to determine an address of a playable media stream according to the media resources, and to feed back the address of the playable media stream to the AS, so that the AS issues a media playing request carrying the address of the playable media stream to a communication system core network element, which is configured to send the playable media stream to at least a calling terminal of the call service according to the address of the playable media stream.

8. The method of claim 7, wherein, The sending of the media stream address to the media capability platform comprises: When there is an available connection in a preset media stream connection pool of the media capability platform, sending the media stream address corresponding to the available connection to the media capability platform; when there is no available connection in the preset media stream connection pool of the media capability platform, creating the media stream address based on a connection established with the third-party media source in response to the ability to create a connection with the third-party media source, and sending the media stream address to the media capability platform; The method further comprises: In response to the inability to create a connection with the third-party media source, enabling a backup media stream according to a preset strategy, sending a media stream address of the backup media stream and processing configuration information of the backup media stream to the media capability platform.

9. An apparatus for converging a media stream and a call, the apparatus comprising: Applied to a media capability platform, the apparatus comprises: A first receiving module, configured to receive a media stream control request sent by an application server (AS) after a process of media anchoring and media negotiation related to a call service ends; A first processing module, configured to request a media content management network element for a media stream address and processing configuration information of a media stream, and to acquire a media resource after receiving the media stream address and the processing configuration information of the media stream returned by the media content management network element, and to determine an address of a playable media stream according to the media resource; A second processing module, configured to feed back the address of the playable media stream to the AS, so that the AS issues a media playing request carrying the address of the playable media stream to a core network element of a communication system, and the core network element is configured to send the playable media stream to at least a calling terminal of the call service according to the address of the playable media stream.

10. An apparatus for converging a media stream and a call, the apparatus comprising: Applied to a media content management network element, the apparatus comprises: A second receiving module, configured to receive a request for acquiring a media stream address and processing configuration information of a media stream sent by a media capability platform, and the media capability platform is configured to receive a media stream control request sent by an application server (AS) after a process of media anchoring and media negotiation related to a call service ends, and to send the request for acquiring the media stream address and the processing configuration information of the media stream after receiving the media stream control request; A third processing module, configured to send the media stream address and the processing configuration information of the media stream to the media capability platform, and the media capability platform is configured to acquire a media resource after receiving the media stream address and the processing configuration information of the media stream, to determine an address of a playable media stream according to the media resource, to feed back the address of the playable media stream to the AS, so that the AS issues a media playing request carrying the address of the playable media stream to a core network element of a communication system, and the core network element is configured to send the playable media stream to at least a calling terminal of the call service according to the address of the playable media stream.

11. An electronic device, comprising: Applied to a media capability platform, the electronic device comprises a processor and a memory for storing a computer program capable of running on the processor; wherein, The processor is configured to execute the computer program to perform the method of any one of claims 1 to 6.

12. An electronic device, comprising: Applied to the media content management network element, the electronic device comprises a processor and a memory for storing a computer program capable of running on the processor; wherein, The processor is configured to execute the computer program to perform the method of claim 7 or 8.

13. A computer storage medium having stored thereon a computer program, characterized in that The computer program is executed by the processor to implement the method of any one of claims 1 to 8.

14. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the method of any one of claims 1 to 8.

Images