A method and system for realizing audio and video interaction between mini program and SIP contact center

Through call requests and media stream conversion between applets and SIP contact centers, the problem that applets cannot access SIP contact centers is solved, audio and video interaction is realized, and the practicality and cross-platform capabilities of the application are enhanced.

CN114710473BActive Publication Date: 2024-11-29上海井星信息科技有限公司
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202210254995.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-15
Publication Date
2024-11-29
Estimated Expiration
2042-03-15

AI Technical Summary

Technical Problem

The mini program cannot access the SIP contact center through the standard SIP protocol, resulting in the inability to interact with the SIP contact center for audio and video.

Method used

After receiving the call agent request from the applet, it sends SIP information to the SIP contact center, and converts the media stream to the format supported by the SIP contact center after the agent answers, and vice versa, thereby realizing the applet and SIP contact center. Audio and video interaction.

Benefits of technology

It realizes the voice and video data interaction between the mini program and the SIP contact center, solves the channel problem that the mini program cannot access the SIP contact center, and enhances the practicality of cross-platform applications.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114710473B_ABST
    Figure CN114710473B_ABST
Patent Text Reader

Abstract

The present application relates to a method and system for realizing audio and video interaction between a mini program and a SIP contact center, and relates to the technical field of network communication. The method includes: after receiving a call agent request sent by a mini program, sending a first SIP message to the SIP contact center according to the call agent request; after the agent answers the call, converting the media stream sent by the received mini program into a media stream in a first file format supported by the SIP contact center, and sending the media stream in the first file format to the SIP contact center; the media stream in the first file format is used to trigger the SIP contact center to send the media stream in the first file format to the agent; and after the agent answers the call, converting the media stream sent by the SIP contact center into a media stream in a second file format supported by the mini program, and sending the media stream in the second file format to the mini program. The present application has the effect of realizing audio and video interaction between a mini program and a SIP contact center.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of network communications, and in particular to a method for realizing audio and video interaction between a mini program and a SIP contact center. Background Art

[0002] With the development of SIP contact center applications, the channels for accessing SIP contact centers are no longer limited to mobile phones or landline calls. More and more APP applications have integrated VOIP (Voice Over IP) functions, and users can call into the enterprise SIP contact center through VOIP. This communication method can carry more application data and can more conveniently associate user information. Currently, there are many VOIP application SDKs based on the SIP protocol on Android and IOS platforms.

[0003] Mini programs are favored by more and more users because they are cross-platform and have numerous ready-to-use applications.

[0004] With respect to the above-mentioned related technologies, the inventors found that the mini program does not have a channel for voice and video access to the SIP contact center, and it is impossible to implement voice and video data interaction between the mini program and the SIP contact center. Summary of the invention

[0005] In order to realize audio and video interaction between the mini program and the SIP contact center, the present application provides a method for realizing audio and video interaction between the mini program and the SIP contact center.

[0006] In a first aspect, the present application provides a method for realizing audio and video interaction between a mini program and a SIP contact center, which adopts the following technical solution.

[0007] A method for realizing audio and video interaction between a mini program and a SIP contact center, comprising:

[0008] After receiving the call seat request sent by the mini program, sending a first SIP message to the SIP contact center according to the call seat request; the first SIP message is used to trigger the SIP contact center to assign the first SIP message to the seat;

[0009] After the agent answers the call, convert the received media stream sent by the applet into a media stream in a first file format supported by the SIP contact center, and send the media stream in the first file format to the SIP contact center; the media stream in the first file format is used to trigger the SIP contact center to send the media stream in the first file format to the agent; and,

[0010] After the agent answers the call, the media stream sent by the SIP contact center is converted into a media stream in a second file format supported by the applet, and the media stream in the second file format is sent to the applet; the media stream sent by the SIP contact center is sent by the agent to the SIP contact center.

[0011] By adopting the above technical solution, the call agent request sent by the mini program is converted into the first SIP information of the SIP protocol. After the agent is connected, the media stream sent by the agent is converted into the media stream format supported by the mini program, thereby realizing voice and video interaction between the mini program and the agent.

[0012] Optionally, after sending the first SIP message to the SIP contact center, the method further includes:

[0013] receiving the agent status information sent by the SIP contact center; the agent status information is sent by the SIP contact center according to the response status of the agent after the agent receives the first SIP information; and

[0014] The agent status information is sent to the applet.

[0015] By adopting the above technical solution, the agent status information is sent to the mini program, so that the mini program can know the status of the agent.

[0016] Optionally, the mini program is pre-registered, and the mini program registration step includes:

[0017] receiving a registration request sent by the mini program; the registration request is generated by the mini program based on the account, user name and password assigned by the SIP contact center;

[0018] Sending SIP registration information to the SIP contact center based on the registration request;

[0019] receiving registration result information sent by the SIP contact center; and,

[0020] The registration result information is sent to the applet.

[0021] By adopting the above technical solution, the mini program is pre-registered, so when the mini program interacts with the agent, it is convenient for the agent to know the information of the mini program terminal.

[0022] Optionally, after the mini program is successfully registered, the following steps may also be included:

[0023] receiving a heartbeat message sent by the applet; and,

[0024] Based on the heartbeat information, it is determined whether the communication connection with the applet is successful; if not, the registration status of the applet is cancelled.

[0025] By adopting the above technical solution, the heartbeat message makes it easy to know whether and when the applet fails or terminates, thereby making it easy to judge whether to maintain the registration status of the applet.

[0026] Optionally, the method further includes:

[0027] After receiving a call applet request sent by a SIP contact center, sending a call request to a corresponding applet based on the call applet request; the call applet is received by the SIP contact center from an agent;

[0028] After the mini-program selects to answer the call, converting the received media stream sent by the mini-program into a media stream in a first file format supported by the SIP contact center, and sending the media stream in the first file format to the SIP contact center; the media stream in the first file format is used to trigger the SIP contact center to send the media stream in the first file format to the agent; and,

[0029] After the mini program chooses to answer the call, the media stream sent by the SIP contact center is converted into a media stream in a second file format supported by the mini program, and the media stream in the second file format is sent to the mini program; the media stream sent by the SIP contact center is sent by the agent to the SIP contact center.

[0030] By adopting the above technical solution, it is convenient for agents to directly contact the registered mini-programs.

[0031] Optionally, the method further includes:

[0032] After receiving the hang-up request sent by the mini-program terminal, sending a first hang-up message to the SIP contact center and stopping the conversion of the media stream; the first hang-up message is used to trigger the SIP contact center to send the hang-up message to the agent; or,

[0033] After receiving the hang-up request sent by the SIP contact center, a second hang-up message is sent to the applet, and the conversion of the media stream is stopped.

[0034] Optionally, converting the received media stream sent by the applet into a media stream of a first file format supported by the SIP contact center includes: converting the ACC-encoded voice information sent by the applet into a PCMA 8k RTP stream; converting the H264-encoded video information sent by the applet into an RTP stream;

[0035] Converting the media stream sent by the SIP contact center into a media stream in a second file format supported by the applet, including: converting the RTP stream of PCMA 8k into ACC-encoded voice information; converting the RTP stream into H264-encoded video information.

[0036] In a second aspect, the present application provides a system for implementing audio and video interaction between a mini program and a SIP contact center, which adopts the following technical solution.

[0037] A system for realizing audio and video interaction between a mini program and a SIP contact center, comprising:

[0038] A receiving module, configured to: after receiving a call seat request sent by the mini program, send a first SIP message to a SIP contact center according to the call seat request; the first SIP message is used to trigger the SIP contact center to assign the first SIP message to the seat;

[0039] a first media stream conversion module, configured to: after the agent answers the call, convert the received media stream sent by the applet into a media stream in a first file format supported by the SIP contact center, and send the media stream in the first file format to the SIP contact center; the media stream in the first file format is used to trigger the SIP contact center to send the media stream in the first file format to the agent; and

[0040] The second media stream conversion module is used to: convert the media stream sent by the SIP contact center into a media stream in a second file format supported by the mini-program, and send the media stream in the second file format to the mini-program; the media stream sent by the SIP contact center is sent by the agent to the SIP contact center.

[0041] In a third aspect, the present application discloses a computer device, including a memory and a server, wherein the memory stores a computer program that is loaded by the server and executes any of the above methods.

[0042] In a fourth aspect, the present application discloses a computer-readable storage medium storing a computer program that can be loaded by a server and execute any of the above methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 It is an exemplary system framework for applying a method of the present application to realize audio and video interaction between a mini program and a SIP contact center;

[0044] Figure 2 This is a flow chart of a method for realizing audio and video interaction between a mini program and a SIP contact center in the present application;

[0045] Figure 3It is a flowchart of the steps for registering a small program in this application;

[0046] Figure 4 It is a system framework of a system for realizing audio and video interaction between a mini program and a SIP contact center in an embodiment of the present application;

[0047] In the figure, 401 is a receiving module; 402 is a first media stream conversion module; 403 is a second media stream conversion module. DETAILED DESCRIPTION

[0048] In order to make the purpose, technical solutions and advantages of this application more clear, the following Figure 1-4 It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0049] Mini Programs have many instant applications, and are therefore favored by more and more users. In related technologies, Mini Programs do not support the UDP protocol as a media transmission channel, and the voice and video applications of Mini Programs only support the RTMP protocol based on TCP. At present, most of the enterprise SIP contact centers are based on the SIP architecture, so applications based on Mini Programs cannot achieve voice and video access to the SIP contact center through the standard SIP protocol.

[0050] In order to solve the above technical problems, the present application discloses a method for realizing audio and video interaction between a mini program and a SIP contact center.

[0051] Reference Figure 1 , Figure 1 An exemplary system architecture to which the method of the present application can be applied is shown. The system architecture may include a mini-program terminal, a protocol conversion gateway, a SIP contact center (also referred to as a call center), and an agent SIP terminal (referred to as an agent). It should be understood that Figure 1 The numbers are merely indicative; any number of mini-program terminals and any number of seats may be selected as required.

[0052] Reference Figure 2 As an implementation method of a method for realizing audio and video interaction between a mini program and a SIP contact center, the method is applied to a protocol conversion gateway, and the method includes the following steps:

[0053] Step 101: After receiving a call agent request sent by the mini program, send a first SIP message to a SIP contact center according to the call agent request; the first SIP message is used to trigger the SIP contact center to distribute the first SIP message to the agent.

[0054] Specifically, the user can initiate a call agent request to the protocol conversion gateway according to the called party (i.e., SIP contact center or agent) through the mini program terminal. After receiving the call agent request, the protocol conversion gateway sends a first SIP message to the SIP contact center according to the call agent request, and the SIP contact center assigns the first SIP message to the agent.

[0055] In one implementation manner of step 101, after receiving the call agent request, the protocol conversion gateway generates a SIP Invite message (i.e., a first SIP message) according to the calling number, called number, domain name and other information, and generates an SDP message body according to the IP of the machine where the protocol conversion gateway is located. Thereafter, the protocol conversion gateway sends the SIP Invite message to the SIP contact center; after receiving the SIP Invite message, the SIP contact center allocates an agent and sends the SIP Invite message to the allocated agent.

[0056] Step 102: After the agent answers the call, the media stream sent by the received applet is converted into a media stream in a first file format supported by the SIP contact center.

[0057] Specifically, since the voice and video formats supported by the mini program are different from those supported by the SIP contact center, after the agent answers the call, the media stream sent by the mini program needs to be converted into a media stream in the first format supported by the SIP contact center.

[0058] Step 103: Send the media stream in the first file format to the SIP contact center; the media stream in the first file format is used to trigger the SIP contact center to send the media stream in the first file format to the agent.

[0059] Specifically, the media stream in the first file format is sent to the SIP contact center. After receiving the media stream in the first file format, the SIP contact center sends it to the previously assigned seat, so that the agent can receive the video and audio sent by the mini program.

[0060] Step 104: After the agent answers the call, the media stream sent by the SIP contact center is converted into a media stream in a second file format supported by the applet. The media stream sent by the SIP contact center is sent by the agent to the SIP contact center.

[0061] Specifically, since the order in which the two parties send information during voice and video interaction is uncertain, the numerical order of step 104 and step 102 is not used to limit step 104 to be after step 102. After the media stream sent by the agent is received by the SIP contact center, the SIP contact center sends the media stream to the protocol conversion gateway, and the protocol conversion gateway converts the media stream sent by the SIP contact center into a media stream in the second file format.

[0062] Step 105: Send the media stream in the second file format to the mini program.

[0063] Specifically, the protocol conversion gateway converts the media stream sent by the SIP contact center into a media stream in the second file format, and sends the media stream to the mini program, so that the mini program can receive the voice and video information sent by the agent, thereby realizing the voice and video data interaction between the mini program and the agent.

[0064] As another implementation method of a method for realizing audio and video interaction between a mini program and a SIP contact center, converting a media stream sent by a received mini program into a media stream of a first file format supported by the SIP contact center includes: converting ACC-encoded voice information sent by the mini program into a PCMA 8k RTP stream; converting H264-encoded video information sent by the mini program into an RTP stream;

[0065] Convert the media stream sent by the SIP contact center into a media stream in the second file format supported by the applet, including: converting the RTP stream of PCMA 8k into ACC-encoded voice information; converting the RTP stream into H264-encoded video information.

[0066] Specifically, after the agent is connected, the protocol conversion gateway starts to establish a media transmission channel. The mini program terminal pushes the collected media streams (voice, video) to the protocol conversion gateway through the live-pusher component (depending on the different media stream collection components supported by the mini program, the live-pusher component can also be replaced by other media stream collection components). At the same time, the mini program terminal receives and plays the media streams sent by the protocol conversion gateway through the live-player component (depending on the different audio and video playback components supported by the mini program, the live-player component can be replaced by other audio and video playback components).

[0067] In one implementation mode, if the voice encoding supported by the mini program is AAC, and the video encoding supported by the mini program is H264; because the SIP switch of the SIP contact center does not support AAC encoding, and the voice data packet transmission protocol of the SIP switch is RTP, in order to realize the voice and video interaction between the mini program and the agent, the protocol conversion gateway needs to realize the mutual conversion of RTMP data stream to RTP protocol, and at the same time, it needs to convert AAC voice encoding and voice PCMA encoding.

[0068] The mini program pushes the collected media streams (voice, video) to the protocol conversion gateway through the live-pusher component. After receiving the media stream sent by the mini program, the protocol conversion gateway converts the AAC format voice stream into the PCMA 8k RTP stream and sends the PCMA8k RTP stream to the SIP switch of the SIP contact center. The protocol conversion gateway directly converts the H264 format video stream into the RTP stream and sends the RTP stream to the SIP switch of the SIP contact center. The protocol conversion gateway can send the server RTP ip and port in the SIP 200OK SDP message through the UDP protocol. At the same time, the protocol conversion gateway needs to monitor the RTP media stream sent from the SIP switch of the SIP contact center. The voice codec sent by the SIP contact center is PCMA8k. At this time, the protocol conversion gateway needs to convert the media stream into the RTMP protocol media stream and push the converted media stream to the RTMP:url2 address. The mini program terminal monitors the media stream from RTMP:url2 through the live-player component, so as to play the voice sent by the agent on the mini program terminal, thereby realizing voice interaction. Since the call in the video information contains voice information, if the SIP switch supports H264 encoding, there is no need to transcode the video information. The protocol conversion gateway merges the voice stream and the video stream into an RTMP stream and pushes it to the mini program, thereby realizing video interaction.

[0069] As another implementation of a method for realizing audio and video interaction between a mini program and a SIP contact center, after sending the first SIP message to the SIP contact center, the method further includes the following steps:

[0070] Receiving agent status information sent by the SIP contact center; the agent status information is sent by the SIP contact center according to the agent's response status after the agent receives the first SIP message; and,

[0071] Send agent status information to the applet.

[0072] Specifically, after receiving the call agent request, the protocol conversion gateway creates a SIP Invite message, and then sends the SIP Invite message to the SIP contact center; after receiving the SIP Invite message, the SIP contact center assigns an agent and sends the SIP Invite message to the assigned agent. The protocol conversion gateway forwards the corresponding status information to the mini program through a websocket message based on the status of the agent's response (ringing, answering, hanging up, etc.). If the mini program call fails, the protocol conversion gateway sends the corresponding error code (such as the number does not exist, the called party is not answered, etc.) to the mini program, and the mini program terminal displays the status of the call based on the agent status information sent by the protocol conversion gateway, so that the mini program terminal can know the current communication status.

[0073] As another implementation method of a method for realizing audio and video interaction between a mini program and a SIP contact center, the mini program is pre-registered. The mini program registration step includes the following steps:

[0074] Step 201: Receive a registration request sent by the mini program; the registration request is generated by the mini program based on the account, user name and password assigned by the SIP contact center;

[0075] Step 202: Send SIP registration information to the SIP contact center based on the registration request;

[0076] Step 203: receiving registration result information sent by the SIP contact center; and,

[0077] Step 204: Send the registration result information to the mini program.

[0078] Specifically, the mini program generates a registration request based on the account number assigned by the SIP contact center, the set user name, and the set password. The mini program sends the registration request to the protocol conversion gateway through websocket. After receiving the registration request, the protocol conversion gateway creates a new SIP UAC object to form the SIP registration information of the extension account and password (i.e., SIP Register message), and then the protocol conversion gateway sends the SIP registration information to the SIP switch of the SIP contact center through the SIP UDP protocol. The protocol conversion gateway receives the registration result information sent by the SIP contact center, and forwards the registration result information to the mini program terminal through a websocket message. The mini program displays the registration success or failure in the mini program terminal based on the registration result.

[0079] As another implementation method of a method for realizing audio and video interaction between a mini program and a SIP contact center, after the mini program is successfully registered, the method further includes:

[0080] Receive heartbeat messages sent by the applet; and,

[0081] Based on the heartbeat information, determine whether the communication connection with the applet is successful; if not, cancel the registration status of the applet.

[0082] Specifically, a successfully registered applet needs to regularly send heartbeat messages to the protocol conversion gateway to keep the websocket connection open. A heartbeat message is a message sent from a source to a receiver, which allows the receiver to determine whether and when the source fails or terminates. The protocol conversion gateway will save the verification credentials when the user registers. If the heartbeat message sent by the applet is not interrupted, the protocol conversion gateway will regularly send SIPRegister requests to the applet. When the protocol conversion gateway detects that the applet is disconnected, it will automatically send an UnRegister request to the SIP switch to cancel the registration status of the applet terminal.

[0083] As another implementation method of a method for realizing audio and video interaction between a mini program and a SIP contact center, a method for realizing audio and video interaction between a mini program and a SIP contact center also includes:

[0084] After receiving the call applet request sent by the SIP contact center, a call request is sent to the corresponding applet based on the call applet request; the call applet is received by the SIP contact center from the agent;

[0085] After the mini program chooses to answer the call, convert the media stream sent by the mini program into a media stream in a first file format supported by the SIP contact center, and send the media stream in the first file format to the SIP contact center; the media stream in the first file format is used to trigger the SIP contact center to send the media stream in the first file format to the agent; and,

[0086] After the mini program chooses to answer the call, the media stream sent by the SIP contact center is converted into a media stream in a second file format supported by the mini program, and the media stream in the second file format is sent to the mini program; the media stream sent by the SIP contact center is sent by the agent to the SIP contact center.

[0087] Specifically, for successfully registered mini-program terminals, the agents of the SIP contact center can actively call the mini-program. The protocol conversion gateway receives the mini-program call request (Invite request) from the SIP contact center, converts the mini-program call request into a call request (i.e., an incoming call ringing request), and sends the call request to the mini-program terminal through the websocket protocol. After receiving the call request, the mini-program terminal will pop up a screen to let the user choose to connect or reject. If the mini-program terminal connects, the mini-program starts to call the live-player component and the live-pusher component to receive and send media streams. The media stream conversion process is consistent with the process of the agent calling into the SIP contact center as the caller, and will not be repeated here. This setting facilitates the agent to interact with the registered mini-programs through voice and video.

[0088] As another implementation method of a method for realizing audio and video interaction between a mini program and a SIP contact center, after receiving a hang-up request sent by a mini program terminal, a first hang-up message is sent to the SIP contact center, and the conversion of the media stream is stopped; the first hang-up message is used to trigger the SIP contact center to send the hang-up message to the agent; or,

[0089] After receiving the hang-up request sent by the SIP contact center, a second hang-up message is sent to the applet, and the conversion of the media stream is stopped.

[0090] Specifically, when an agent or a mini-program sends a hang-up request, the hang-up request will be converted into information of the corresponding communication protocol through the protocol conversion gateway. For example, when the agent sends a hang-up request, the protocol conversion gateway converts the hang-up request into information of the websocket protocol and then sends the information to the mini-program terminal, while shutting down the transmission of RTP messages and RTMP media streams. When the mini-program terminal sends a hang-up request, the protocol conversion gateway converts the hang-up request into information of the SIP protocol and sends the information to the SIP switch, while shutting down the transmission of RTP messages and RTMP media streams.

[0091] Reference Figure 4 , the present application also provides a system for realizing audio and video interaction between a mini program and a SIP contact center, including:

[0092] The receiving module 401 is used to: after receiving the call seat request sent by the mini program, send the first SIP information to the SIP contact center according to the call seat request; the first SIP information is used to trigger the SIP contact center to assign the first SIP information to the seat;

[0093] The first media stream conversion module 402 is used to: after the agent answers the call, convert the media stream sent by the mini-program into a media stream in a first file format supported by the SIP contact center, and send the media stream in the first file format to the SIP contact center; the media stream in the first file format is used to trigger the SIP contact center to send the media stream in the first file format to the agent; and

[0094] The second media stream conversion module 403 is used to convert the media stream sent by the SIP contact center into a media stream in a second file format supported by the mini-program, and send the media stream in the second file format to the mini-program; the media stream sent by the SIP contact center is sent by the agent to the SIP contact center.

[0095] The embodiment of the present application also discloses a computer device.

[0096] Specifically, the device includes a memory and a server, and the memory stores a computer program that can be loaded by the server and execute any one of the above methods for realizing audio and video interaction between the mini program and the SIP contact center.

[0097] The embodiment of the present application also discloses a computer-readable storage medium.

[0098] Specifically, the computer-readable storage medium stores a computer program that can be loaded by the server and execute any of the above methods for implementing audio and video interaction between the mini program and the SIP contact center. The computer-readable storage medium includes, for example, various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0099] The above are all preferred embodiments of the present application, and are not intended to limit the protection scope of the present application. Any feature disclosed in this specification (including the abstract and drawings), unless otherwise stated, can be replaced by other equivalent or alternative features with similar purposes. That is, unless otherwise stated, each feature is only an example of a series of equivalent or similar features.

Claims

1. A method for realizing audio and video interaction between a mini program and a SIP contact center, characterized in that: include: After receiving the call agent request sent by the mini program, sending a first SIP message to the SIP contact center according to the call agent request; The first SIP information is used to trigger the SIP contact center to distribute the first SIP information to the agent; Specifically, after receiving the call agent request, the protocol conversion gateway generates a SIP Invite message according to the calling number, the called number, and the domain name. The SIP Invite message is the first SIP information. At the same time, the SDP message body is generated according to the IP of the machine where the protocol conversion gateway is located. After that, the protocol conversion gateway sends the SIP Invite message to the SIP contact center; After receiving the SIP Invite message, the SIP contact center assigns an agent and sends the SIP Invite message to the assigned agent; After sending the first SIP message to the SIP contact center, the method further includes: receiving agent status information sent by the SIP contact center; the agent status information is sent by the SIP contact center according to the response status of the agent after the agent receives the first SIP message; and sending the agent status information to the mini program; After the agent answers the call, converting the received media stream sent by the applet into a media stream in a first file format supported by the SIP contact center; sending the media stream in the first file format to the SIP contact center; the media stream in the first file format is used to trigger the SIP contact center to send the media stream in the first file format to the previously assigned seat; and, After the agent answers the call, the media stream sent by the SIP contact center is converted into a media stream in a second file format supported by the applet, and the media stream in the second file format is sent to the applet; the media stream sent by the SIP contact center is sent by the agent to the SIP contact center; The method further comprises: After receiving a call applet request sent by the SIP contact center, sending a call request to the corresponding applet based on the call applet request; the call applet request is received by the SIP contact center from the agent; After the mini-program selects to answer the call, converting the received media stream sent by the mini-program into a media stream in a first file format supported by the SIP contact center, and sending the media stream in the first file format to the SIP contact center; the media stream in the first file format is used to trigger the SIP contact center to send the media stream in the first file format to the agent; and, After the mini program chooses to answer the call, the media stream sent by the SIP contact center is converted into a media stream in a second file format supported by the mini program, and the media stream in the second file format is sent to the mini program; the media stream sent by the SIP contact center is sent by the agent to the SIP contact center; Specifically, for the mini program terminal that has successfully registered, the agent of the SIP contact center actively calls the mini program; the protocol conversion gateway receives the mini program call request from the SIP contact center, converts the mini program call request into a call request, that is, an incoming call ringing request, and sends the call request to the mini program terminal through the websocket protocol. After receiving the call request, the mini program terminal will pop up a screen to let the user choose to connect or reject. If the mini program terminal connects, the mini program starts to call the liveplayer component and the livepusher component to receive and send media streams; The mini program is pre-registered, and the mini program registration steps include: receiving a registration request sent by the mini program; the registration request is generated by the mini program based on the account, user name and password assigned by the SIP contact center; Sending SIP registration information to the SIP contact center based on the registration request; receiving registration result information sent by the SIP contact center; and, The registration result information is sent to the applet.

2. The method according to claim 1, characterized in that After the mini program is successfully registered, it also includes: receiving a heartbeat message sent by the applet; and, Based on the heartbeat message, it is determined whether the communication connection with the applet is successful; if not, the registration status of the applet is cancelled.

3. The method according to claim 1, characterized in that The method further comprises: After receiving the hang-up request sent by the mini-program terminal, sending a first hang-up message to the SIP contact center and stopping the conversion of the media stream; the first hang-up message is used to trigger the SIP contact center to send the hang-up message to the agent; or, After receiving the hang-up request sent by the SIP contact center, a second hang-up message is sent to the applet, and the conversion of the media stream is stopped.

4. The method according to claim 1, characterized in that: Converting the received media stream sent by the applet into a media stream of a first file format supported by the SIP contact center, including: converting the ACC-encoded voice information sent by the applet into a PCMA 8k RTP stream; converting the H264-encoded video information sent by the applet into an RTP stream; Converting the media stream sent by the SIP contact center into a media stream in a second file format supported by the applet, including: converting the RTP stream of PCMA 8k into ACC-encoded voice information; converting the RTP stream into H264-encoded video information.

5. A system for realizing audio and video interaction between a mini program and a SIP contact center, characterized in that: The method according to any one of claims 1 to 4 comprises: A receiving module, configured to: after receiving a call seat request sent by the mini program, send a first SIP message to a SIP contact center according to the call seat request; the first SIP message is used to trigger the SIP contact center to assign the first SIP message to the seat; a first media stream conversion module, configured to: after the agent answers the call, convert the received media stream sent by the applet into a media stream in a first file format supported by the SIP contact center, and send the media stream in the first file format to the SIP contact center; the media stream in the first file format is used to trigger the SIP contact center to send the media stream in the first file format to the agent; and The second media stream conversion module is used to: convert the media stream sent by the SIP contact center into a media stream in a second file format supported by the mini-program, and send the media stream in the second file format to the mini-program; the media stream sent by the SIP contact center is sent by the agent to the SIP contact center.

6. A computer device, characterized in that: The method comprises a memory and a server, wherein the memory stores a computer program according to any one of the methods of claims 1 to 4 which is loaded and executed by the server.

7. A computer-readable storage medium, characterized in that: A computer program is stored which can be loaded by a server and execute the method according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Self-help system and equipment for realizing AV (audio / video) integration

    CN102306430A

  • Signaling transmission method and system

    CN106921613A

  • Call service processing method and device, computer storage medium and electronic equipment

    CN110475029A

  • Request and call separated distributed call center system

    CN110636177A

  • Multi-channel data integration interaction method and device, equipment and storage medium

    CN110740217A