Chat connection system, method, apparatus, device and storage medium

Abstract

The present disclosure provides a chat connection system, method, apparatus, device and storage medium, in which a chat connection invitee receives a chat connection request from a chat connection inviter via a chat connection business server, and pushes audio / video streams to a real-time collaboration RTC server upon receiving a chat connection acceptance operation for the chat connection request.The chat connection inviter pushes audio / video streams to the RTC server upon receiving a notification message from the RTC server indicating that the chat connection room has been successfully joined.

Description

[Technical Field]

[0001] (Related Applications) This application claims priority to a Chinese patent application filed on June 15, 2021, with application number 202110660881.X and title "Chat connection system, method, apparatus, device and storage medium," the entire contents of which are incorporated herein by reference. (Technical field) The present disclosure relates to the field of data processing, and in particular to chat connection systems, methods, apparatus, devices and storage media. [Background technology]

[0002] In webcasting features, chat connections have become a common form of live broadcasting, typically referring to real-time communication exchanges between hosts or between hosts and viewers via methods such as video calls. Summary of the Invention

[0003] To solve all or at least some of the above technical problems, the present disclosure provides a chat connection system, method, apparatus, device and storage medium.

[0004] According to a first aspect, the present disclosure provides a chat connection system, the system comprising: a chat connection business server; a chat connection inviter; and a chat connection invitee; The chat connection invitee receives a chat connection request from the chat connection inviter via the chat connection business server, and upon receiving a chat connection acceptance operation for the chat connection request, pushes an audio / video stream to a real-time collaboration RTC server; After receiving a response message to the chat connection request from the chat connection business server, the chat connection inviting party sends a request to join the chat connection room to the RTC server, and upon receiving a notification message from the RTC server that the chat connection room has been successfully joined, the chat connection inviting party is used to push an audio / video stream to the RTC server.

[0005] In an alternative embodiment, the chat connection invitee is further used to start rendering the audio / video stream pushed by the chat connection inviter upon receiving a chat connection accept operation for the chat connection request.

[0006] In an alternative embodiment, the chat connection invitee is further used to send a cancel instruction message to the RTC server when receiving a chat connection request from the chat connection inviter via the chat connection business server, and to send a cancel instruction message to the RTC server when receiving a chat connection acceptance operation for the chat connection request via the chat connection business server; Here, the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party, and the cancel stop instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party.

[0007] In an alternative embodiment, the system further comprises the RTC server; The RTC server is used to store the audio / video stream pushed by the chat connection inviting party, and upon receiving the stop instruction message from the chat connection invited party, stop sending the audio / video stream to the chat connection invited party, and upon receiving the stop instruction message from the chat connection invited party, start sending the audio / video stream to the chat connection invited party.

[0008] In an alternative embodiment, the chat connection inviting party is further used to send a first concatenation instruction message to the RTC server upon receiving a chat connection acceptance response to the chat connection request from the chat connection invited party via the chat connection business server, wherein the first concatenation instruction message is used to indicate concatenation on.

[0009] In an alternative embodiment, the chat connection invitee is further used to send a second concatenation instruction message to the RTC server upon receiving a chat connection acceptance operation for the chat connection request, wherein the second concatenation instruction message is used to indicate concatenation on.

[0010] In an alternative embodiment, both the chat connection invitee and the chat connection inviter Live Streaming Device is.

[0011] According to a second aspect, the present disclosure provides a chat connection method, the chat connection method comprising: Sending a chat connection request from the chat connection inviting party to the chat connection invited party via the chat connection business server; When the chat connection invitee receives a chat connection acceptance operation for the chat connection request, the chat connection invitee pushes the audio / video stream to a real-time collaboration RTC server; After the chat connection inviting party receives a response message to the chat connection request from the chat connection business server, the chat connection inviting party sends a request to join the chat connection room to the RTC server, and when the chat connection inviting party receives a notification message from the RTC server indicating that the chat connection room has been successfully joined, pushes an audio / video stream to the RTC server.

[0012] According to a third aspect, the present disclosure provides a chat connection method, which is applied to a chat connection inviter, and the method includes: sending a chat connection request to the chat connection invitee via the chat connection business server; After receiving a response message to the chat connection request from the chat connection business server, sending a request to join a chat connection room to a real-time collaboration RTC server, and upon receiving a notification message from the RTC server indicating that joining the chat connection room has been successful, pushing an audio / video stream to the RTC server.

[0013] In an alternative embodiment, the method comprises: The method further includes sending a first concatenation instruction message to the RTC server upon receiving a chat connection acceptance response to the chat connection request from the chat connection invitee via the chat connection business server, wherein the first concatenation instruction message is used to instruct concatenation on.

[0014] According to a fourth aspect, the present disclosure provides a chat connection method, which is applied to a chat connection invitee, and the method includes: receiving a chat connection request from a chat connection inviter via a chat connection business server; When a chat connection acceptance operation is received for the chat connection request, the audio / video stream is pushed to a real-time collaboration RTC server.

[0015] In an alternative embodiment, the method comprises: The method further includes, upon receiving a chat connection acceptance operation for the chat connection request, starting to render the audio / video stream pushed by the chat connection inviter.

[0016] In an alternative embodiment, the method comprises: Upon receiving a chat connection request from the chat connection inviting party, sending a stop instruction message to the RTC server, wherein the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party; The method further includes sending an unsuspend instruction message to the RTC server upon receiving a chat connection acceptance operation for the chat connection request, wherein the unsuspend instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviter to the chat connection invitee.

[0017] In an alternative embodiment, the method comprises: The method further includes sending a second concatenation instruction message to the RTC server upon receiving a chat connection acceptance operation for the chat connection request, wherein the second concatenation instruction message is used to indicate concatenation on.

[0018] According to a fifth aspect, the present disclosure provides a chat connection device, the device comprising: a first sending module used to send a chat connection request to a chat connection invitee via a chat connection business server; a second sending module, which is used to send a request to join a chat connection room to a real-time collaboration RTC server after receiving a response message to the chat connection request from the chat connection business server; and a first push module, which is used to push an audio / video stream to the RTC server upon receiving a notification message from the RTC server indicating that the user has successfully joined the chat connection room.

[0019] According to a sixth aspect, the present disclosure provides a chat connection device, the device comprising: a first receiving module used to receive a chat connection request from a chat connection inviting party via a chat connection business server; and a second push module used to push the audio / video stream to the real-time collaboration RTC server upon receiving a chat connection acceptance operation for the chat connection request.

[0020] According to a seventh aspect, the present disclosure provides a computer-readable storage medium having instructions stored thereon that, when executed on a computing device, cause the computing device to perform the above-described method.

[0021] According to an eighth aspect, the present disclosure provides an apparatus including a memory, a processor, and a computer program stored in the memory, the apparatus performing the above method when the processor executes the computer program.

[0022] According to a ninth aspect, the present disclosure provides a computer program product, including computer programs / instructions, which, when executed by a processor, realize the chat connection method described in the embodiments of the present disclosure. [Brief explanation of the drawings]

[0023] The accompanying drawings herein, which are incorporated in and constitute a part of the specification, illustrate embodiments consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure.

[0024] In order to more clearly describe the technical solutions in the embodiments of the present disclosure or the prior art, the following briefly describes the drawings that need to be used in the description of the embodiments or the prior art, and obviously, those skilled in the art can obtain other drawings based on these drawings without any creative work. [Figure 1] 1 is a schematic diagram of data interaction during a current webcasting chat connection method. [Figure 2] FIG. 2 is a diagram of a signaling interaction in a chat connection system provided by an embodiment of the present disclosure. [Figure 3] 1 is a schematic structural diagram of a chat connection system provided by an embodiment of the present disclosure; [Figure 4] 1 is a flowchart of a chat connection method provided by an embodiment of the present disclosure. [Figure 5] 1 is a flowchart of another chat connection method provided by an embodiment of the present disclosure. [Figure 6] 10 is a flowchart of yet another chat connection method provided by an embodiment of the present disclosure. [Figure 7] 1 is a schematic structural diagram of a chat connection device provided by an embodiment of the present disclosure; [Figure 8] FIG. 2 is a schematic structural diagram of another chat connection device provided by an embodiment of the present disclosure; [Figure 9] 1 is a schematic structural diagram of a chat connection device provided by an embodiment of the present disclosure; DETAILED DESCRIPTION OF THE INVENTION

[0025] In order to more clearly understand the above objectives, features and advantages of the present disclosure, the solutions of the present disclosure are further described below. It should be noted that, unless contradictory, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0026] In the following description, numerous specific details are set forth to provide a thorough understanding of the present disclosure; however, the present disclosure may be practiced in other ways different from those described herein, and it is apparent that the embodiments herein are merely some, but not all, of the present disclosure.

[0027] In webcasting, real-time communication between presenters or between presenters and viewers via a method such as video calling is also called a chat connection.

[0028] The efficiency of a chat connection is one of the important factors that affect the experience of users participating in a chat connection, and in particular, users who are invited to a chat connection expect to be able to enter the communication dialogue interface of the two-way chat connection as quickly as possible after actively clicking to accept the chat connection invitation. Therefore, one effective way to improve users' chat connection experience is to minimize the waiting time after the user who is invited to a chat connection accepts the chat connection invitation.

[0029] Currently, after triggering the chat connection invitation acceptance operation, the user of the chat connection invitee needs to wait for a response message from the chat connection business server, push the audio / video stream to the real-time collaboration RTC server, and then wait for the first frame of the chat connection inviter to be pulled from the real-time collaboration RTC server, thereby realizing the chat connection between the two parties.

[0030] Currently, in a webcasting chat connection method, after a user on the chat connection invitee side clicks to accept a chat connection invitation, the chat connection invitee side triggers a reply request to be sent to the chat connection business server. Only after the chat connection invitee side receives a relay response to the reply request from the chat connection business server does the chat connection invitee side begin to push audio / video streams to the RTC server. Only after the chat connection invitee side pulls the first frame of the chat connection inviter from the real-time collaboration RTC server does the chat connection between the two sides become a reality. As such, it can be seen that the period between the chat connection invitee side accepting the chat connection invitation operation and the chat connection inviter side pulling the first frame is long, which increases the waiting time of the user on the chat connection invitee side and negatively impacts the user's chat connection experience.

[0031] Taking a chat connection between casters as an example, Figure 1 shows a schematic diagram of data interaction in a current webcasting chat connection method. Here, Caster A sends a chat connection request (invite message) to Caster B through the chat connection business server. After Caster B receives the chat connection request from the chat connection business server, he can trigger a chat connection acceptance operation in response to the chat connection request. When Caster B receives the chat connection acceptance operation, he sends a chat connection acceptance message (reply request) to the chat connection business server. When Caster B receives a reply message (reply response) from the chat connection business server to the chat connection acceptance message, Caster B starts pushing audio / video streams to the RTC server and sends a concatenation-on instruction to the RTC server to instruct the RTC server to open concatenation.

[0032] Caster A sends a chat connection request to Caster B via the chat connection business server, and after receiving a response message (invite response) returned from the chat connection business server, begins entering the chat connection virtual room of the RTC server. After Caster B receives the chat connection acceptance operation, he sends a chat connection acceptance message (reply request) to the chat connection business server, and the chat connection business server forwards a chat connection acceptance notification message (reply message) in response to the chat connection acceptance message to Caster A. When Caster A receives the chat connection acceptance notification message from the chat connection business server, he starts pushing audio / video streams to the RTC server and simultaneously sends a concatenation on command to the RTC server, instructing the RTC server to start concatenation.

[0033] After Caster B triggers the chat connection acceptance operation, he waits for a relay response from the chat connection business server, and only after receiving the relay response does he start pushing to the RTC server, and only after pulling the audio / video stream of the other party from the RTC server can the chat connection between the two parties be realized. Therefore, the period between Caster B triggering the chat connection acceptance operation and the chat connection between the two parties is long, which negatively impacts Caster B's chat connection experience.

[0034] For this reason, an embodiment of the present disclosure provides a chat connection system. Referring to FIG. 2, a signaling dialogue diagram in the chat connection system provided by the embodiment of the present disclosure is shown. In this diagram, the chat connection invitee (caster B) starts pushing audio / video streams to the RTC server immediately after receiving the chat connection acceptance operation, so that caster B can push early to the RTC server. Also, the chat connection inviter (caster A) starts pushing audio / video streams to the RTC server immediately after receiving a notification message that he / she has successfully joined the chat connection room. When caster B pushes to the RTC server, he / she can pull the first frame of caster A's audio / video stream from the RTC server, and the chat connection between the two parties can be realized.

[0035] As can be seen from this, in the chat connection system provided by the embodiment of the present disclosure, both caster A and caster B can be pushed to the RTC server early, which shortens the period from when caster B triggers the chat connection acceptance operation to when the two parties are chat connected, thereby shortening the first frame elapsed time for caster B and improving caster B's chat connection experience.

[0036] Based on this, an embodiment of the present disclosure provides a chat connection system. Referring to FIG. 3, there is shown a structural schematic diagram of the chat connection system provided by the embodiment of the present disclosure. Here, the chat connection system 300 includes a chat connection business server 301, a chat connection inviting party 302, and a chat connection invited party 303; The chat connection invitee 303 receives a chat connection request from the chat connection inviter 302 via the chat connection business server 301, and upon receiving a chat connection acceptance operation for the chat connection request, is used to push an audio / video stream to the real-time collaboration RTC server.

[0037] After receiving a response message to the chat connection request from the chat connection business server 301, the chat connection inviting party 302 sends a request to join the chat connection room to the RTC server, and when it receives a notification message from the RTC server that the chat connection room has been successfully joined, it is used to push an audio / video stream to the RTC server.

[0038] In an embodiment of the present disclosure, the chat connection request is used to request the chat connection invitee to accept the chat connection invitation from the chat connection inviter. Specifically, the chat connection inviter sends a chat connection request to the chat connection invitee through the chat connection business server, requesting the chat connection invitee to accept the chat connection invitation.

[0039] After the chat connection invitee receives the chat connection request, it can trigger a chat connection acceptance operation or a chat connection rejection operation in response to the chat connection request. When the chat connection invitee receives the chat connection acceptance operation triggered in response to the chat connection request from the chat connection invitee, the chat connection invitee sends a chat connection acceptance message to the chat connection business server and simultaneously starts pushing audio / video streams to the real-time collaboration RTC server.

[0040] In this way, the chat connection invitee in the embodiment of the present disclosure does not need to wait for a response message to the chat connection acceptance message from the chat connection business server, and can push to the RTC server and can push early. In this case, if the chat connection invitee can pull the audio / video stream of the opposite party, the chat connection invitee can realize a quick chat connection after triggering the chat connection acceptance operation, and the user experience is improved.

[0041] In an embodiment of the present disclosure, a chat connection inviter sends a chat connection request to a chat connection business server, and after receiving a response message indicating that the chat connection request has been successfully received, the chat connection inviter sends a chat connection room join request to the RTC server and applies to join the chat connection virtual room. Once the chat connection inviter receives a notification message from the RTC server indicating that the chat connection room join has been successful, indicating that the chat connection inviter has joined the chat connection virtual room, the chat connection inviter can start pushing audio / video streams to the RTC server.

[0042] In this way, in an embodiment of the present disclosure, the chat connection inviting party can push to the RTC server without having to wait for a chat connection acceptance notification message in response to a chat connection request from the chat connection business server, and the timing of pushing the audio / video stream from the chat connection inviting party to the RTC can be advanced.

[0043] In the embodiment of the present disclosure, the chat connection inviting party will push audio / video streams to the RTC server immediately after receiving a notification message that the party has successfully joined the chat connection room. Therefore, when the chat connection invited party receives a chat connection acceptance operation for the chat connection request, the chat connection invited party can not only push to the RTC server, but also pull the audio / video streams of the chat connection inviting party from the RTC server, thereby shortening the latency of the first frame of the chat connection invited party and improving the chat connection experience of the user of the chat connection invited party.

[0044] In addition, the chat connection inviting party advances the timing of pushing to the RTC server, so that after the chat connection invited party pushes to the RTC server, the chat connection inviting party can pull the opposite party's audio / video stream from the RTC server, which similarly shortens the waiting time for the first frame on the chat connection inviting party and improves the user's chat connection experience on the chat connection inviting party.

[0045] In actual applications, when the chat connection inviting party receives a notification message indicating that the party has successfully joined the chat connection room, it may start pushing audio / video streams to the RTC server, and the chat connection invited party may receive the audio / video streams from the chat connection inviting party before receiving the chat connection acceptance operation, i.e., before the chat connection invited party agrees to the chat connection, resulting in a poor user experience for the chat connection invited party.

[0046] For this reason, the chat connection system provided by the embodiment of the present disclosure requires functional optimization for the above content, and in an optional embodiment, if the chat connection invitee does not receive a chat connection acceptance operation in response to the chat connection request, the chat connection invitee mutes the audio / video stream of the opposite party pulled by the chat connection invitee. Specifically, if the chat connection invitee does not receive a chat connection acceptance operation in response to the chat connection request, the chat connection invitee does not render the audio / video stream pulled by the chat connection inviter, but if the chat connection accept operation in response to the chat connection request is received, the chat connection is realized by rendering the audio / video stream pushed by the chat connection inviter.

[0047] In this way, in the embodiment of the present disclosure, the chat connection invitee starts rendering the audio / video stream pushed by the chat connection inviter only when the chat connection invitee receives a chat connection acceptance operation for the chat connection request, thereby avoiding the chat connection invitee from rendering the audio / video stream of the chat connection inviter when the chat connection invitee does not agree to the chat connection, and improving the user chat connection experience of the chat connection inviter.

[0048] In the above embodiment, the audio / video stream of the chat connection inviting party pulled early by the chat connection invited party occupies resources of the chat connection invited party, such as bandwidth and CPU resources, which may cause lag or other issues on the chat connection invited party, negatively affecting the user experience of the chat connection invited party. Therefore, the embodiment of the present disclosure also provides a function optimization method.

[0049] Specifically, when the chat connection invitee receives a chat connection request from the chat connection inviting party, it sends a stop instruction message to the RTC server to instruct the RTC server to stop transmitting the audio / video stream pushed by the chat connection inviting party to the chat connection invitee. Also, when the chat connection invitee receives a chat connection accept operation for the chat connection request, it sends a cancel stop instruction message to the RTC server to instruct the RTC server to start transmitting the audio / video stream pushed by the chat connection inviting party to the chat connection invitee.

[0050] Correspondingly, in order to realize the above-mentioned function optimization method, an embodiment of the present disclosure further provides a chat connection system, which, in addition to a chat connection business server, a chat connection inviter and a chat connection invitee, further includes an RTC server having a frame accumulation function.

[0051] Specifically, the RTC server is used to store the audio / video stream pushed by the chat connection inviting party, and upon receiving the stop instruction message from the chat connection invited party, stop sending the audio / video stream to the chat connection invited party, and upon receiving the stop instruction message from the chat connection invited party, start sending the audio / video stream to the chat connection invited party.

[0052] The RTC server in the above embodiment stores the audio / video streams pushed by the chat connection inviting party through a frame accumulation function, and transmits the audio / video streams to the chat connection invited party only when it receives a cancellation instruction message from the chat connection invited party, thereby realizing the chat connection. Therefore, in the embodiment of the present disclosure, there is no need to occupy the resources of the chat connection invited party, which can avoid the lag phenomenon caused by this on the chat connection invited party and improve the user experience of the chat connection invited party.

[0053] In addition, the RTC server further has a concatenation function, specifically, it is used to concatenate audio / video streams pushed by the chat connection invitee and the chat connection inviter to obtain audio / video concatenation, and the audio / video concatenation can be displayed and used in the live broadcast room where the chat connection invitee or the chat connection inviter is located.

[0054] In an embodiment of the present disclosure, when the chat connection inviting party receives a chat connection acceptance response to the chat connection request of the chat connection invitee through the chat connection business server, the chat connection inviting party further sends a first concatenation instruction message to the RTC server, which is used to instruct the RTC server to concatenate the audio / video streams pushed by the chat connection inviting party and the chat connection invitee. Here, the audio / video concatenation obtained based on the first concatenation instruction message is displayed and used in the live broadcast room where the chat connection inviting party is located.

[0055] In this way, the chat connection inviting party in the chat connection system provided by the embodiment of the present disclosure separates the timing of pushing to the RTC server and the timing of instructing concatenation on, and advances the timing of pushing to the RTC server but maintains the timing of sending the first concatenation instruction message to the RTC server, that is, still sends the first concatenation instruction message to the RTC server upon receiving a chat connection acceptance response.By the chat connection inviting party pushing early, the period from when the chat connection inviting party receives a chat connection acceptance response to when the chat connection is established is shortened, so the embodiment of the present disclosure can also shorten the first frame waiting time of the chat connection inviting party.

[0056] In addition, the chat connection invitee is further used to send a second concatenation instruction message to the RTC server when receiving a chat connection acceptance operation for the chat connection request, where the second concatenation instruction message is used to indicate concatenation on.

[0057] In the embodiment of the present disclosure, when the chat connection invitee receives a chat connection acceptance operation for the chat connection request, the chat connection invitee sends a second concatenation instruction message to the RTC server. Specifically, the audio / video concatenation obtained based on the second concatenation instruction message is displayed and used in the live broadcast room where the chat connection invitee is located.

[0058] Based on the chat connection system in the above embodiment, the present disclosure provides a chat connection method. Referring to FIG. 4, there is shown a flowchart of the chat connection method provided by the embodiment of the present disclosure, where the method is applied to the above chat connection system, the chat connection system including a chat connection business server, a chat connection inviting party, and a chat connection invited party, and the chat connection method includes the following steps:

[0059] S401: A chat connection request is sent from the chat connection inviting party to the chat connection invited party via the chat connection business server.

[0060] S402: When the chat connection invitee receives a chat connection acceptance operation for the chat connection request, the chat connection invitee pushes the audio / video stream to the real-time collaboration RTC server.

[0061] S403: After the chat connection inviting party receives a response message to the chat connection request from the chat connection business server, it sends a request to join the chat connection room to the RTC server, and upon receiving a notification message from the RTC server that the party has successfully joined the chat connection room, it pushes an audio / video stream to the RTC server.

[0062] In the chat connection method provided by the embodiment of the present disclosure, the chat connection invitee pushes audio / video to the RTC server immediately after receiving the chat connection acceptance operation, and the chat connection inviter pushes audio / video streams to the RTC server immediately after receiving the notification message that the chat connection room has been successfully joined. In this way, both the chat connection inviter and the chat connection invitee advance the timing of pushing to the RTC server, so that the chat connection invitee can pull the first frame of the chat connection inviter earlier after accepting the chat connection invitation, thereby shortening the first frame elapsed time of the chat connection invitee, shortening the waiting time after the user of the chat connection invitee accepts the chat connection invitation, and improving the user's chat connection experience.

[0063] In an alternative embodiment, to prevent the chat connection invitee from rendering the audio / video stream of the other party without accepting the chat connection invitation, when the chat connection invitee receives a chat connection accept operation for the chat connection request, the chat connection invitee starts rendering the audio / video stream pulled from the RTC server, where the audio / video stream is pushed to the RTC server by the chat connection inviter.

[0064] In another alternative embodiment, the audio / video stream of the chat connection inviting party is pulled to the chat connection invited party early and then occupies resources, and when the chat connection invited party receives a chat connection request from the chat connection inviting party through the chat connection business server, it sends a stop instruction message to the RTC server, and when it receives a chat connection acceptance operation for the chat connection request through the chat connection business server, it sends a cancel stop instruction message to the RTC server.

[0065] Here, the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party, and the cancel stop instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party.

[0066] Correspondingly, the RTC server has a frame accumulation function, specifically, the RTC server stores the audio / video stream pushed by the chat connection inviting party, and upon receiving the stop instruction message from the chat connection invited party, stops sending the audio / video stream to the chat connection invited party, and upon receiving the stop instruction message from the chat connection invited party, starts sending the audio / video stream to the chat connection invited party.

[0067] Based on the above system and method embodiments, the present disclosure further provides a chat connection method, which is applied to a chat connection inviter. Referring to FIG. 5, there is shown a flowchart of another chat connection method provided by an embodiment of the present disclosure, which includes the following steps:

[0068] S501: A chat connection request is sent to the chat connection invitee via the chat connection business server.

[0069] S502: After receiving a response message to the chat connection request from the chat connection business server, send a request to join a chat connection room to a real-time collaboration RTC server, and upon receiving a notification message from the RTC server indicating successful participation in the chat connection room, push an audio / video stream to the RTC server.

[0070] In an embodiment of the present disclosure, a chat connection inviting party sends a chat connection request to a chat connection invited party via a chat connection business server. After receiving the chat connection request (invite message), the chat connection business server first returns a response message (invite reply message) to the chat connection inviting party to notify the chat connection inviting party that the chat connection request has been received. After receiving the response message, the chat connection inviting party sends a chat connection room join request (rtc_join_channel message) to the RTC server to request participation in the chat connection virtual room. Here, the response message carries information such as the room number of the chat connection virtual room.

[0071] In the embodiment of the present disclosure, after the chat connection inviting party sends a request to join a chat connection room to the RTC server, when it receives a notification message from the RTC server indicating that it has successfully joined the chat connection room, it indicates that the chat connection inviting party has successfully joined the chat connection virtual room, and at this time, the chat connection inviting party can push audio / video streams to the RTC server to advance the push timing of the chat connection inviting party.

[0072] In practical application, after the chat connection inviting party sends a chat connection request to the chat connection invited party, if the chat connection invited party accepts the chat connection invitation, it will return a chat connection acceptance response to the chat connection request to the chat connection business server. At this time, when the chat connection inviting party receives the chat connection acceptance response, it will send a first concatenation instruction message to the RTC server to instruct the RTC server to turn on concatenation.

[0073] As described above, in the chat connection method provided by the embodiment of the present disclosure, the timing of the chat connection inviting party's push to the RTC server and the timing of sending the first concatenation instruction message to the RTC server are different, so the chat connection inviting party's push to the RTC server is advanced, the chat connection invited party's first frame waiting time is shortened, and the user chat connection experience is improved.

[0074] Based on the above system embodiment, the present disclosure further provides a chat connection method, which is applied to the chat connection invitee. Referring to FIG. 6, there is shown a flowchart of another chat connection method provided by an embodiment of the present disclosure, which includes the following steps:

[0075] S601: A chat connection request is received from a chat connection inviter via a chat connection business server.

[0076] S602: When a chat connection acceptance operation is received for the chat connection request, the audio / video stream is pushed to the real-time collaboration RTC server.

[0077] In the embodiment of the present disclosure, after the chat connection invitee receives a chat connection request from the chat connection inviter, if the chat connection invitee accepts the chat connection invitation, it triggers a chat connection accept operation. When the chat connection invitee receives the chat connection accept operation for the chat connection request, it starts to push audio / video streams to the RTC server without waiting for a response to the chat connection accept message from the chat connection business server, thereby reducing the first frame latency of the chat connection invitee and improving the user chat connection experience.

[0078] In an optional embodiment, when the chat connection inviting party receives a notification message from the RTC server that the chat connection room has been successfully joined, the chat connection inviting party starts pushing to the RTC server, so as to prevent the chat connection invited party from receiving the audio / video stream of the opposite party without agreeing to the chat connection; in an embodiment of the present disclosure, when the chat connection invited party receives a chat connection acceptance operation for the chat connection request, the chat connection inviting party starts rendering the audio / video stream pushed by the chat connection inviting party, so as to prevent the chat connection invited party from rendering the audio / video stream of the opposite party without accepting the chat connection invitation. In order to prevent the chat connection invitee from receiving the audio / video stream of the chat connection inviter early and occupying the resources of the chat connection invitee, in an embodiment of the present disclosure, a remote mute function may be implemented based on the frame accumulation function of the RTC server.

[0079] Specifically, when the chat connection invitee receives a chat connection request from the chat connection inviting party, it sends a stop instruction message to the RTC server, where the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting party to the chat connection invitee.

[0080] In addition, when the chat connection invitee receives a chat connection acceptance operation for the chat connection request, it sends a cancel stop instruction message to the RTC server, where the cancel stop instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviter to the chat connection invitee.

[0081] In actual application, when the RTC server receives a message from the chat connection invitee instructing it to stop, even if the RTC server receives the audio / video stream pushed by the chat connection inviter, it will not send it to the chat connection invitee but will store it in the RTC server.Only when the RTC server receives a message from the chat connection invitee instructing it to cancel the stop will it push the audio / video stream of the opposite party to the chat connection invitee to establish the chat connection.

[0082] In addition, the chat connection invitee is further used to send a second concatenation instruction message to the RTC server when receiving a chat connection acceptance operation for the chat connection request, where the second concatenation instruction message is used to instruct concatenation on. Specifically, the audio / video concatenation obtained by the second concatenation instruction message is displayed and used in the live broadcast room where the chat connection invitee is located.

[0083] Based on the same inventive concept as the above system and method embodiments, the present disclosure further provides a chat connection device. Referring to FIG. 7, a structural schematic diagram of a chat connection device provided by an embodiment of the present disclosure is shown, the device is applied to a chat connection inviter, and the device includes: a first sending module 701 used to send a chat connection request to a chat connection invitee via a chat connection business server; a second sending module 702, which is used to send a request to join a chat connection room to the real-time collaboration RTC server after receiving a response message to the chat connection request from the chat connection business server; and a first push module 703, which is used to push an audio / video stream to the RTC server upon receiving a notification message from the RTC server indicating that the user has successfully joined the chat connection room.

[0084] In an alternative embodiment, the apparatus comprises: When receiving a chat connection acceptance response to the chat connection request of the chat connection invitee through the chat connection business server, a first concatenation instruction message is sent to the RTC server, where the first concatenation instruction message further comprises a third sending module used to instruct concatenation on.

[0085] Based on the same inventive concept as the above system and method embodiments, the present disclosure further provides a chat connection device. Referring to FIG. 8, there is shown a structural schematic diagram of another chat connection device provided by an embodiment of the present disclosure, the device being applied to a chat connection invitee, the device comprising: a first receiving module 801 used to receive a chat connection request from a chat connection inviter via a chat connection business server; and a second push module 802, which is used to push the audio / video stream to the real-time collaboration RTC server when receiving a chat connection acceptance operation for the chat connection request.

[0086] In an alternative embodiment, the apparatus comprises: The chat connection system further comprises a rendering module, which is used to start rendering the audio / video stream pushed by the chat connection inviter when a chat connection accept operation is received for the chat connection request.

[0087] In an alternative embodiment, the apparatus comprises: a fourth sending module, upon receiving a chat connection request from the chat connection inviting party via the chat connection business server, sending a stop instruction message to the RTC server, wherein the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party; and a fifth sending module, which, upon receiving a chat connection acceptance operation for the chat connection request through the chat connection business server, sends a cancel stop instruction message to the RTC server, where the cancel stop instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviter to the chat connection invitee.

[0088] In the embodiment of the present disclosure, when the chat connection invitee receives the chat connection acceptance operation, it pushes the audio / video to the RTC server, and immediately after the chat connection inviter receives the notification message that the chat connection room has been successfully joined, it pushes the audio / video stream to the RTC server. In this way, both the chat connection inviter and the chat connection invitee advance the push timing to the RTC server, shortening the first frame elapsed time of the chat connection invitee, shortening the waiting time after the user of the chat connection invitee accepts the chat connection invitation, and improving the user's chat connection experience.

[0089] In an embodiment of the present disclosure, when the chat connection invitee receives a chat connection acceptance operation for the chat connection request, it sends a second concatenation instruction message to the RTC server, where the second concatenation instruction message is used to indicate concatenation on.

[0090] In addition to the above method and apparatus, an embodiment of the present disclosure further provides a computer-readable storage medium having instructions stored therein, the instructions, when executed on a terminal device, causing the terminal device to perform the chat connection method described in the embodiment of the present disclosure.

[0091] An embodiment of the present disclosure further provides a computer program product including a computer program / instruction, which, when executed by a processor, performs the chat connection method described in the embodiment of the present disclosure.

[0092] In addition, the embodiment of the present disclosure further provides a chat connection device, as shown in FIG. 9 : The chat connection device includes a processor 901, a memory 902, an input device 903, and an output device 904. The number of processors 901 in the chat connection device may be one or more, and one processor is shown as an example in Fig. 9. In some embodiments of the present disclosure, the processor 901, the memory 902, the input device 903, and the output device 904 may be connected via a bus or other method, and Fig. 9 shows a bus connection as an example.

[0093] The memory 902 is used to store software programs and modules, and the processor 901 executes the software programs and modules stored in the memory 902 to perform various functional applications and data processing of the chat connection device. The memory 902 mainly includes a program storage area and a data storage area, where the program storage area may include an operating system, an application program required for at least one function, etc. Furthermore, the memory 902 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk memory device, flash memory device, or other volatile solid-state memory device. The input device 903 is used to receive input digital or text information and to generate signal inputs related to user settings and function control of the chat connection device.

[0094] In this specific embodiment, the processor 901 loads executable files corresponding to the processes of one or more application programs into the memory 902 in accordance with the following instructions, and executes the application programs stored in the memory 902 by the processor 901, thereby realizing various functions of the chat connection device.

[0095] It should be noted that, in this specification, relational terms such as "first," "second," and the like are used only to distinguish one entity or operation from another, and do not necessarily require or imply that such an actual relationship or order exists between those entities or operations. Furthermore, the terms "comprise," "include," or any other modification thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus consisting of a set of elements includes not only those elements but also other elements not expressly listed or inherent in such process, method, article, or apparatus. Unless further limited, an element defined by the phrase "comprising a ..." does not exclude the presence of other similar elements in the process, method, article, or apparatus consisting of said elements.

[0096] The foregoing are merely specific embodiments of the present disclosure, intended for those skilled in the art to understand or realize the present disclosure. Various modifications to these examples will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other examples without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not limited to the examples described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A streaming interaction server, a chat connection inviting party, and a chat connection invited party are provided, The chat connection invitee is used to receive a chat connection request from the chat connection inviter via the streaming interaction server, and push an audio / video stream to a real-time collaborative RTC server in response to receiving a chat connection acceptance operation for the chat connection request; A chat connection system in which the chat connection inviting party sends a request to join a chat connection room to the RTC server after receiving a response message to the chat connection request from the streaming interaction server, and pushes an audio / video stream to the RTC server in response to receiving a notification message from the RTC server that joining the chat connection room has been successful.

2. The system of claim 1 , wherein the chat connection invitee is further used to start rendering the audio / video stream pushed by the chat connection inviter upon receiving a chat connection accept operation for the chat connection request.

3. The chat connection invitee is further used to send a stop instruction message to the RTC server when receiving the chat connection request from the chat connection inviter via the streaming interaction server, and to send a cancel stop instruction message to the RTC server when receiving a chat connection acceptance operation for the chat connection request via the streaming interaction server; 2. The system of claim 1, wherein the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviter to the chat connection invitee, and the cancel stop instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviter to the chat connection invitee.

4. The system further comprises the RTC server; The system of claim 3, wherein the RTC server is used to store the audio / video stream pushed by the chat connection inviting party, to stop sending the audio / video stream to the chat connection invited party upon receiving the stop instruction message from the chat connection invited party, and to start sending the audio / video stream to the chat connection invited party upon receiving the cancel stop instruction message from the chat connection invited party.

5. 2. The system of claim 1, wherein the chat connection inviting party is further used to send a first concatenation instruction message to the RTC server upon receiving a chat connection acceptance response to the chat connection request from the chat connection invited party via the streaming interaction server, and the first concatenation instruction message is used to instruct concatenation on.

6. 2. The system of claim 1, wherein the chat connection invitee is further used to send a second concatenation instruction message to the RTC server when receiving a chat connection acceptance operation for the chat connection request, and the second concatenation instruction message is used to indicate concatenation on.

7. The system according to any one of claims 1 to 6, wherein both the chat connection invitee and the chat connection inviter are live streaming terminals.

8. a chat connection inviting device sending a chat connection request to a chat connection invited device via a streaming interaction server; the chat connection invited device pushes an audio / video stream to a real-time collaborative RTC server in response to receiving a chat connection acceptance operation for the chat connection request; A chat connection method including the chat connection inviting device sending a request to join a chat connection room to the RTC server after receiving a response message to the chat connection request from the streaming interaction server, and pushing an audio / video stream to the RTC server in response to receiving a notification message from the RTC server indicating that joining the chat connection room has been successful.

9. A chat connection method applied to a chat connection inviting device, comprising: sending a chat connection request to the chat connection invitee device via the streaming interaction server; A chat connection method including: after receiving a response message to the chat connection request from the streaming interaction server, sending a request to join a chat connection room to a real-time collaboration RTC server; and in response to receiving a notification message from the RTC server indicating successful participation in the chat connection room, pushing an audio / video stream to the RTC server.

10. 10. The method of claim 9, further comprising: upon receiving a chat connection acceptance response to the chat connection request from the chat connection invited device via the streaming interaction server, sending a first concatenation instruction message to the RTC server, wherein the first concatenation instruction message is used to indicate concatenation on.

11. A chat connection method applied to a chat connection invited device, comprising: receiving a chat connection request from a chat connection inviting device via a streaming interaction server; In response to receiving a chat connection acceptance operation for the chat connection request, pushing an audio / video stream to a real-time collaborative RTC server; A chat connection method including: upon receiving a chat connection acceptance operation for the chat connection request, sending a second concatenation instruction message to the RTC server, the second concatenation instruction message being used to instruct concatenation on.

12. The method comprises: The method of claim 11 , further comprising: upon receiving a chat connection accept operation for the chat connection request, starting rendering of the audio / video stream pushed by the chat connection inviting device.

13. The method comprises: sending a stop instruction message to the RTC server upon receiving the chat connection request from the chat connection inviting device, the stop instruction message being used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting device to the chat connection invited device; 12. The method of claim 11, further comprising: upon receiving a chat connection accept operation for the chat connection request, sending an unsuspend instruction message to the RTC server, wherein the unsuspend instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviting device to the chat connection invited device.

14. a first sending module used to send a chat connection request to a chat connection invitee via a streaming interaction server; a second sending module, which is used to send a request to join a chat connection room to a real-time collaboration RTC server after receiving a response message to the chat connection request from the streaming conversation server; A chat connection device comprising: a first push module used to push an audio / video stream to the RTC server in response to receiving a notification message from the RTC server indicating successful participation in the chat connection room.

15. A computer readable storage medium having stored thereon instructions that, when executed on a computing device, cause the computing device to perform the method of claim 8.

16. 10. An apparatus comprising a memory, a processor, and a computer program stored in said memory, said apparatus implementing the method of claim 8 when said processor executes said computer program.

17. A computer program which, when executed by a processor, implements the method of claim 8.

Images