Chat connection system, method, apparatus, device and storage medium

Abstract

The present disclosure provides a chat connection system, method, apparatus, device and storage medium, in which a chat connection invitee receives a chat connection request from a chat connection inviter via a chat connection business server, and pushes audio / video streams to a real-time collaboration RTC server upon receiving a chat connection acceptance operation for the chat connection request.The chat connection inviter pushes audio / video streams to the RTC server upon receiving a notification message from the RTC server indicating that the chat connection room has been successfully joined.

Description

[Technical field]

[0001] (Related Applications) This application claims priority to a Chinese patent application filed on June 15, 2021, with application number 202110660881.X and title "Chat connection system, method, apparatus, device and storage medium", the entire contents of which are incorporated herein by reference. (Technical field) The present disclosure relates to the field of data processing, and in particular to chat connection systems, methods, apparatus, devices and storage media. [Background technology]

[0002] In webcasting features, chat connections have become a common form of live broadcasting, typically referring to real-time communication exchanges between hosts or between hosts and viewers, such as by video calling. Summary of the Invention

[0003] To solve all or at least some of the above technical problems, the present disclosure provides a chat connection system, method, apparatus, device and storage medium.

[0004] According to a first aspect, the present disclosure provides a chat connection system, the system comprising: a chat connection business server, a chat connection inviter, and a chat connection invitee; The chat connection invitee receives a chat connection request from the chat connection inviter via the chat connection business server, and when the chat connection accept operation is received for the chat connection request, the chat connection invitee pushes an audio / video stream to a real-time collaboration RTC server; After receiving a response message to the chat connection request from the chat connection business server, the chat connection inviter sends a request to join a chat connection room to the RTC server, and upon receiving a notification message from the RTC server indicating successful participation in the chat connection room, the chat connection inviter is used to push an audio / video stream to the RTC server.

[0005] In an optional embodiment, the chat connection invitee is further used to start rendering the audio / video stream pushed by the chat connection inviter upon receiving a chat connection accept operation for the chat connection request.

[0006] In an alternative embodiment, the chat connection invitee is further used to send a stop instruction message to the RTC server when receiving a chat connection request from the chat connection inviter via the chat connection business server, and to send a cancel stop instruction message to the RTC server when receiving a chat connection acceptance operation for the chat connection request via the chat connection business server; Here, the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party, and the cancel stop instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party.

[0007] In an alternative embodiment, the system further comprises the RTC server, The RTC server is used to store the audio / video stream pushed by the chat connection inviting side, and upon receiving the stop instruction message from the chat connection invited side, to stop sending the audio / video stream to the chat connection invited side, and upon receiving the cancel stop instruction message from the chat connection invited side, to start sending the audio / video stream to the chat connection invited side.

[0008] In an optional embodiment, the chat connection inviting party is further used for sending a first concatenation instruction message to the RTC server upon receiving a chat connection acceptance response to the chat connection request from the chat connection invited party via the chat connection business server, wherein the first concatenation instruction message is used to indicate concatenation on.

[0009] In an optional embodiment, the chat connection invitee is further used to send a second concatenation instruction message to the RTC server upon receiving a chat connection accept operation for the chat connection request, wherein the second concatenation instruction message is used to indicate concatenation on.

[0010] In an alternative embodiment, both the chat connection invitee and the chat connection inviter are casters.

[0011] According to a second aspect, the present disclosure provides a chat connection method, the chat connection method comprising: Sending a chat connection request from the chat connection inviting party to the chat connection invited party via the chat connection business server; When the chat connection invitee receives a chat connection acceptance operation for the chat connection request, pushing the audio / video stream to a real-time collaboration RTC server; After the chat connection inviting party receives a response message to the chat connection request from the chat connection business server, the chat connection inviting party sends a request to join a chat connection room to the RTC server, and when the chat connection inviting party receives a notification message from the RTC server indicating that joining the chat connection room has been successful, pushes an audio / video stream to the RTC server.

[0012] According to a third aspect, the present disclosure provides a chat connection method, which is applied to a chat connection inviter, the method comprising: sending a chat connection request to the chat connection invitee via the chat connection business server; After receiving a response message to the chat connection request from the chat connection business server, sending a request to join a chat connection room to a real-time collaboration RTC server, and upon receiving a notification message from the RTC server indicating that joining the chat connection room has been successful, pushing an audio / video stream to the RTC server.

[0013] In an alternative embodiment, the method further comprises: The method further includes sending a first concatenation instruction message to the RTC server upon receiving a chat connection acceptance response to the chat connection request from the chat connection invited party via the chat connection business server, where the first concatenation instruction message is used to indicate concatenation on.

[0014] According to a fourth aspect, the present disclosure provides a chat connection method, which is applied to a chat connection invitee side, the method comprising: receiving a chat connection request from a chat connection inviter via a chat connection business server; When a chat connection acceptance operation is received for the chat connection request, the audio / video stream is pushed to a real-time collaboration RTC server.

[0015] In an alternative embodiment, the method further comprises: The method further includes, upon receiving a chat connection accept operation for the chat connection request, starting rendering of the audio / video stream pushed by the chat connection inviter.

[0016] In an alternative embodiment, the method further comprises: sending a stop instruction message to the RTC server upon receiving a chat connection request from the chat connection inviting party, where the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party; The method further includes, upon receiving a chat connection acceptance operation for the chat connection request, sending an unsuspend instruction message to the RTC server, where the unsuspend instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviter to the chat connection invitee.

[0017] In an alternative embodiment, the method further comprises: The method further includes sending a second concatenation instruction message to the RTC server when a chat connection acceptance operation is received for the chat connection request, where the second concatenation instruction message is used to indicate concatenation on.

[0018] According to a fifth aspect, the present disclosure provides a chat connection device, the device comprising: a first sending module used to send a chat connection request to a chat connection invitee via a chat connection business server; A second sending module is used to send a request to join a chat connection room to a real-time collaboration RTC server after receiving a response message to the chat connection request from the chat connection business server; and a first push module, which is used to push an audio / video stream to the RTC server upon receiving a notification message from the RTC server indicating that the user has successfully joined the chat connection room.

[0019] According to a sixth aspect, the present disclosure provides a chat connection device, the device comprising: a first receiving module used to receive a chat connection request from a chat connection inviter via a chat connection business server; and a second push module, which is used to push the audio / video stream to the real-time collaboration RTC server upon receiving a chat connection acceptance operation for the chat connection request.

[0020] According to a seventh aspect, the present disclosure provides a computer readable storage medium having instructions stored thereon that, when executed on a computing device, cause the computing device to perform the above method.

[0021] According to an eighth aspect, the present disclosure provides an apparatus including a memory, a processor, and a computer program stored in the memory, the apparatus performing the above method when the processor executes the computer program.

[0022] According to a ninth aspect, the present disclosure provides a computer program product, comprising computer programs / instructions, which, when executed by a processor, implement the chat connection method according to the embodiments of the present disclosure. [Brief description of the drawings]

[0023] The accompanying drawings herein are incorporated in and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification can be used to interpret the principles of the present disclosure.

[0024] In order to more clearly describe the technical solutions in the embodiments or prior art of the present disclosure, the following briefly describes the drawings that need to be used in the description of the embodiments or prior art, and obviously, those skilled in the art can obtain other drawings based on these drawings without creative labor. [Figure 1] FIG. 2 is a schematic diagram of data interaction during a current webcasting chat connection method. [Diagram 2] FIG. 2 is a diagram of a signaling interaction in a chat connection system provided by an embodiment of the present disclosure. [Diagram 3] FIG. 1 is a schematic structural diagram of a chat connection system provided by an embodiment of the present disclosure; [Figure 4] 2 is a flowchart of a chat connection method provided by an embodiment of the present disclosure. [Diagram 5] 4 is a flowchart of another chat connection method provided by an embodiment of the present disclosure. [Figure 6] 4 is a flowchart of yet another chat connection method provided by an embodiment of the present disclosure. [Figure 7] FIG. 2 is a schematic structural diagram of a chat connection device provided by an embodiment of the present disclosure; [Figure 8] FIG. 2 is a schematic structural diagram of another chat connection device provided by an embodiment of the present disclosure; [Figure 9] FIG. 2 is a schematic structural diagram of a chat connection device provided by an embodiment of the present disclosure; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] In order to more clearly understand the above objectives, features and advantages of the present disclosure, the solutions of the present disclosure are further described below. It should be noted that, unless contradictory, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0026] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure; however, the present disclosure may be embodied in other ways different from those described herein, and it is apparent that the embodiments in this specification are merely some embodiments of the present disclosure, but not all of the embodiments.

[0027] In webcasting, real-time communication between casters or between casters and viewers via a method such as video calling is also called a chat connection.

[0028] The efficiency of chat connection is one of the important factors that affect the experience of users who participate in a chat connection, and especially for a user of the chat connection invited side, after actively clicking to accept the chat connection invitation, it is expected that the user can enter the communication dialogue interface of the two-way chat connection as soon as possible. Therefore, one of the effective ways to improve the user's chat connection experience is to minimize the waiting time after the user of the chat connection invited side accepts the chat connection invitation.

[0029] Currently, after triggering a chat connection invitation acceptance operation, the user of the chat connection invited party needs to wait for a response message from the chat connection business server, push the audio / video stream to the real-time collaboration RTC server, and then wait to pull the first frame of the chat connection inviting party from the real-time collaboration RTC server to realize the chat connection between the two parties.

[0030] Currently, in the chat connection method of webcasting, after the user of the chat connection invited side clicks to accept the chat connection invitation, it triggers the chat connection invited side to send a reply request to the chat connection business server, and only after the chat connection invited side receives a relay response to the reply request from the chat connection business server, the chat connection invited side starts to push audio / video streams to the RTC server, and only after the chat connection invited side pulls the first frame of the chat connection inviting side from the real-time collaboration RTC server, the chat connection between the two is realized. As such, it can be seen that the period from the chat connection invited side accepting the chat connection invitation operation to pulling the first frame of the chat connection inviting side is long, which increases the waiting time of the user of the chat connection invited side, and adversely affects the user's chat connection experience.

[0031] Taking chat connection between casters as an example, as shown in Figure 1, it is a schematic diagram of data interaction during the chat connection method of the current webcasting. Here, caster A sends a chat connection request (invite message) to caster B through the chat connection business server, and after caster B receives the chat connection request from the chat connection business server, it can trigger a chat connection accept operation in response to the chat connection request. When caster B receives the chat connection accept operation, it sends a chat connection accept message (reply request) to the chat connection business server, and when caster B receives a reply message (reply response) to the chat connection accept message from the chat connection business server, caster B starts to push audio / video streams to the RTC server and sends a concatenation on instruction to the RTC server to instruct the RTC server to open concatenation.

[0032] Caster A sends a chat connection request to caster B via the chat connection business server, and after receiving a response message (invite response) returned from the chat connection business server, starts entering the chat connection virtual room of the RTC server. Also, after caster B receives the chat connection acceptance operation, he sends a chat connection acceptance message (reply request) to the chat connection business server, and the chat connection business server transfers a chat connection acceptance notification message (reply message) in response to the chat connection acceptance message to caster A. When caster A receives the chat connection acceptance notification message from the chat connection business server, he starts pushing audio / video streams to the RTC server, and at the same time sends a concatenation on instruction to the RTC server, instructing the RTC server to start concatenation.

[0033] After Caster B triggers the chat connection acceptance operation, he / she waits for a relay response returned from the chat connection business server, and only after receiving the relay response, he / she starts pushing the RTC server. Only after pulling the audio / video stream of the opposite side from the RTC server can the chat connection between the two parties be realized. Therefore, the period between Caster B triggering the chat connection acceptance operation and the chat connection between the two parties is long, which adversely affects Caster B's chat connection experience.

[0034] For this reason, the embodiment of the present disclosure provides a chat connection system. Referring to FIG. 2, a signaling dialogue diagram in the chat connection system provided by the embodiment of the present disclosure is shown, in which the chat connection invitee (caster B) starts to push audio / video streams to the RTC server immediately after receiving the chat connection acceptance operation, so that caster B can push early to the RTC server. Also, the chat connection inviter (caster A) starts to push audio / video streams to the RTC server immediately after receiving a notification message that the chat connection room has been successfully joined. When caster B pushes to the RTC server, it can pull the first frame of caster A's audio / video stream from the RTC server, and the chat connection between the two parties can be realized.

[0035] As can be seen from this, in the chat connection system provided by the embodiment of the present disclosure, both caster A and caster B can be pushed to the RTC server early, so that the period from when caster B triggers the chat connection acceptance operation to when the two parties chat is connected is shortened, thereby shortening the first frame elapsed time of caster B and improving caster B's chat connection experience.

[0036] Based on this, an embodiment of the present disclosure provides a chat connection system. Referring to FIG. 3, a structural schematic diagram of the chat connection system provided by the embodiment of the present disclosure is shown. Here, the chat connection system 300 includes a chat connection business server 301, a chat connection inviting party 302 and a chat connection invited party 303; The chat connection invitee 303 receives a chat connection request from the chat connection inviter 302 via the chat connection business server 301, and upon receiving a chat connection acceptance operation for the chat connection request, is used to push audio / video streams to the real-time collaboration RTC server.

[0037] After receiving a response message to the chat connection request from the chat connection business server 301, the chat connection inviting party 302 sends a request to join a chat connection room to the RTC server, and when it receives a notification message from the RTC server that joining the chat connection room has been successful, it is used to push an audio / video stream to the RTC server.

[0038] In the embodiment of the present disclosure, the chat connection request is used to request the chat connection invitee to accept the chat connection invitation of the chat connection inviter. Specifically, the chat connection inviter sends a chat connection request to the chat connection invitee via the chat connection business server, and requests the chat connection invitee to accept the chat connection invitation.

[0039] After the chat connection invitee receives the chat connection request, it can trigger a chat connection accept operation or a chat connection reject operation according to the chat connection request. When the chat connection invitee receives the chat connection accept operation triggered for the chat connection request of the chat connection invitee, the chat connection invitee sends a chat connection accept message to the chat connection business server, and simultaneously starts pushing audio / video streams to the real-time collaboration RTC server.

[0040] In this way, the chat connection invitee in the embodiment of the present disclosure does not need to wait for a response message to the chat connection acceptance message of the chat connection business server, and can push to the RTC server and can be pushed early. At this time, if the chat connection invitee can pull the audio / video stream of the opposite side, the chat connection invitee can realize a quick chat connection after triggering the chat connection acceptance operation, and the user experience is improved.

[0041] In an embodiment of the present disclosure, after a chat connection inviter sends a chat connection request to a chat connection business server and receives a response message for successful receipt of the chat connection request, the chat connection inviter sends a chat connection room participation request to the RTC server and applies to participate in the chat connection virtual room. Once the chat connection inviter receives a notification message from the RTC server that the chat connection inviter has successfully joined the chat connection room, indicating that the chat connection inviter has joined the chat connection virtual room, the chat connection inviter can start pushing audio / video streams to the RTC server.

[0042] In this manner, in an embodiment of the present disclosure, the chat connection inviter can push to the RTC server without having to wait for a chat connection acceptance notification message in response to a chat connection request from the chat connection business server, and the timing of pushing audio / video streams from the chat connection inviter to the RTC can be advanced.

[0043] In the embodiment of the present disclosure, the chat connection inviting party will push audio / video streams to the RTC server immediately after receiving a notification message indicating successful participation in the chat connection room. Therefore, when the chat connection invited party receives a chat connection acceptance operation for the chat connection request, it can not only push to the RTC server, but also pull the audio / video streams of the chat connection inviting party from the RTC server, thereby shortening the first frame latency of the chat connection invited party, and improving the chat connection experience of the user on the chat connection invited party.

[0044] In addition, the chat connection inviting side advances the timing of pushing to the RTC server, so that after the chat connection invited side pushes to the RTC server, the chat connection inviting side can pull the opposite side's audio / video stream from the RTC server, which similarly shortens the first frame latency of the chat connection inviting side and improves the user's chat connection experience on the chat connection inviting side.

[0045] In practical applications, when the chat connection inviting party receives a notification message indicating that the chat connection room has been successfully joined, it may start pushing audio / video streams to the RTC server, and the chat connection invited party may receive the audio / video streams from the chat connection inviting party before receiving the chat connection acceptance operation, i.e., before the chat connection invited party agrees to the chat connection, resulting in a poor user experience for the chat connection invited party.

[0046] For this reason, the chat connection system provided by the embodiment of the present disclosure requires function optimization for the above content, and in an optional embodiment, if the chat connection invitee does not receive a chat connection acceptance operation for the chat connection request, the chat connection invitee mutes the audio / video stream of the opposite party pulled by the chat connection invitee. Specifically, if the chat connection invitee does not receive a chat connection acceptance operation for the chat connection request, the chat connection invitee does not render the audio / video stream of the chat connection inviter pulled by the chat connection inviter, and if the chat connection accept operation for the chat connection request is received, the chat connection is realized by rendering the audio / video stream pushed by the chat connection inviter.

[0047] In this way, in an embodiment of the present disclosure, the chat connection invitee starts rendering the audio / video stream pushed by the chat connection inviting party only when the chat connection invitee receives a chat connection acceptance operation for the chat connection request, thereby avoiding the chat connection invitee rendering the audio / video stream of the chat connection inviting party when the chat connection invitee does not agree to the chat connection, and improving the user chat connection experience of the chat connection inviting party.

[0048] In the above embodiment, the audio / video stream of the chat connection inviting party pulled early by the chat connection invited party occupies the resources of the chat connection invited party, such as bandwidth and CPU resources, so that the chat connection invited party may experience lag and other phenomena, which adversely affects the user experience of the chat connection invited party. Therefore, the embodiment of the present disclosure also provides a function optimization method.

[0049] Specifically, when the chat connection invitee receives a chat connection request from the chat connection inviting side, it sends a stop instruction message to the RTC server to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting side to the chat connection invitee, and when the chat connection invitee receives a chat connection accept operation for the chat connection request, it sends a cancel stop instruction message to the RTC server to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviting side to the chat connection invitee.

[0050] Correspondingly, in order to realize the above-mentioned function optimization method, an embodiment of the present disclosure further provides a chat connection system, which in addition to a chat connection business server, a chat connection inviting party and a chat connection invited party, further includes an RTC server having a frame accumulation function.

[0051] Specifically, the RTC server is used to store the audio / video stream pushed by the chat connection inviting side, and upon receiving the stop instruction message from the chat connection invited side, to stop sending the audio / video stream to the chat connection invited side, and upon receiving the cancel stop instruction message from the chat connection invited side, to start sending the audio / video stream to the chat connection invited side.

[0052] The RTC server in the above embodiment stores the audio / video stream pushed by the chat connection inviting side through the frame accumulation function, and transmits the audio / video stream to the chat connection invited side only when receiving a cancel cancellation instruction message from the chat connection invited side to realize the chat connection. Therefore, in the embodiment of the present disclosure, there is no need to occupy the resources of the chat connection invited side, which can avoid the lag phenomenon caused by the chat connection invited side, and improve the user experience of the chat connection invited side.

[0053] In addition, the RTC server further has a concatenation function, specifically used to concatenate audio / video streams pushed by the chat connection invitee and the chat connection inviter to obtain audio / video concatenation, where the audio / video concatenation can be displayed and used in a live broadcast room where the chat connection invitee or the chat connection inviter is located.

[0054] In the embodiment of the present disclosure, when the chat connection inviting party receives a chat connection acceptance response to the chat connection request of the chat connection invited party through the chat connection business server, the chat connection inviting party further sends a first concatenation instruction message to the RTC server, which is used to instruct the RTC server to concatenate the audio / video streams pushed by the chat connection inviting party and the chat connection invited party, where the audio / video concatenation obtained according to the first concatenation instruction message is displayed and used in the live broadcast room where the chat connection inviting party is located.

[0055] In this way, the chat connection inviting side in the chat connection system provided by the embodiment of the present disclosure separates the timing of pushing to the RTC server and the timing of instructing concatenation on, and advances the timing of pushing to the RTC server, but maintains the timing of sending the first concatenation instruction message to the RTC server, that is, still sends the first concatenation instruction message to the RTC server when it receives a chat connection acceptance response. The chat connection inviting side pushes early, thereby shortening the period from when the chat connection inviting side receives a chat connection acceptance response to when the chat connection is realized, so that the embodiment of the present disclosure can also shorten the first frame waiting time of the chat connection inviting side.

[0056] In addition, the chat connection invited party is further used to send a second concatenation instruction message to the RTC server when receiving a chat connection acceptance operation for the chat connection request, where the second concatenation instruction message is used to indicate concatenation on.

[0057] In the embodiment of the present disclosure, when the chat connection invitee receives a chat connection acceptance operation for the chat connection request, it sends a second concatenation instruction message to the RTC server. Specifically, the audio / video concatenation obtained based on the second concatenation instruction message is displayed and used in the live broadcast room where the chat connection invitee is located.

[0058] Based on the chat connection system in the above embodiment, the present disclosure provides a chat connection method. Referring to FIG. 4, there is shown a flowchart of the chat connection method provided by the embodiment of the present disclosure, where the method is applied to the above chat connection system, the chat connection system includes a chat connection business server, a chat connection inviting party and a chat connection invited party, and the chat connection method includes the following steps:

[0059] S401: A chat connection request is sent from the chat connection inviting party to the chat connection invited party via the chat connection business server.

[0060] S402: When the chat connection invitee receives a chat connection acceptance operation for the chat connection request, the chat connection invitee pushes an audio / video stream to the real-time collaboration RTC server.

[0061] S403: After the chat connection inviting party receives a response message to the chat connection request from the chat connection business server, it sends a request to join a chat connection room to the RTC server, and upon receiving a notification message from the RTC server indicating that joining the chat connection room has been successful, it pushes an audio / video stream to the RTC server.

[0062] In the chat connection method provided by the embodiment of the present disclosure, the chat connection invitee pushes audio / video to the RTC server immediately after receiving the chat connection acceptance operation, and the chat connection inviting party pushes audio / video stream to the RTC server immediately after receiving the notification message of successful participation in the chat connection room. In this way, the chat connection inviting party and the chat connection invited party both advance the push timing to the RTC server, and the chat connection invitee can pull the first frame of the chat connection inviting party earlier after the chat connection invited party accepts the chat connection invitation, shortening the first frame elapsed time of the chat connection invited party, shortening the waiting time after the user of the chat connection invited party accepts the chat connection invitation, and improving the chat connection experience of the user.

[0063] In an optional embodiment, to prevent the chat connection invitee from rendering the audio / video stream of the opposite party without the chat connection invitee accepting the chat connection invitation, when the chat connection invitee receives a chat connection accept operation for the chat connection request, the chat connection invitee starts rendering the audio / video stream pulled from the RTC server, where the audio / video stream is pushed to the RTC server by the chat connection invitee.

[0064] In another optional embodiment, the audio / video stream of the chat connection inviting party occupies resources after being pulled early to the chat connection invited party, and when the chat connection invited party receives a chat connection request from the chat connection inviting party through the chat connection business server, it sends a stop instruction message to the RTC server, and when it receives a chat connection accept operation for the chat connection request through the chat connection business server, it sends an unstop instruction message to the RTC server.

[0065] Here, the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party, and the cancel stop instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party.

[0066] Correspondingly, the RTC server has a frame accumulation function, specifically, the RTC server stores the audio / video stream pushed by the chat connection inviting side, and when it receives the stop instruction message from the chat connection invited side, it stops sending the audio / video stream to the chat connection invited side, and when it receives the stop instruction message from the chat connection invited side, it starts sending the audio / video stream to the chat connection invited side.

[0067] Based on the above system and method embodiments, the present disclosure further provides a chat connection method, which is applied to a chat connection inviter. Referring to FIG. 5, there is shown a flowchart of another chat connection method provided by an embodiment of the present disclosure, the method including the following steps:

[0068] S501: A chat connection request is sent to a chat connection invitee via a chat connection business server.

[0069] S502: After receiving a response message to the chat connection request from the chat connection business server, send a request to join a chat connection room to a real-time collaboration RTC server, and upon receiving a notification message from the RTC server indicating successful participation in the chat connection room, push an audio / video stream to the RTC server.

[0070] In an embodiment of the present disclosure, the chat connection inviting party sends a chat connection request to the chat connection invited party via the chat connection business server, and after the chat connection business server receives the chat connection request (invite message), it first returns a response message (invite reply message) to the chat connection inviting party to notify the chat connection inviting party that it has received the chat connection request. After the chat connection inviting party receives the response message, it sends a chat connection room participation request (rtc_join_channel message) to the RTC server to request participation in the chat connection virtual room. Here, the response message carries information such as the room number of the chat connection virtual room.

[0071] In an embodiment of the present disclosure, after the chat connection inviting party sends a request to join a chat connection room to the RTC server, when the chat connection inviting party receives a notification message from the RTC server indicating that the chat connection room has been successfully joined, it indicates that the chat connection inviting party has successfully joined the chat connection virtual room, and at this time, the chat connection inviting party can push audio / video streams to the RTC server to advance the push timing of the chat connection inviting party.

[0072] In practical application, after the chat connection inviting party sends a chat connection request to the chat connection invited party, when the chat connection invited party accepts the chat connection invitation, it returns a chat connection acceptance response to the chat connection request to the chat connection business server. At this time, when the chat connection inviting party receives the chat connection acceptance response, it sends a first concatenation instruction message to the RTC server, instructing the RTC server to turn on concatenation.

[0073] As described above, in the chat connection method provided by the embodiment of the present disclosure, the timing of the push by the chat connection inviting party to the RTC server and the timing of the sending of the first concatenation instruction message to the RTC server are different, so that the timing of the push by the chat connection inviting party to the RTC server is advanced, the first frame waiting time of the chat connection invited party is shortened, and the user chat connection experience is improved.

[0074] Based on the above system embodiment, the present disclosure further provides a chat connection method, which is applied to the chat connection invited party. Referring to FIG. 6, there is shown a flowchart of yet another chat connection method provided by an embodiment of the present disclosure, the method including the following steps:

[0075] S601: A chat connection request is received from a chat connection inviter via a chat connection business server.

[0076] S602: When a chat connection acceptance operation for the chat connection request is received, push the audio / video stream to the real-time collaboration RTC server.

[0077] In the embodiment of the present disclosure, after the chat connection invitee receives a chat connection request from the chat connection inviting party, if the chat connection invitee accepts the chat connection invitation, it triggers a chat connection accept operation. When the chat connection invitee receives the chat connection accept operation for the chat connection request, it starts to push audio / video streams to the RTC server without waiting for the response to the chat connection accept message of the chat connection business server, thereby shortening the first frame latency of the chat connection invitee and improving the user chat connection experience.

[0078] In an optional embodiment, when the chat connection inviting party receives a notification message from the RTC server indicating that the chat connection room has been successfully joined, the chat connection inviting party starts pushing to the RTC server, in order to prevent the chat connection invited party from receiving the audio / video stream of the opposite party without agreeing to the chat connection; in an embodiment of the present disclosure, when the chat connection invited party receives a chat connection accept operation for the chat connection request, the chat connection inviting party starts rendering the audio / video stream pushed by the chat connection inviting party, in order to prevent the chat connection invited party from rendering the audio / video stream of the opposite party without accepting the chat connection invitation. In order to prevent the chat connection invitee from receiving the audio / video stream of the chat connection inviter early and occupying the resources of the chat connection invitee, in an embodiment of the present disclosure, a remote mute function may be implemented based on the frame accumulation function of the RTC server.

[0079] Specifically, when a chat connection invited party receives a chat connection request from the chat connection inviting party, it sends a stop instruction message to the RTC server, where the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party.

[0080] In addition, when the chat connection invited party receives a chat connection acceptance operation for the chat connection request, it sends a cancel stop instruction message to the RTC server, where the cancel stop instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party.

[0081] In actual application, when the RTC server receives the chat connection invitee's cancellation instruction message, even if the RTC server receives the audio / video stream pushed by the chat connection invitee, it does not send it to the chat connection invitee but stores it in the RTC server. Only when the RTC server receives the chat connection cancel cancellation instruction message from the chat connection invitee, it pushes the opposite side's audio / video stream to the chat connection invitee to realize the chat connection.

[0082] In addition, the chat connection invitee is further used to send a second concatenation instruction message to the RTC server when receiving a chat connection acceptance operation for the chat connection request, where the second concatenation instruction message is used to indicate concatenation on. Specifically, the audio / video concatenation obtained by the second concatenation instruction message is displayed and used in the live broadcast room where the chat connection invitee is located.

[0083] Based on the same inventive concept as the above system and method embodiments, the present disclosure further provides a chat connection device. Referring to FIG. 7, a structural schematic diagram of a chat connection device provided by an embodiment of the present disclosure is shown, the device is applied to a chat connection inviter, and the device includes: a first sending module 701 used to send a chat connection request to a chat connection invitee via a chat connection business server; a second sending module 702, which is used to send a request to join a chat connection room to a real-time collaboration RTC server after receiving a response message to the chat connection request from the chat connection business server; and a first push module 703, which is used to push an audio / video stream to the RTC server upon receiving a notification message from the RTC server indicating that the user has successfully joined the chat connection room.

[0084] In an alternative embodiment, the apparatus comprises: The third sending module further includes a third sending module for sending a first concatenation instruction message to the RTC server upon receiving a chat connection acceptance response to the chat connection request of the chat connection invitee via the chat connection business server, where the first concatenation instruction message is used to indicate concatenation on.

[0085] Based on the same inventive concept as the above system and method embodiments, the present disclosure further provides a chat connection device. Referring to FIG. 8, there is shown a structural schematic diagram of another chat connection device provided by the embodiments of the present disclosure, the device is applied to a chat connection invitee side, the device includes: A first receiving module 801 used to receive a chat connection request from a chat connection inviter via a chat connection business server; and a second push module 802, which is used for pushing the audio / video stream to the real-time collaboration RTC server when receiving a chat connection acceptance operation for the chat connection request.

[0086] In an alternative embodiment, the apparatus comprises: The chat connection further comprises a rendering module that is used to start rendering the audio / video stream pushed by the chat connection inviter upon receiving a chat connection accept operation for the chat connection request.

[0087] In an alternative embodiment, the apparatus comprises: a fourth sending module, when receiving a chat connection request from the chat connection inviting party via the chat connection business server, sending a stop instruction message to the RTC server, where the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party; and a fifth sending module, when receiving a chat connection acceptance operation for the chat connection request via the chat connection business server, sending a cancel stop instruction message to the RTC server, where the cancel stop instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviting party to the chat connection invited party.

[0088] In the embodiment of the present disclosure, when the chat connection invitee receives the chat connection acceptance operation, it pushes audio / video to the RTC server, and immediately after the chat connection inviting party receives the notification message that the chat connection room has been successfully joined, it pushes the audio / video stream to the RTC server. In this way, the chat connection inviting party and the chat connection invited party both advance the push timing to the RTC server, shorten the first frame elapsed time of the chat connection invited party, shorten the waiting time after the user of the chat connection invited party accepts the chat connection invitation, and improve the user's chat connection experience.

[0089] In an embodiment of the present disclosure, when the chat connection invitee receives a chat connection acceptance operation for the chat connection request, it sends a second concatenation instruction message to the RTC server, where the second concatenation instruction message is used to indicate concatenation on.

[0090] In addition to the above method and apparatus, an embodiment of the present disclosure further provides a computer-readable storage medium having instructions stored therein that, when executed on a terminal device, cause the terminal device to perform the chat connection method described in the embodiment of the present disclosure.

[0091] An embodiment of the present disclosure further provides a computer program product including a computer program / instruction, which, when executed by a processor, performs the chat connection method described in the embodiment of the present disclosure.

[0092] In addition, the embodiment of the present disclosure further provides a chat connection device, as shown in FIG. The chat connection device includes a processor 901, a memory 902, an input device 903, and an output device 904. The number of processors 901 in the chat connection device may be one or more, and one processor is exemplified in Fig. 9. In some embodiments of the present disclosure, the processor 901, the memory 902, the input device 903, and the output device 904 may be connected via a bus or other method, and a bus connection is exemplified in Fig. 9.

[0093] The memory 902 is used to store software programs and modules, and the processor 901 executes various functional applications and data processing of the chat connection device by executing the software programs and modules stored in the memory 902. The memory 902 mainly includes a program storage area and a data storage area, where the program storage area may include an operating system, an application program required for at least one function, and the like. In addition, the memory 902 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk memory device, a flash memory device, or other volatile solid-state memory device. The input device 903 is used to receive input digital or text information and generate signal inputs related to user settings and function control of the chat connection device.

[0094] In this specific embodiment, the processor 901 loads executable files corresponding to the processes of one or more application programs into the memory 902 in accordance with the following instructions, and executes the application programs stored in the memory 902 by the processor 901, thereby realizing various functions of the above-mentioned chat connection device.

[0095] It should be noted that, in this specification, relational terms such as "first," "second," and the like are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that such an actual relationship or sequence exists between those entities or operations. Also, the terms "comprise," "include," or any other modification are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus consisting of a set of elements includes not only those elements, but also other elements not expressly listed or inherent to such process, method, article, or apparatus. Unless further limited, an element defined by the phrase "comprising a ..." does not exclude the presence of other similar elements in the process, method, article, or apparatus consisting of said elements.

[0096] The above are merely specific embodiments of the present disclosure, and are intended for those skilled in the art to understand or realize the present disclosure. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not limited to these embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A streaming dialogue server, a chat connection inviting party, and a chat connection invited party, The chat connection invitee is used to receive a chat connection request from the chat connection inviter via the streaming interaction server, and in response to receiving a chat connection acceptance operation for the chat connection request, push an audio / video stream to a real-time collaborative RTC server; A chat connection system in which the chat connection inviter sends a request to join a chat connection room to the RTC server after receiving a response message to the chat connection request from the streaming interaction server, and is used to push an audio / video stream to the RTC server in response to receiving a notification message from the RTC server that joining the chat connection room has been successful.

2. The system of claim 1 , wherein the chat connection invitee is further used to start rendering the audio / video stream pushed by the chat connection inviter upon receiving a chat connection accept operation for the chat connection request.

3. The chat connection invitee is further used to send a stop instruction message to the RTC server when receiving the chat connection request from the chat connection inviter via the streaming dialogue server, and to send a cancel stop instruction message to the RTC server when receiving a chat connection acceptance operation for the chat connection request via the streaming dialogue server; 2. The system of claim 1, wherein the stop instruction message is used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviter to the chat connection invitee, and the unstop instruction message is used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviter to the chat connection invitee.

4. The system further comprises the RTC server, The system of claim 3, wherein the RTC server is used to store the audio / video stream pushed by the chat connection inviting party, to stop sending the audio / video stream to the chat connection invited party upon receiving the stop instruction message from the chat connection invited party, and to start sending the audio / video stream to the chat connection invited party upon receiving the cancel stop instruction message from the chat connection invited party.

5. 2. The system of claim 1, wherein the chat connection inviting party is further used to send a first concatenation instruction message to the RTC server upon receiving a chat connection acceptance response to the chat connection request from the chat connection invited party via the streaming interaction server, and the first concatenation instruction message is used to indicate concatenation on.

6. 2. The system of claim 1, wherein the chat connection invitee is further used to send a second concatenation instruction message to the RTC server when receiving a chat connection accept operation for the chat connection request, and the second concatenation instruction message is used to indicate concatenation on.

7. The system according to any one of claims 1 to 6, wherein both the chat connection invitee and the chat connection inviter are live stream terminals.

8. a chat connection inviting device sending a chat connection request to a chat connection invited device via a streaming interaction server; the chat connection invited device pushing an audio / video stream to a real-time collaborative RTC server in response to receiving a chat connection acceptance operation for the chat connection request; A chat connection method including the chat connection inviting device sending a request to join a chat connection room to the RTC server after receiving a response message to the chat connection request from the streaming interaction server, and pushing an audio / video stream to the RTC server in response to receiving a notification message from the RTC server indicating successful participation in the chat connection room.

9. A chat connection method applied to a chat connection inviting device, comprising: sending a chat connection request to the chat connection invitee device via the streaming interaction server; A chat connection method comprising: after receiving a response message to the chat connection request from the streaming interaction server, sending a request to join a chat connection room to a real-time collaboration RTC server; and in response to receiving a notification message from the RTC server indicating successful participation in the chat connection room, pushing an audio / video stream to the RTC server.

10. 10. The method of claim 9, further comprising: upon receiving a chat connection acceptance response to the chat connection request from the chat connection invited device via the streaming interaction server, sending a first concatenation indication message to the RTC server, the first concatenation indication message being used to indicate concatenation on.

11. A chat connection method applied to a chat connection invited device, comprising: receiving a chat connection request from a chat connection inviting device via a streaming interaction server; In response to receiving a chat connection accept operation for the chat connection request, pushing an audio / video stream to a real-time collaborative RTC server.

12. The method comprises: The method of claim 11 , further comprising: upon receiving a chat connection accept operation on the chat connection request, starting rendering of the audio / video stream pushed by the chat connection inviting device.

13. The method comprises: sending a stop instruction message to the RTC server upon receiving the chat connection request from the chat connection inviting device, the stop instruction message being used to instruct the RTC server to stop sending the audio / video stream pushed by the chat connection inviting device to the chat connection invited device; The method of claim 11, further comprising: upon receiving a chat connection accept operation for the chat connection request, sending an unsuspend instruction message to the RTC server, the unsuspend instruction message being used to instruct the RTC server to start sending the audio / video stream pushed by the chat connection inviting device to the chat connection invited device.

14. The method comprises:

12. The method of claim 11, further comprising: sending a second concatenation indication message to the RTC server upon receiving a chat connection accept operation for the chat connection request, the second concatenation indication message being used to indicate concatenation on.

15. A first sending module used to send a chat connection request to a chat connection invitee via a streaming dialogue server; a second sending module, which is used to send a request to join a chat connection room to a real-time collaboration RTC server after receiving a response message to the chat connection request from the streaming dialogue server; A chat connection device comprising: a first push module used to push an audio / video stream to the RTC server in response to receiving a notification message from the RTC server indicating successful participation in the chat connection room.

16. A first receiving module used to receive a chat connection request from a chat connection inviting party via a streaming dialogue server; a second push module used to push an audio / video stream to a real-time collaborative RTC server in response to receiving a chat connection acceptance operation for the chat connection request.

17. A computer readable storage medium having instructions stored thereon which, when executed on a computing device, cause the computing device to perform the method of claim 8, or the method of claim 9 or 10, or the method of any one of claims 11 to 14.

18. An apparatus comprising a memory, a processor and a computer program stored in the memory, the apparatus implementing the method of claim 8, or the method of claim 9 or 10, or the method of any one of claims 11 to 14, when the processor executes the computer program.

19. A computer program product comprising a computer program / instructions which, when executed by a processor, result in the method of claim 8 or the method of claim 9 or 10 or the method of any one of claims 11 to 14.

Images