Audio and video conference joining method and device
By using real-time message identifiers and tokens to generate authentication commands in the audio and video conferencing system, the problem of terminals being unable to select audio and video servers is solved, enabling flexible authentication and secure data transmission between terminals and audio and video servers, thus enhancing the flexibility and security of audio and video conferencing.
Patent Information
- Application Number
- CN202411015974.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-26
- Publication Date
- 2024-11-15
AI Technical Summary
In existing technologies, when participating in audio and video conferences, terminals can only receive and receive audio and video streams through streaming media servers, which lacks flexibility and makes it impossible to select audio and video servers.
By obtaining the terminal's real-time message identifier and real-time message token from the first server, an authentication command is generated and sent to the audio and video server to create an audio and video conference. The real-time interactive token is then used to authenticate the terminal and allow it to enter the audio and video conference.
It enables flexible authentication between terminals and audio/video servers, improves the security and selectivity of data transmission, and enhances the security and flexibility of audio and video conferencing.
Smart Images

Figure CN118972515A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of network communication technology, and in particular to a method and device for joining an audio or video conference. Background Art
[0002] The visual network is an important milestone in the development of the Internet. It is a more advanced form of the Internet and a real-time network that can achieve real-time transmission of high-definition video across the entire network, which is currently impossible with the Internet. It will push many Internet applications towards high-definition video and high-definition face-to-face communication, allowing people around the world to be just a screen away from each other.
[0003] Currently, when a terminal participates in an audio or video conference, there is only authentication between the terminal and the streaming media server, and all terminals can only receive and send audio and video streams through the streaming media server, and cannot select the audio or video server, which has poor flexibility. Summary of the invention
[0004] In view of the above problems, embodiments of the present application provide a method and device for joining an audio or video conference that overcomes the above problems or at least partially solves the above problems.
[0005] In order to solve the above problems, the embodiment of the present application discloses a method for joining an audio and video conference, which is applied to an audio and video conference system. The audio and video conference system includes: a first server and an audio and video server. The method includes:
[0006] When the first terminal creates an audio and video conference on the first server through the first account, the first server is controlled to obtain the real-time message identification number and the real-time message token corresponding to the first account and send them to the audio and video server. The first server is connected between the first terminal and the audio and video server, and is used to send and receive data and generate authentication instructions according to the binding relationship between the saved real-time message identification number, the real-time message token, the real-time interaction identification number, and the first account. The audio and video server is used to create an audio and video conference and send and receive audio and video streams of the audio and video conference;
[0007] Control the audio and video server to create an audio and video conference according to the real-time message identification number and the real-time message token corresponding to the first account, generate a conference number and a channel number identification number of the audio and video conference, and send the conference number and the channel number identification number of the audio and video conference to the first server;
[0008] Control the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and real-time message token corresponding to the first account, and send the authentication instruction to the audio and video server;
[0009] When the authentication instruction is successfully authenticated, the audio and video server is controlled to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server, so that the first terminal can enter the audio and video conference through the real-time interactive token of the first server.
[0010] Optionally, when the authentication instruction is successfully authenticated, controlling the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and sending the token to the first server, so that the first terminal enters the audio and video conference through the real-time interactive token of the first server, includes:
[0011] When the authentication instruction is successfully authenticated, control the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server;
[0012] Control the first server to send the real-time interactive token corresponding to the first account and the channel number identification number of the audio and video conference to the first terminal, so that the first terminal enters the channel corresponding to the audio and video conference of the audio and video server through the real-time interactive token corresponding to the first account and the channel number identification number of the audio and video conference to receive and hear audio and video streams.
[0013] Optionally, when the authentication instruction is successfully authenticated, controlling the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and sending the token to the first server includes:
[0014] Control the audio and video server to determine whether the authentication instruction conforms to the authentication format, and if so, control the audio and video server to authenticate the authentication instruction;
[0015] If the authentication is successful, the audio and video server is controlled to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server.
[0016] Optionally, when the first terminal creates an audio and video conference on the first server through the first account, before controlling the first server to obtain the real-time message identification number and the real-time message token corresponding to the first account and sending them to the audio and video server, the method further includes:
[0017] When the first terminal logs in to the first account and sends the first account to the first server, the first server is controlled to send the first identity identification number and the first token corresponding to the first account to the first terminal, so that the first terminal logs in to the first server through the first identity identification number and the first token.
[0018] Optionally, the audio and video conferencing system further includes a streaming media server, and the controlling the first server to send a first identity identification number and a first token corresponding to the first account to the first terminal, so that the first terminal logs in to the first server through the first identity identification number and the first token, includes:
[0019] Control the first server to send the first identity identification number and the first token corresponding to the first account, and the second identity identification number and the second token of the streaming media server to the first terminal, so that the first terminal logs in to the first server through the first identity identification number and the first token, and logs in to the streaming media server through the second identity identification number and the second token.
[0020] Optionally, the method further comprises:
[0021] When the second terminal logs in to the first server and the streaming server through the first identity identification number and the first token, the second identity identification number and the second token, control the streaming server to send a kick signaling to the first terminal, and send indication information of updating the first token to the first server;
[0022] Control the first server to update the first token according to the instruction information.
[0023] Optionally, the controlling the first server to generate an authentication instruction according to the conference number of the audio and video conference and the real-time message identification number and the real-time message token corresponding to the first account includes:
[0024] Controlling the first server to obtain facial information at the current time from the first terminal;
[0025] Control the first server to obtain the real-time interaction identification number corresponding to the first account, and generate an authentication instruction through the conference number of the audio and video conference, the facial information, and the real-time message identification number, the real-time message token, and the real-time interaction identification number corresponding to the first account;
[0026] Among them, the authentication instruction includes: a protocol header and a payload, and the payload includes: the conference number of the audio and video conference, the facial information, and the real-time message identification number, real-time message token and real-time interaction identification number corresponding to the first account.
[0027] The embodiment of the present application also discloses a device for joining an audio and video conference, which is applied to an audio and video conference system. The audio and video conference system includes: a first server and an audio and video server. The device includes:
[0028] A first control module, used for controlling the first server to obtain the real-time message identification number and the real-time message token corresponding to the first account and send them to the audio and video server when the first terminal creates an audio and video conference on the first server through the first account, the first server is connected between the first terminal and the audio and video server, and is used for sending and receiving data and generating authentication instructions according to the binding relationship between the saved real-time message identification number, the real-time message token, the real-time interaction identification number, and the first account, and the audio and video server is used to create an audio and video conference and send and receive audio and video streams of the audio and video conference;
[0029] A second control module is used to control the audio and video server to create an audio and video conference according to the real-time message identification number and the real-time message token corresponding to the first account, and to generate a conference number and a channel number identification number of the audio and video conference, and to send the conference number and the channel number identification number of the audio and video conference to the first server;
[0030] A third control module is used to control the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and real-time message token corresponding to the first account, and send the authentication instruction to the audio and video server;
[0031] The fourth control module is used to control the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server when the authentication instruction is successfully authenticated, so that the first terminal can enter the audio and video conference through the real-time interactive token of the first server.
[0032] The present application also discloses an electronic device, including:
[0033] one or more processors; and
[0034] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to execute the method for joining an audio or video conference as described above.
[0035] The embodiment of the present application also discloses a computer-readable storage medium, which stores a computer program that enables a processor to execute the method for joining an audio or video conference as described above.
[0036] The embodiments of the present application include the following advantages:
[0037] In the case where the first terminal creates an audio and video conference on the first server through the first account, the first server is controlled to obtain the real-time message identification number and the real-time message token corresponding to the first account and send them to the audio and video server. The first server is connected between the first terminal and the audio and video server and is used to generate data reception and authentication instructions according to the binding relationship between the saved real-time message identification number, the real-time message token, the real-time interaction identification number, and the first account. The audio and video server is used to create an audio and video conference and send and receive the audio and video streams of the audio and video conference; the audio and video server is controlled to receive the real-time message identification number and the real-time message token corresponding to the first account according to the real-time message identification number and the real-time interaction identification number. The real-time message token creates an audio and video conference, generates a conference number and a channel number identification number of the audio and video conference, and sends the conference number and the channel number identification number of the audio and video conference to the first server, controls the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and real-time message token corresponding to the first account, and sends the authentication instruction to the audio and video server, thereby, the authentication instruction generated by the real-time message identification number and the real-time message token can ensure the real-time nature of the authentication instruction, and because the real-time message token has a validity period, the security of data transmission between the first server and the third-party server can be guaranteed. Moreover, in the case of successful authentication of the authentication instruction, the audio and video server is controlled to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server, so that the first terminal enters the audio and video conference through the real-time interactive token of the first server, thereby realizing the authentication between the first server and the third-party server, improving the security between the first server and the third-party server, and the user can select the audio and video server to receive the audio and video stream according to their own needs, with strong selectivity and flexibility. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] Figure 1 is a communication diagram between the audio and video conferencing system provided in an embodiment of the present application and the first terminal;
[0039] Figure 2 It is a flowchart of the steps of the method for joining an audio or video conference provided in an embodiment of the present application;
[0040] Figure 3 It is a structural block diagram of the audio and video conference joining device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0041] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.
[0042] Specifically, the embodiment of the present application provides a method for joining an audio and video conference, which is applied to an audio and video conference system, such as Figure 1 As shown, the audio and video conferencing system includes: a first server 11 and an audio and video server 12, and the first server 11 and the audio and video server 12 are communicatively connected.
[0043] like Figure 2 As shown, the method for joining the above audio and video conference specifically includes the following steps:
[0044] Step 201, when the first terminal creates an audio and video conference on the first server through the first account, the first server is controlled to obtain the real-time message identification number and the real-time message token corresponding to the first account and send them to the audio and video server. The first server is connected between the first terminal and the audio and video server, and is used to send and receive data and generate authentication instructions according to the binding relationship between the saved real-time message identification number, the real-time message token, the real-time interaction identification number, and the first account. The audio and video server is used to create an audio and video conference and send and receive the audio and video streams of the audio and video conference.
[0045] Specifically, Figure 1 As shown, the first terminal 13 can be an Internet terminal or a video network terminal. The user logs in to the first server 11 through the first account at the first terminal 13, and the audio and video conferencing system obtains the real-time message (Rtm) identification number (Identity document, Id) and real-time message token RtmToken corresponding to the first account through the first server 11, and sends RtmId and RtmToken to the audio and video server 12.
[0046] Step 202, control the audio and video server to create an audio and video conference according to the real-time message identification number and real-time message token corresponding to the first account, generate the conference number and channel number identification number of the audio and video conference, and send the conference number and channel number identification number of the audio and video conference to the first server.
[0047] Specifically, the audio and video conferencing system controls the audio and video server to create an audio and video conference according to the RtmId and RtmToken corresponding to the first account, and generates a conference number and channel number identification number corresponding to the audio and video conference, and the audio and video server returns the conference number and channel number identification number corresponding to the audio and video conference to the first server.
[0048] Step 203, controlling the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and real-time message token corresponding to the first account, and sending the authentication instruction to the audio and video server.
[0049] Specifically, after receiving the conference number and channel number identification number corresponding to the audio and video conference, the first server saves the conference number and channel number identification number corresponding to the audio and video conference in the conference data table corresponding to the audio and video conference. The first server generates an authentication instruction according to the conference number of the audio and video conference and the RtmId and RtmToken corresponding to the first account saved in the local database, and sends the authentication instruction to the audio and video server through the conference joining interface of the audio and video server.
[0050] Step 204, when the authentication instruction is successfully authenticated, control the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server, so that the first terminal can enter the audio and video conference audio and video server through the real-time interactive token of the first server.
[0051] Specifically, after receiving the authentication instruction, the audio and video server authenticates the authentication instruction, that is, the audio and video server determines whether the first account has the authority to communicate with the audio and video server through the authentication instruction. If the authentication fails, it means that the first account does not have the authority to communicate with the audio and video server. If the authentication is successful, it means that the first account has the authority to communicate with the audio and video server, and the audio and video server generates a real-time interaction token (Real time interaction, Rtc) token Token corresponding to the first account according to the authentication instruction, and sends the real-time interaction token RtcToken corresponding to the first account to the first server through the audio and video server's conference joining interface. The first server sends the real-time interaction token RtcToken corresponding to the first account to the first terminal, and the first terminal enters the audio and video conference according to the real-time interaction token RtcToken corresponding to the first account.
[0052] In the above embodiment of the present application, when the first terminal creates an audio and video conference on the first server through the first account, the first server is controlled to obtain the real-time message identification number and the real-time message token corresponding to the first account and send them to the audio and video server. The first server is connected between the first terminal and the audio and video server, and is used to send and receive data and generate authentication instructions according to the binding relationship between the saved real-time message identification number, the real-time message token, the real-time interaction identification number, and the first account. The audio and video server is used to create an audio and video conference and send and receive the audio and video streams of the audio and video conference; the audio and video server is controlled according to the real-time message identification number corresponding to the first account. The first server generates an audio and video conference using the real-time message identification number and the real-time message token, generates a conference number and a channel number identification number of the audio and video conference, and sends the conference number and the channel number identification number of the audio and video conference to the first server, controls the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and the real-time message token corresponding to the first account, and sends the authentication instruction to the audio and video server, thereby, the authentication instruction generated by the real-time message identification number and the real-time message token can ensure the real-time nature of the authentication instruction, and because the real-time message token has a validity period, the security of data transmission between the first server and the third-party server can be guaranteed. Moreover, in the case of successful authentication of the authentication instruction, the audio and video server is controlled to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server, so that the first terminal enters the audio and video conference through the real-time interactive token of the first server, thereby realizing the authentication between the first server and the third-party server, improving the security between the first server and the third-party server, and the user can select the audio and video server to receive and send the audio and video stream according to their own needs, with strong selectivity and flexibility.
[0053] As an optional specific embodiment, in step 201, when the first terminal creates an audio and video conference on the first server through the first account, before controlling the first server to obtain the real-time message identification number and the real-time message token corresponding to the first account and sending them to the audio and video server, the method further includes:
[0054] Step 200, when the first terminal logs in to the first account and sends the first account to the first server, control the first server to send the first identity identification number and the first token corresponding to the first account to the first terminal, so that the first terminal logs in to the first server through the first identity identification number and the first token.
[0055] Specifically, the user uses the first account to log in to the first terminal, the first terminal sends the first account to the first server through the login interface of the first server, the first server obtains the first identity identification number ID and the first token Token corresponding to the first account, and returns the first ID and the first Token to the first terminal through the login interface of the first server, and the first terminal logs in to the first server according to the first ID and the first Token.
[0056] It should be noted that a first account is created on the first server, and the first ID and first token of the first account and the validity period of the first token are set. For example, the first token is set to be valid for 30 days. If the difference between the current time when the first account logs into the first server or the first terminal and the time when the first token is generated exceeds 30 days, the first token returned by the login interface of the first server to the first terminal for login is invalid, and the first terminal needs to re-retrieve the first token on the first server and successfully log in to the first server through the latest first token.
[0057] Furthermore, if Figure 1 As shown, the audio and video conferencing system further includes a streaming media server 14 , which is communicatively connected to the first server 11 .
[0058] The step 100 controls the first server to send the first identity identification number and the first token corresponding to the first account to the first terminal, so that the first terminal logs in to the first server through the first identity identification number and the first token, and specifically includes:
[0059] Control the first server to send the first identity identification number and the first token corresponding to the first account, and the second identity identification number and the second token of the streaming media server to the first terminal, so that the first terminal logs in to the first server through the first identity identification number and the first token, and logs in to the streaming media server through the second identity identification number and the second token.
[0060] Specifically, the user uses the first account to log in to the first terminal, and the first terminal sends the first account to the first server through the login interface of the first server. The first server obtains the first ID and the first Token corresponding to the first account, and obtains the second ID and the second Token of the streaming media server corresponding to the first account. The first server returns the first ID and the first Token as well as the second ID and the second Token to the first terminal through the login interface of the first server, and the first terminal logs in to the first server according to the first ID and the first Token. After successfully logging in to the first server, the first terminal uses the second ID and the second Token of the streaming media server to log in to the streaming media server so that functions such as sharing can be used in audio and video conferences.
[0061] As an optional specific embodiment, the method may further include:
[0062] When the second terminal logs in to the first server and the streaming server through the first identity identification number and the first token, the second identity identification number and the second token, control the streaming server to send a kick signaling to the first terminal, and send indication information of updating the first token to the first server;
[0063] Control the first server to update the first token according to the instruction information.
[0064] Specifically, after the first account logs in to the first server and the streaming media server through the first terminal, if a second terminal later logs in to the first server and the streaming media server through the first account, the streaming media server will send a kick signaling to the first terminal that logged in previously, and will also send an instruction message to the first server to instruct the update of the first token corresponding to the first account. After receiving the instruction message, the first server updates the first token corresponding to the first account. If the original first terminal uses the first token before the update to call the interface on the first server, it will be displayed that the first token is invalid.
[0065] As an optional specific embodiment, the step 203 controls the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and real-time message token corresponding to the first account, including:
[0066] Controlling the first server to obtain facial information at the current time from the first terminal;
[0067] Control the first server to obtain the real-time interaction identification number corresponding to the first account, and generate an authentication instruction through the conference number of the audio and video conference, the facial information, and the real-time message identification number, the real-time message token, and the real-time interaction identification number corresponding to the first account;
[0068] Among them, the authentication instruction includes: a protocol header and a payload, and the payload includes: the conference number of the audio and video conference, the facial information, and the real-time message identification number, real-time message token and real-time interaction identification number corresponding to the first account.
[0069] Specifically, before the first account enters the audio and video conference, the first terminal obtains the on-site photos at the current time, identifies the facial information from the on-site photos, and sends the facial information to the first server through the first server's conference joining interface. The first server obtains the real-time interactive identification number RtcId corresponding to the first account in the local database, and generates an authentication instruction based on the conference number of the audio and video conference, the facial information, and the RtmId, RtmToken, and RtcId corresponding to the first account. The format of the authentication instruction is protocol header + payload, and the payload is generated by the conference number of the audio and video conference, the facial information, and the RtmId, RtmToken, and RtcId corresponding to the first account.
[0070] It should be noted that when creating the first account on the first server, the first server calls the audio and video server interface, obtains the RtmId, RtmToken, and RtcId of the first account on the audio and video server, binds the RtmId, RtmToken, and RtcId to the first account, and stores the RtmId, RtmToken, RtcId, the first account, and the binding relationship between them in the local database of the first server. Among them, RtmToken will have a validity period (such as 24 hours), and the first server will refresh the RtmToken of the first account to the local database 24 hours before the end of the validity period.
[0071] As an optional specific embodiment, in step 204, when the authentication instruction is successfully authenticated, controlling the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and sending it to the first server, so that the first terminal enters the audio and video conference through the real-time interactive token of the first server, specifically includes:
[0072] When the authentication instruction is successfully authenticated, control the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server;
[0073] Control the first server to send the real-time interactive token corresponding to the first account and the channel number identification number of the audio and video conference to the first terminal, so that the first terminal enters the channel corresponding to the audio and video conference of the audio and video server through the real-time interactive token corresponding to the first account and the channel number identification number of the audio and video conference to receive and hear audio and video streams.
[0074] Specifically, the first server sends the real-time interactive token RtcToken corresponding to the first account and the channel number identification number of the audio and video conference to the first terminal through the first server's join conference interface. The first terminal enters the channel corresponding to the audio and video conference of the audio and video server through the real-time interactive token RtcToken corresponding to the first account and the channel number identification number of the audio and video conference to receive and send audio and video streams.
[0075] As an optional specific embodiment, in step 204, when the authentication instruction is successfully authenticated, controlling the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and sending it to the first server includes:
[0076] Control the audio and video server to determine whether the authentication instruction conforms to the authentication format, and if so, control the audio and video server to authenticate the authentication instruction;
[0077] When the authentication instruction is successfully authenticated, the audio and video server is controlled to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server.
[0078] Specifically, after receiving the authentication instruction, the audio and video server determines whether the authentication instruction conforms to the authentication format, that is, whether the authentication instruction is in the format of protocol header + payload, and the payload is in the format of the audio and video conference number + facial information + RtmId + RtmToken + RtcId. If the authentication instruction conforms to the above format, the audio and video server determines whether the first account has the authority to communicate with the audio and video server through the authentication instruction. If the authentication is successful, it means that the first account has the authority to communicate with the audio and video server. The audio and video server generates the RtcToken corresponding to the first account according to the authentication instruction, and sends the RtcToken corresponding to the first account to the first server through the audio and video server's join conference interface. Invalid authentication requests can be filtered to avoid invalid authentication caused by multi-terminal logins, thereby improving the security of audio and video conferences.
[0079] It should be noted that, for the method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the described order of actions, because according to the embodiments of the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.
[0080] In summary, the above embodiments of the present application can filter invalid authentication requests through the format of the authentication instruction, avoid invalid authentication caused by multi-terminal login, and improve the security of audio and video conferences. In addition, the authentication instruction generated by the conference number + facial information + RtmId + RtmToken + RtcId of the audio and video conference can ensure the real-time nature of the authentication instruction, and because RtmToken has a validity period, the security of data transmission between the first server and the third-party server can be guaranteed. In addition, when multiple devices log in to the first server and the streaming media server through the same account, the streaming media server sends a kick signal to the first terminal that logged in previously, and instructs the first server to update the first token corresponding to the first account, to ensure that the account is valid and legal for audio and video conferences, and to improve the security of audio and video conferences. In addition, users can choose the audio and video server to receive and send audio and video streams according to their own needs, with strong selectivity and flexibility.
[0081] Reference Figure 3 The embodiment of the present application provides a device 300 for joining an audio and video conference, which is applied to an audio and video conference system. The audio and video conference system includes: a first server and an audio and video server. The device may specifically include the following modules:
[0082] The first control module 301 is used to control the first server to obtain the real-time message identification number and the real-time message token corresponding to the first account and send them to the audio and video server when the first terminal creates an audio and video conference on the first server through the first account. The first server is connected between the first terminal and the audio and video server, and is used to send and receive data and generate authentication instructions according to the binding relationship between the saved real-time message identification number, the real-time message token, the real-time interaction identification number, and the first account. The audio and video server is used to create an audio and video conference and send and receive audio and video streams of the audio and video conference;
[0083] The second control module 302 is used to control the audio and video server to create an audio and video conference according to the real-time message identification number and the real-time message token corresponding to the first account, and generate a conference number and a channel number identification number of the audio and video conference, and send the conference number and the channel number identification number of the audio and video conference to the first server;
[0084] The third control module 303 is used to control the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and real-time message token corresponding to the first account, and send the authentication instruction to the audio and video server;
[0085] The fourth control module 304 is used to control the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server when the authentication instruction is successfully authenticated, so that the first terminal can enter the audio and video conference through the real-time interactive token of the first server.
[0086] In the case where the first terminal creates an audio and video conference on the first server through the first account, the first server is controlled to obtain the real-time message identification number and the real-time message token corresponding to the first account and send them to the audio and video server. The first server is connected between the first terminal and the audio and video server and is used to generate data reception and authentication instructions according to the binding relationship between the saved real-time message identification number, the real-time message token, the real-time interaction identification number, and the first account. The audio and video server is used to create an audio and video conference and send and receive the audio and video streams of the audio and video conference; the audio and video server is controlled to receive the real-time message identification number and the real-time message token corresponding to the first account according to the real-time message identification number and the real-time interaction identification number. The real-time message token creates an audio and video conference, generates the conference number and channel number identification number of the audio and video conference, and sends the conference number and channel number identification number of the audio and video conference to the first server, controls the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and real-time message token corresponding to the first account, and sends the authentication instruction to the audio and video server, thereby, the authentication instruction generated by the real-time message identification number and the real-time message token can ensure the real-time nature of the authentication instruction, and because the real-time message token has a validity period, the security of data transmission between the first server and the third-party server can be guaranteed. And, in the case of successful authentication of the authentication instruction, control the audio and video server to generate the real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server, so that the first terminal enters the audio and video conference through the real-time interactive token of the first server, thereby realizing the authentication between the first server and the third-party server, improving the security between the first server and the third-party server, and the user can select the audio and video server to receive the audio and video stream according to their own needs, which is highly selective and flexible. Optionally, the fourth control module 304 is specifically used to:
[0087] When the authentication instruction is successfully authenticated, control the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server;
[0088] Control the first server to send the real-time interactive token corresponding to the first account and the channel number identification number of the audio and video conference to the first terminal, so that the first terminal enters the channel corresponding to the audio and video conference of the audio and video server through the real-time interactive token corresponding to the first account and the channel number identification number of the audio and video conference to receive and hear audio and video streams.
[0089] Optionally, when the authentication instruction is successfully authenticated, the fourth control module 304 controls the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and sends it to the first server, specifically for:
[0090] Control the audio and video server to determine whether the authentication instruction conforms to the authentication format, and if so, control the audio and video server to authenticate the authentication instruction;
[0091] If the authentication is successful, the audio and video server is controlled to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server.
[0092] Optionally, the device further comprises:
[0093] a fifth control module, for controlling the first server to send a first identity identification number and a first token corresponding to the first account to the first terminal when the first terminal logs in to the first account and sends the first account to the first server, so that the first terminal logs in to the first server through the first identity identification number and the first token.
[0094] Optionally, the audio and video conferencing system further includes a streaming media server, and the fifth control module is specifically used to:
[0095] Control the first server to send the first identity identification number and the first token corresponding to the first account, and the second identity identification number and the second token of the streaming media server to the first terminal, so that the first terminal logs in to the first server through the first identity identification number and the first token, and logs in to the streaming media server through the second identity identification number and the second token.
[0096] Optionally, the device further comprises:
[0097] a sixth control module, configured to control the streaming media server to send a kicked signal to the first terminal and to send an indication message of updating the first token to the first server when the second terminal logs in to the first server and the streaming media server through the first identity identification number and the first token, and the second identity identification number and the second token;
[0098] Control the first server to update the first token according to the instruction information.
[0099] Optionally, when the third control module 303 controls the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and real-time message token corresponding to the first account, it is specifically used to:
[0100] Controlling the first server to obtain facial information at the current time from the first terminal;
[0101] Control the first server to obtain the real-time interaction identification number corresponding to the first account, and generate an authentication instruction through the conference number of the audio and video conference, the facial information, and the real-time message identification number, the real-time message token, and the real-time interaction identification number corresponding to the first account;
[0102] Among them, the authentication instruction includes: a protocol header and a payload, and the payload includes: the conference number of the audio and video conference, the facial information, and the real-time message identification number, real-time message token and real-time interaction identification number corresponding to the first account.
[0103] In summary, the above embodiments of the present application can filter invalid authentication requests through the format of the authentication instruction, avoid invalid authentication caused by multi-terminal login, and improve the security of audio and video conferences. In addition, the authentication instruction generated by the conference number + facial information + RtmId + RtmToken + RtcId of the audio and video conference can ensure the real-time nature of the authentication instruction, and because RtmToken has a validity period, the security of data transmission between the first server and the third-party server can be guaranteed. In addition, when multiple devices log in to the first server and the streaming media server through the same account, the streaming media server sends a kick signal to the first terminal that logged in previously, and instructs the first server to update the first token corresponding to the first account, to ensure that the account is valid and legal for audio and video conferences, and to improve the security of audio and video conferences. In addition, users can choose the audio and video server to receive and send audio and video streams according to their own needs, with strong selectivity and flexibility.
[0104] It should be noted that the division of units in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional unit in each embodiment of the present application may be integrated into a processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0105] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a processor-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program codes.
[0106] An embodiment of the present application further provides an electronic device, including:
[0107] one or more processors; and
[0108] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to execute the method for joining an audio or video conference as described above.
[0109] The processor can be a central processing unit (CPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or a complex programmable logic device (CPLD), and the processor can also adopt a multi-core architecture.
[0110] It should be noted here that the above-mentioned electronic device provided in the embodiment of the present application can implement all the method steps implemented in the above-mentioned audio and video conference joining method embodiment, and can achieve the same technical effect. The parts and beneficial effects of this embodiment that are the same as the method embodiment will not be described in detail here.
[0111] An embodiment of the present application also provides a processor-readable storage medium, which stores a computer program that enables the processor to execute the above-mentioned method for joining an audio or video conference.
[0112] The processor-readable storage medium can be any available medium or data storage device that can be accessed by the processor, including but not limited to magnetic storage (such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc.), optical storage (such as CD, DVD, BD, HVD, etc.), and semiconductor storage (such as ROM, EPROM, EEPROM, non-volatile memory (NANDFLASH), solid-state drive (SSD)), etc.
[0113] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.
[0114] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer executable instructions. These computer executable instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0115] These processor executable instructions may also be stored in a processor readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the processor readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0116] These processor-executable instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0117] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A method for joining an audio and video conference, applied to an audio and video conference system, It is characterized in that The audio and video conferencing system includes: a first server and an audio and video server, and the method includes: When the first terminal creates an audio and video conference on the first server through the first account, the first server is controlled to obtain the real-time message identification number and the real-time message token corresponding to the first account and send them to the audio and video server. The first server is connected between the first terminal and the audio and video server, and is used to send and receive data and generate authentication instructions according to the binding relationship between the saved real-time message identification number, the real-time message token, the real-time interaction identification number, and the first account. The audio and video server is used to create an audio and video conference and send and receive audio and video streams of the audio and video conference; Control the audio and video server to create an audio and video conference according to the real-time message identification number and the real-time message token corresponding to the first account, generate a conference number and a channel number identification number of the audio and video conference, and send the conference number and the channel number identification number of the audio and video conference to the first server; Control the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and real-time message token corresponding to the first account, and send the authentication instruction to the audio and video server; When the authentication instruction is successfully authenticated, the audio and video server is controlled to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server, so that the first terminal can enter the audio and video conference through the real-time interactive token of the first server.
2. The method according to claim 1, It is characterized in that When the authentication instruction is successfully authenticated, controlling the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and sending the token to the first server, so that the first terminal enters the audio and video conference through the real-time interactive token of the first server, includes: When the authentication instruction is successfully authenticated, control the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server; Control the first server to send the real-time interactive token corresponding to the first account and the channel number identification number of the audio and video conference to the first terminal, so that the first terminal enters the channel corresponding to the audio and video conference of the audio and video server through the real-time interactive token corresponding to the first account and the channel number identification number of the audio and video conference to receive and hear audio and video streams.
3. The method according to claim 1, It is characterized in that When the authentication instruction is successfully authenticated, controlling the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and sending the token to the first server includes: Control the audio and video server to determine whether the authentication instruction conforms to the authentication format, and if so, control the audio and video server to authenticate the authentication instruction; If the authentication is successful, the audio and video server is controlled to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server.
4. The method according to claim 1, It is characterized in that When the first terminal creates an audio and video conference on the first server through the first account, before controlling the first server to obtain the real-time message identification number and the real-time message token corresponding to the first account and sending them to the audio and video server, the method further includes: When the first terminal logs in to the first account and sends the first account to the first server, the first server is controlled to send the first identity identification number and the first token corresponding to the first account to the first terminal, so that the first terminal logs in to the first server through the first identity identification number and the first token.
5. The method according to claim 4, It is characterized in that The audio and video conference system further includes a streaming media server, and the controlling the first server to send a first identity identification number and a first token corresponding to the first account to the first terminal so that the first terminal logs in to the first server through the first identity identification number and the first token includes: Control the first server to send the first identity identification number and the first token corresponding to the first account, and the second identity identification number and the second token of the streaming media server to the first terminal, so that the first terminal logs in to the first server through the first identity identification number and the first token, and logs in to the streaming media server through the second identity identification number and the second token.
6. The method according to claim 5, It is characterized in that The method further comprises: When the second terminal logs in to the first server and the streaming server through the first identity identification number and the first token, the second identity identification number and the second token, control the streaming server to send a kick signaling to the first terminal, and send indication information of updating the first token to the first server; Control the first server to update the first token according to the instruction information.
7. The method according to claim 1, It is characterized in that The controlling the first server to generate an authentication instruction according to the conference number of the audio and video conference and the real-time message identification number and the real-time message token corresponding to the first account includes: Controlling the first server to obtain facial information at the current time from the first terminal; Control the first server to obtain the real-time interaction identification number corresponding to the first account, and generate an authentication instruction through the conference number of the audio and video conference, the facial information, and the real-time message identification number, the real-time message token, and the real-time interaction identification number corresponding to the first account; Among them, the authentication instruction includes: a protocol header and a payload, and the payload includes: the conference number of the audio and video conference, the facial information, and the real-time message identification number, real-time message token and real-time interaction identification number corresponding to the first account.
8. An audio and video conference joining device, applied to an audio and video conference system, It is characterized in that The audio and video conference system includes: a first server and an audio and video server, and the device includes: A first control module, used for controlling the first server to obtain the real-time message identification number and the real-time message token corresponding to the first account and send them to the audio and video server when the first terminal creates an audio and video conference on the first server through the first account, the first server is connected between the first terminal and the audio and video server, and is used for sending and receiving data and generating authentication instructions according to the binding relationship between the saved real-time message identification number, the real-time message token, the real-time interaction identification number, and the first account, and the audio and video server is used to create an audio and video conference and send and receive audio and video streams of the audio and video conference; A second control module is used to control the audio and video server to create an audio and video conference according to the real-time message identification number and the real-time message token corresponding to the first account, and to generate a conference number and a channel number identification number of the audio and video conference, and to send the conference number and the channel number identification number of the audio and video conference to the first server; A third control module is used to control the first server to generate an authentication instruction through the conference number of the audio and video conference and the real-time message identification number and real-time message token corresponding to the first account, and send the authentication instruction to the audio and video server; The fourth control module is used to control the audio and video server to generate a real-time interactive token corresponding to the first account according to the authentication instruction and send it to the first server when the authentication instruction is successfully authenticated, so that the first terminal can enter the audio and video conference through the real-time interactive token of the first server.
9. An electronic device, It is characterized in that include: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to execute the method for joining an audio or video conference as described in any one of claims 1 to 7.
10. A computer-readable storage medium, It is characterized in that The computer program stored therein enables the processor to execute the method for joining an audio or video conference as described in any one of claims 1 to 7.
