Video conference live broadcast method and device

Abstract

The embodiment of the present invention provides a method and device for live broadcasting of a video conference, the method comprising: configuring a virtual terminal on the server, the virtual terminal supporting the video conference function; when the virtual terminal joins the video conference, the audio and video streams of the video conference are transmitted to the user terminal through the pull stream address of at least one live broadcast protocol bound to the virtual terminal. The embodiment of the present invention enables the video conference to be pushed to the Internet in different live broadcast protocols in the visual network, meeting the needs of users.

Description

Technical Field

[0001] The present invention relates to the field of visual networking technology, and in particular to a video conference live broadcast method and a video conference live broadcast device. Background Art

[0002] At present, with the popularization and development of visual networking services across the country, the visual networking high-definition video interaction technology plays a vital role in various industries. The visual networking adopts the world's most advanced VisionVera real-time high-definition video exchange technology, which realizes the real-time transmission of high-definition video across the entire network that cannot be achieved by the Internet at present, and can provide high-definition visual networking video conferencing services.

[0003] However, currently video conferencing can only be broadcast live within the video network and cannot be broadcast live to the Internet. Summary of the invention

[0004] In view of the above problems, embodiments of the present invention are proposed to provide a method for live broadcasting of a video conference and a corresponding device for live broadcasting of a video conference that overcome the above problems or at least partially solve the above problems.

[0005] In order to solve the above problems, an embodiment of the present invention discloses a method for live broadcasting of a video conference, the method comprising:

[0006] Configuring a virtual terminal on the server, wherein the virtual terminal supports a video conferencing function;

[0007] When the virtual terminal joins a video conference, the audio and video streams of the video conference are transmitted to the user terminal through the stream pulling address of at least one live broadcast protocol bound to the virtual terminal.

[0008] Optionally, the user terminal includes a visual networking terminal and / or an Internet terminal.

[0009] Optionally, when the virtual terminal joins the video conference, transmitting the audio and video streams of the video conference to the user terminal through the streaming address of at least one live broadcast protocol bound to the virtual terminal includes:

[0010] When the virtual terminal joins the video conference, the audio and video streams of the target participating terminal in the video conference are obtained;

[0011] The audio and video streams of the target conference participant terminal are transmitted to the user terminal through the streaming address of at least one live broadcast protocol bound to the virtual terminal.

[0012] Optionally, the target participating terminals include all participating terminals of the video conference, or one or more preset participating terminals, or participating terminals determined in sequence from all participating terminals.

[0013] Optionally, the user terminal includes a terminal that has participated in the conference and a terminal that has not participated in the conference; and the method further includes:

[0014] In response to the conference joining request sent by the non-participating terminal, the conference joining request is forwarded to the conference control terminal, so that the conference control terminal adds the non-participating terminal to the video conference according to the conference joining request.

[0015] Optionally, when the virtual terminal joins the video conference, transmitting the audio and video streams of the video conference to the user terminal through the streaming address of at least one live broadcast protocol bound to the virtual terminal includes:

[0016] When the virtual terminal joins the video conference, the audio and video streams of the video conference are pushed to the cloud server according to at least one push stream address bound to the virtual terminal;

[0017] The audio and video streams of the cloud server are transmitted to the user terminal according to the pull stream addresses of the multiple live broadcast protocols of the live broadcast source corresponding to the at least one push stream address.

[0018] Optionally, the transmitting the audio and video streams of the cloud server to the user terminal according to the pull stream addresses of multiple live broadcast protocols of the live broadcast source corresponding to the at least one push stream address includes:

[0019] Sending to the user terminal the pull stream addresses of multiple live broadcast protocols of the live broadcast source corresponding to the at least one push stream address, so that the user terminal obtains the corresponding audio and video streams of the cloud server according to the pull stream addresses corresponding to the multiple live broadcast protocols.

[0020] The embodiment of the present invention further discloses a video conference live broadcast device, the device comprising:

[0021] A configuration module, used for configuring a virtual terminal on the server, wherein the virtual terminal supports a video conferencing function;

[0022] The transmission module is used to transmit the audio and video streams of the video conference to the user terminal through the pull stream address of at least one live broadcast protocol bound to the virtual terminal when the virtual terminal joins the video conference.

[0023] Optionally, the user terminal includes a visual networking terminal and / or an Internet terminal.

[0024] Optionally, the transmission module includes:

[0025] A target stream acquisition submodule, used for acquiring the audio and video streams of the target participating terminal in the video conference when the virtual terminal joins the video conference;

[0026] The target stream transmission submodule is used to transmit the audio and video stream of the target conference terminal to the user terminal through the stream pulling address of at least one live broadcast protocol bound to the virtual terminal.

[0027] Optionally, the target participating terminals include all participating terminals of the video conference, or one or more preset participating terminals, or participating terminals determined in sequence from all participating terminals.

[0028] Optionally, the user terminal includes a terminal that has participated in the conference and a terminal that has not participated in the conference; and the device further includes:

[0029] The conference request forwarding module is used to respond to the conference request sent by the non-participating terminal and forward the conference request to the conference control end, so that the conference control end adds the non-participating terminal to the video conference according to the conference request.

[0030] Optionally, the transmission module includes:

[0031] A streaming processing submodule, configured to stream the audio and video streams of the video conference to a cloud server according to at least one streaming address bound to the virtual terminal when the virtual terminal joins the video conference;

[0032] The stream pulling processing submodule is used to transmit the audio and video streams of the cloud server to the user terminal according to the stream pulling addresses of multiple live broadcast protocols of the live broadcast source corresponding to the at least one push stream address.

[0033] Optionally, the stream pulling processing submodule includes:

[0034] The streaming unit is used to send to the user terminal the streaming addresses of multiple live broadcast protocols of the live broadcast source corresponding to the at least one streaming push address, so that the user terminal can obtain the corresponding audio and video streams of the cloud server according to the streaming addresses corresponding to the multiple live broadcast protocols.

[0035] An embodiment of the present invention further discloses an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the steps of the video conference live broadcast method described above when executed by the processor.

[0036] The embodiment of the present invention further discloses a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the video conference live broadcast method described above are implemented.

[0037] The embodiments of the present invention include the following advantages:

[0038] In the embodiment of the present invention, a virtual terminal can be configured on the server, and the virtual terminal can support the video conferencing function; when the virtual terminal joins the video conference, the audio and video streams of the video conference can be transmitted to the user terminal through the pull stream address of at least one live broadcast protocol bound to the virtual terminal. The embodiment of the present invention enables the video conference to be pushed to the user terminal on the Internet in different live broadcast protocols in the visual network, meeting the user's needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 It is a flowchart of the steps of a video conference live broadcast method provided by an embodiment of the present invention;

[0040] Figure 2 is a flowchart of another method for live broadcasting of a video conference provided by an embodiment of the present invention;

[0041] Figure 3 It is a communication framework diagram for live broadcasting of a video conference on a visual network in an embodiment of the present invention;

[0042] Figure 4 This is a flowchart of the steps of a method for a live broadcast source to join a video conference provided by an embodiment of the present invention;

[0043] Figure 5 It is a flowchart of the steps of another method for a live broadcast source to join a video conference provided by an embodiment of the present invention;

[0044] Figure 6 It is a structural block diagram of a video conference live broadcast device provided by an embodiment of the present invention;

[0045] Figure 7 The present invention provides a structural block diagram of a device for a live broadcast source to join a video conference. DETAILED DESCRIPTION

[0046] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0047] Reference Figure 1 , shows a flowchart of a method for live broadcasting of a video conference provided by an embodiment of the present invention, and the method may specifically include the following steps:

[0048] Step 101: configure a virtual terminal on a server, wherein the virtual terminal supports a video conferencing function.

[0049] The method of the embodiment of the present invention can be applied to a visual network server, the video conference can be a visual network video conference, and the visual network server can include a server for implementing various functions in the visual network. For example, the visual network server can include a streaming media server. The streaming media server is a bridge and link between the visual network and the Internet audio and video transmission service, which realizes the interconnection between the visual network service and the Internet service, and can securely connect various audio and video resources in the Internet to the visual network, and can also securely connect various audio and video resources in the visual network to the Internet.

[0050] Exemplarily, multiple virtual terminals can be configured on the visual network server, and each virtual terminal can be identified by a virtual terminal number. The state of the virtual terminal can be indicated by a state identifier, for example, an idle state identifier can indicate that the virtual terminal is idle and can be used. The virtual terminal configured by the visual network server can support the visual network video conferencing function, that is, the virtual terminal can support joining the visual network video conference, as a participant of the visual network video conference, and receive the audio and video streams of the visual network video conference.

[0051] Step 102: When the virtual terminal joins a video conference, the audio and video streams of the video conference are transmitted to the user terminal through the streaming address of at least one live broadcast protocol bound to the virtual terminal.

[0052] In an embodiment of the present invention, the video network server can support the use of various Internet live broadcast protocols to broadcast the video network video conference live. Exemplary, the live broadcast protocol may include but is not limited to RTSP (Real Time Streaming Protocol, real-time streaming protocol), RTMP (Real Time Messaging Protocol, real-time messaging protocol), HLS (HTTP Live Streaming, HTTP-based streaming media network transmission protocol).

[0053] When a virtual terminal joins a visual network video conference as a participant, the visual network server can generate a streaming address of at least one live broadcast protocol for the audio and video streams of the video conference, and can transmit the audio and video streams to the user terminal through the streaming address. Among them, the user terminal may include a visual network terminal and an Internet terminal. Streaming refers to the process of pulling the audio and video streams to the user terminal, and the user terminal can use the streaming address to pull the audio and video streams of the visual network video conference. Exemplarily, the user terminal may be installed with a live broadcast APP. When the user wants to watch the visual network video conference live, the user can use the streaming address to pull the audio and video streams of the visual network video conference through the live broadcast APP and play them.

[0054] In one example, the visual network server can generate at least one live streaming protocol streaming address for the audio and video stream of the video conference corresponding to the virtual terminal, and transmit the audio and video stream of the video conference to the user terminal through the streaming address of at least one live streaming protocol. For example, taking a streaming media server as an example, when a virtual terminal configured on the streaming media server joins a video conference, the audio and video stream of the video conference can be obtained through the virtual terminal. The streaming media server can generate multiple live streaming protocol streaming addresses for the audio and video stream of the video conference corresponding to the virtual terminal, and transmit the audio and video stream of the video conference to the user terminal through the streaming address of at least one live streaming protocol.

[0055] In another example, the visual network server can obtain the streaming address generated by the cloud server, and push the audio and video stream of the video conference corresponding to the virtual terminal to the cloud server according to the streaming address. The visual network server can obtain the streaming address of at least one live broadcast protocol generated by the cloud server for the audio and video stream, and the visual network server can transmit the audio and video stream of the video conference to the user terminal through the streaming address of at least one live broadcast protocol.

[0056] In an embodiment of the present invention, step 102 may include the following sub-steps S11-S12:

[0057] Sub-step S11, when the virtual terminal joins a video conference, obtaining the audio and video streams of the target participating terminal in the video conference.

[0058] When a virtual terminal joins a video conference, the audio and video streams of the target participating terminal in the video conference can be obtained through the virtual terminal.

[0059] Exemplarily, the target participating terminals may be all participating terminals participating in the video conference. For example, the video conference may be set to display the audio and video streams of all participating terminals in a split-screen manner. If the network bandwidth permits, the video network server may broadcast the audio and video streams of all participating terminals live and send the audio and video streams of all participating terminals to the user terminal.

[0060] Exemplarily, the target participant terminal may be one or more preset participant terminals participating in the video conference. For example, the video conference may be set to display the audio and video streams of the preset participant terminals such as the chairman or host in a split-screen manner, and the video network server may broadcast the audio and video streams of the preset one or more participant terminals live, and send the audio and video streams of the preset one or more participant terminals to the user terminal.

[0061] Exemplarily, the target participating terminal may be a participating terminal determined in sequence from all participating terminals. For example, the video conference may be set to display the audio and video streams of each participating terminal in sequence in a carousel manner, and the video network server may send the audio and video streams of the participating terminals determined in sequence to the user terminal.

[0062] Sub-step S12, transmitting the audio and video stream of the target participating terminal to the user terminal through the streaming address of at least one live broadcast protocol bound to the virtual terminal.

[0063] The audio and video streams of the target participating terminal can be transmitted to the user terminal through the streaming addresses of various live broadcast protocols bound to the virtual terminal.

[0064] In the embodiment of the present invention, a virtual terminal can be configured on the server, and the virtual terminal can support the video conferencing function; when the virtual terminal joins the video conference, the audio and video streams of the video conference can be transmitted to the user terminal through the pull stream address of at least one live broadcast protocol bound to the virtual terminal. The embodiment of the present invention enables the video conference to be pushed to the user terminal in different live broadcast protocols in the visual network, meeting the user's needs.

[0065] Reference Figure 2 , shows a flowchart of another method for live broadcasting of a video conference provided by an embodiment of the present invention, wherein the method may specifically include the following steps:

[0066] Step 201: configure a virtual terminal on a server, wherein the virtual terminal supports a video conferencing function.

[0067] The method of the embodiment of the present invention can be applied to a visual network server, the video conference can be a visual network video conference, the visual network server can include a server for implementing various functions in the visual network, and illustratively, the visual network server can be a streaming media server. For ease of understanding, this embodiment is described by taking the visual network server as a streaming media server.

[0068] Exemplarily, the method further includes: sending a conference joining request to the conference control terminal according to the virtual terminal, so that the conference control terminal joins the virtual terminal into the video conference according to the conference joining request.

[0069] The streaming media server can communicate with the conference control terminal of the visual network, which is used to manage video conferences; the conference control terminal can be the client of the visual network video conference scheduling system, a client software running on a personal computer platform, which can be used for conference appointments, conference creation, conference process management, control, starting and stopping meetings, switching speakers, split-screen mode, etc.

[0070] After creating a video conference, the conference control end can add participants to the video conference. For video conferences that need to be live, the streaming media server can configure a virtual terminal that supports the video conference function. The conference control end can add the virtual terminal configured by the streaming media server as a participant of the video conference.

[0071] Reference Figure 3 The figure shows a communication framework diagram for live broadcasting of a visual network video conference in an embodiment of the present invention. The streaming media server can communicate in the visual network and the Internet. The streaming media server can communicate with the conference control terminal through the visual network, and can also communicate with the user terminal, wherein the user terminal can include a visual network terminal and an Internet terminal. In the visual network, the conference control terminal can create a visual network video conference, add a visual network terminal to the visual network video conference, and add a virtual terminal allocated by the streaming media server to the visual network video conference.

[0072] Step 202: When the virtual terminal joins a video conference, the audio and video streams of the video conference are pushed to a cloud server according to at least one push stream address bound to the virtual terminal.

[0073] Exemplarily, the streaming media server can obtain the streaming addresses of multiple live broadcast protocols generated by the cloud server, and bind the streaming addresses of multiple live broadcast protocols to the virtual terminal; exemplary, the streaming media server includes a live broadcast service module, which can obtain the streaming addresses of multiple live broadcast protocols generated by the cloud server through the live broadcast service module, and bind the virtual terminal of the participant to the streaming addresses of multiple live broadcast protocols.

[0074] Push streaming refers to the process of pushing the video stream of the live broadcast end to the set server location. The push streaming address refers to the server location URL where the audio and video streams need to be pushed. For example, the push streaming address of the RTMP protocol can be: RTMP: / / XXXXXX. When using multiple live broadcast protocols, you can set the corresponding push streaming address for each live broadcast protocol.

[0075] Exemplarily, the streaming media server can be provided with streaming modules corresponding to multiple live broadcast protocols. The streaming media server can analyze which live broadcast protocols the streaming address belongs to, call the streaming module corresponding to the live broadcast protocol, and stream the audio and video streams to the cloud server according to the streaming address.

[0076] For example, when a virtual terminal joins a video conference, the streaming media server can obtain the audio and video streams of the target participating terminal in the video conference through the virtual terminal, and push the audio and video streams of the target participating terminal to the cloud server according to at least one push stream address bound to the virtual terminal; the cloud server is a server on the Internet, and different push stream addresses can be generated for different cloud servers. The target participating terminal can be all participating terminals participating in the video conference, or one or more preset participating terminals participating in the video conference, or participating terminals determined in sequence from all participating terminals.

[0077] In the embodiment of the present invention, step 202 may include: when the virtual terminal joins the video conference, calling the streaming modules corresponding to the multiple live broadcast protocols bound to the virtual terminal, and streaming the audio and video streams to the cloud server according to the streaming address.

[0078] Step 203: The audio and video streams of the cloud server are transmitted to the user terminal according to the pull stream addresses of the multiple live broadcast protocols of the live broadcast source corresponding to the at least one push stream address.

[0079] The cloud server can generate the pull stream addresses of multiple live broadcast protocols for the audio and video streams of the live broadcast source corresponding to each push stream address. The streaming media server can obtain the pull stream addresses of multiple live broadcast protocols generated by the cloud server for the audio and video streams of the live broadcast source, and bind the pull stream addresses of multiple live broadcast protocols to the virtual terminal as a participant. The pull stream address refers to the address for pulling the audio and video stream from the cloud server. The streaming media server can transmit the audio and video streams of the cloud server to the user terminal according to the pull stream addresses of multiple live broadcast protocols bound to the virtual terminal.

[0080] In an embodiment of the present invention, step 203 may include: sending to the user terminal the pull stream addresses of multiple live broadcast protocols of the live broadcast source corresponding to the at least one push stream address, so that the user terminal obtains the corresponding audio and video stream of the cloud server according to the pull stream addresses corresponding to the multiple live broadcast protocols.

[0081] For example, the user terminal may be installed with a live broadcast APP. When the streaming media server pushes the audio and video streams of the visual network video conference to the cloud server, the streaming media server may send a live broadcast notification message to the live broadcast APP of the user terminal. The live broadcast notification message may include the information of the live visual network video conference (for example, the introduction information of the visual network video conference) and the corresponding streaming address. After receiving the live broadcast notification message, the live broadcast APP of the user terminal may create a conference live broadcast room and show the live broadcast room list to the user. The user may select the live broadcast of the visual network video conference that the user wants to watch from the live broadcast room list. The live broadcast APP may obtain the corresponding audio and video stream from the cloud server for playback according to the streaming address of the live visual network video conference that the user wants to watch, so that the user can watch the live visual network video conference.

[0082] Step 204: respond to the conference joining request sent by the non-participating terminal and forward the conference joining request to the conference control terminal, so that the conference control terminal adds the non-participating terminal to the video conference according to the conference joining request.

[0083] In the embodiment of the present invention, in addition to watching the live broadcast of the video conference on the visual network, the user terminal can also participate in the video conference on the visual network. The user terminal can send a conference participation request to the streaming media server, and the streaming media server can forward the conference participation request to the conference control terminal, so that the conference control terminal can join the user terminal to the video conference on the visual network according to the conference participation request.

[0084] In the embodiment of the present invention, step 204 may include the following sub-steps:

[0085] Sub-step S21, configuring a virtual terminal on the server, and binding the non-participating terminal to the virtual terminal;

[0086] Sub-step S22, in response to the joining request sent by the non-participating terminal based on the virtual terminal, forwarding the joining request to the conference control terminal, so that the conference control terminal adds the virtual terminal bound to the non-participating terminal to the video conference according to the joining request.

[0087] The streaming media server can bind the non-participating terminals that are watching the live broadcast of the visual network video conference to the virtual terminal. The non-participating terminals can send a conference request to the streaming media server based on the number of the bound virtual terminal, and the conference request can include the number of the virtual terminal. The streaming media server can receive the conference request sent by the non-participating terminal and forward the conference request to the conference control terminal. The conference control terminal can agree or reject the conference request. If the conference control terminal agrees to participate in the conference, it can obtain the number of the virtual terminal from the conference request and add the virtual terminal to the visual network video conference, so that the non-participating terminals that are watching the live broadcast can also join the video conference and speak in the visual network video conference.

[0088] In an embodiment of the present invention, a virtual terminal can be configured on the server, and the virtual terminal supports the video conferencing function; when the virtual terminal joins the video conference, the audio and video streams of the video conference are pushed to the cloud server according to at least one push stream address bound to the virtual terminal; according to the pull stream addresses of multiple live broadcast protocols bound to the virtual terminal, the audio and video streams of the cloud server are transmitted to the user terminal, and the user terminal includes the terminal that has participated in the conference and the terminal that has not participated in the conference; in response to the conference request sent by the terminal that has not participated in the conference, a conference participation instruction is sent to the conference control terminal, so that the conference control terminal joins the terminal that has not participated in the video conference according to the conference participation instruction. The embodiment of the present invention realizes the ability to push video conferences to user terminals on the Internet with different live broadcast protocols in the visual network, meeting user needs.

[0089] Reference Figure 4 , shows a flowchart of a method for a live broadcast source to join a video conference provided by an embodiment of the present invention, and the method may specifically include the following steps:

[0090] Step 401: configure a virtual terminal on a server, wherein the virtual terminal supports a video conferencing function.

[0091] The method of the embodiment of the present invention can be applied to a visual network server, the video conference can be a visual network video conference, and the visual network server can include a server for implementing various functions in the visual network. For example, the visual network server can include a streaming media server. The streaming media server is a bridge and link between the visual network and the Internet audio and video transmission service, which realizes the interconnection between the visual network service and the Internet service, and can securely connect various audio and video resources in the Internet to the visual network, and can also securely connect various audio and video resources in the visual network to the Internet.

[0092] Exemplarily, multiple virtual terminals can be configured on the visual network server, and each virtual terminal can be identified by a virtual terminal number. The state of the virtual terminal can be indicated by a state identifier, for example, an idle state identifier can indicate that the virtual terminal is idle and can be used. The virtual terminal configured by the visual network server can support the visual network video conferencing function, that is, the virtual terminal can support joining the visual network video conference, as a participant of the visual network video conference, and receive the audio and video streams of the visual network video conference.

[0093] Step 402: When the virtual terminal joins a video conference, the audio and video streams of the live broadcast source of at least one live broadcast protocol bound to the virtual terminal are pulled into the video conference.

[0094] Exemplarily, the visual network server can bind the virtual terminal to a live broadcast source of at least one live broadcast protocol that is being broadcast live. The live broadcast source can be a live broadcast client running on the terminal device, and can be a visual network live broadcast source and / or an Internet live broadcast source. The live broadcast client can use a variety of live broadcast protocols for live broadcast. Exemplarily, the live broadcast protocol can include but is not limited to RTSP (Real Time Streaming Protocol), RTMP (Real Time Messaging Protocol), and HLS (HTTP Live Streaming, a streaming media network transmission protocol based on HTTP).

[0095] Exemplarily, when a virtual terminal joins a visual network video conference as a participant, the visual network server can pull the audio and video stream of the live broadcast source of at least one live broadcast protocol bound to the virtual terminal into the visual network video conference, so that each participant of the visual network video conference can see the audio and video stream of the live broadcast source.

[0096] In an embodiment of the present invention, a virtual terminal can be configured on the server, and the virtual terminal can support the video conference function; when the virtual terminal joins the video conference, the audio and video streams of the live broadcast source of at least one live broadcast protocol bound to the virtual terminal can be pulled into the video conference. The embodiment of the present invention enables live broadcast sources of different live broadcast protocols to be added to the video conference in the visual network, so that each participant of the video conference can see the audio and video streams of the live broadcast source, meeting the user needs.

[0097] Reference Figure 5 , shows a flowchart of another method for a live broadcast source to join a video conference provided by an embodiment of the present invention, the method may specifically include the following steps:

[0098] Step 501: configure a virtual terminal on a server, wherein the virtual terminal supports a video conferencing function.

[0099] The method of the embodiment of the present invention can be applied to a visual network server, the video conference can be a visual network video conference, the visual network server can include a server for implementing various functions in the visual network, and illustratively, the visual network server can include a streaming media server. For ease of understanding, this embodiment is described by taking the visual network server as a streaming media server.

[0100] In the embodiment of the present invention, the method may further include: sending a conference joining request to a conference control terminal according to the virtual terminal, so that the conference control terminal joins the virtual terminal into the video conference according to the conference joining request.

[0101] The streaming media server can communicate with the conference control terminal of the visual network, which is used to manage the video conference. The conference control terminal can be a visual network video conference scheduling system client, a client software running on a personal computer platform, which can be used for conference reservation, conference creation, conference process management, control, start and stop conferences, switch speakers, split screen mode, etc. After creating a visual network video conference, the conference control terminal can add participants to the visual network video conference.

[0102] For example, the streaming media server can send a conference joining request to the conference control terminal based on a virtual terminal, and the conference joining request can include the number of the virtual terminal. After receiving the conference joining request, the conference control terminal can agree or reject the conference joining request. If the conference control terminal agrees to join the conference, the conference control terminal agrees to obtain the number of the virtual terminal from the conference joining instruction and add the virtual terminal to the video network video conference.

[0103] Step 502: Acquire the audio and video streams of the multiple live broadcast sources according to the stream pull addresses corresponding to the multiple live broadcast sources of the multiple live broadcast protocols bound to the virtual terminal.

[0104] The live broadcast source can be a visual network live broadcast source and / or an Internet live broadcast source. The live broadcast source can set a push stream address and a pull stream address, and can push the audio and video stream to the server according to the push stream address. The streaming media server can bind the virtual terminal to multiple live broadcast sources of multiple live broadcast protocols that are being broadcast live, and the streaming media server can obtain the pull stream address corresponding to the live broadcast source. Pulling stream refers to the process of pulling audio and video streams from the server to the streaming media server. The streaming media server can use the pull stream address to pull the audio and video streams of the visual network live broadcast source.

[0105] In an embodiment of the present invention, step 502 may include: respectively calling the stream pulling modules corresponding to multiple live broadcast protocols, and obtaining the audio and video streams of the multiple live broadcast sources according to the stream pulling addresses corresponding to the multiple live broadcast sources of the multiple live broadcast protocols bound to the virtual terminal.

[0106] The streaming media server is equipped with streaming modules corresponding to various live broadcast protocols. The streaming media server can parse the streaming address corresponding to the live broadcast protocol, and then select the streaming module corresponding to the live broadcast protocol to obtain the audio and video stream of the live broadcast source according to the streaming address.

[0107] Step 503: When the virtual terminal joins the video conference, the audio and video streams of the multiple live broadcast sources are sent to the server to pull the audio and video streams of the multiple live broadcast sources into the video conference.

[0108] Exemplarily, when a virtual terminal configured by a streaming media server joins a visual network video conference, the streaming media server can send audio and video streams of multiple live broadcast sources of multiple live broadcast protocols to the visual network server, so that participants in the visual network video conference can obtain audio and video streams of multiple live broadcast sources of multiple live broadcast protocols from the visual network server.

[0109] In an embodiment of the present invention, a virtual terminal can be configured on the server, and the virtual terminal supports the video conferencing function; the audio and video streams of multiple live sources can be obtained according to the pull stream addresses corresponding to the multiple live sources of the multiple live protocols bound to the virtual terminal. When the virtual terminal joins the video conference, the audio and video streams of the multiple live sources can be sent to the server to pull the audio and video streams of the multiple live sources into the visual network video conference. The embodiment of the present invention enables live sources of different live protocols to be added to the video conference in the visual network, so that each participant of the video conference can see the audio and video streams of the live source, meeting the user needs.

[0110] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0111] Reference Figure 6 , shows a structural block diagram of a video conference live broadcast device provided by an embodiment of the present invention, which may specifically include the following modules:

[0112] Configuration module 601, used to configure a virtual terminal on the server, the virtual terminal supports a video conferencing function;

[0113] The transmission module 602 is used to transmit the audio and video streams of the video conference to the user terminal through the pull stream address of at least one live broadcast protocol bound to the virtual terminal when the virtual terminal joins the video conference.

[0114] In this embodiment of the present invention, the transmission module 602 may include:

[0115] A streaming processing submodule, configured to stream the audio and video streams of the video conference to a cloud server according to at least one streaming address bound to the virtual terminal when the virtual terminal joins the video conference;

[0116] The stream pulling processing submodule is used to transmit the audio and video streams of the cloud server to the user terminal according to the stream pulling addresses of multiple live broadcast protocols of the live broadcast source corresponding to the at least one push stream address.

[0117] In an embodiment of the present invention, the user terminal includes a visual networking terminal and / or an Internet terminal.

[0118] In this embodiment of the present invention, the transmission module 602 may include:

[0119] A target stream acquisition submodule, used for acquiring the audio and video streams of the target participating terminal in the video conference when the virtual terminal joins the video conference;

[0120] The target stream transmission submodule is used to transmit the audio and video stream of the target conference terminal to the user terminal through the stream pulling address of at least one live broadcast protocol bound to the virtual terminal.

[0121] In the embodiment of the present invention, the target participating terminal includes all participating terminals of the video conference, or one or more preset participating terminals, or participating terminals determined in sequence from all participating terminals.

[0122] In the embodiment of the present invention, the user terminal includes a terminal that has participated in the conference and a terminal that has not participated in the conference; the device also includes:

[0123] The conference request forwarding module is used to respond to the conference request sent by the non-participating terminal and forward the conference request to the conference control end, so that the conference control end adds the non-participating terminal to the video conference according to the conference request.

[0124] In an embodiment of the present invention, the stream pulling processing submodule includes:

[0125] The streaming unit is used to send to the user terminal the streaming addresses of multiple live broadcast protocols of the live broadcast source corresponding to the at least one streaming push address, so that the user terminal can obtain the corresponding audio and video streams of the cloud server according to the streaming addresses corresponding to the multiple live broadcast protocols.

[0126] In the embodiment of the present invention, a virtual terminal can be configured on the server, and the virtual terminal can support the video conferencing function; when the virtual terminal joins the video conference, the audio and video streams of the video conference can be transmitted to the user terminal through the pull stream address of at least one live broadcast protocol bound to the virtual terminal. The embodiment of the present invention enables the video conference to be pushed to the user terminal on the Internet in different live broadcast protocols in the visual network, meeting the user's needs.

[0127] Reference Figure 7 , shows a structural block diagram of a device for a live broadcast source to join a video conference provided by an embodiment of the present invention, which may specifically include the following modules:

[0128] Configuration module 701, used to configure a virtual terminal on the server, the virtual terminal supports a video conferencing function;

[0129] The pull-in module 702 is used to pull the audio and video streams of the live broadcast source of at least one live broadcast protocol bound to the virtual terminal into the video conference when the virtual terminal joins the video conference.

[0130] In the embodiment of the present invention, the pull-in module 702 may include:

[0131] A stream acquisition submodule, used to acquire the audio and video streams of the multiple live broadcast sources according to the pull stream addresses corresponding to the multiple live broadcast sources of the multiple live broadcast protocols bound to the virtual terminal;

[0132] The stream sending submodule is used to send the audio and video streams of the multiple live broadcast sources to the server when the virtual terminal joins the video conference, so as to pull the audio and video streams of the multiple live broadcast sources into the video conference.

[0133] In an embodiment of the present invention, the live broadcast source includes an Internet live broadcast source and / or a visual network live broadcast source.

[0134] In an embodiment of the present invention, the stream acquisition submodule may include:

[0135] The calling unit is used to call the stream pulling modules corresponding to the multiple live broadcast protocols respectively, and obtain the audio and video streams of the multiple live broadcast sources according to the stream pulling addresses corresponding to the multiple live broadcast sources of the multiple live broadcast protocols bound to the virtual terminal.

[0136] In an embodiment of the present invention, the device may further include:

[0137] The conference request sending module is used to send a conference request to the conference control end according to the virtual terminal, so that the conference control end joins the virtual terminal into the video conference according to the conference request.

[0138] In an embodiment of the present invention, a virtual terminal can be configured on the server, and the virtual terminal can support the video conference function; when the virtual terminal joins the video conference, the server can pull the audio and video streams of the live broadcast source of at least one live broadcast protocol bound to the virtual terminal into the video conference. The embodiment of the present invention enables the live broadcast sources of different live broadcast protocols to be added to the video conference in the visual network, so that each participant of the video conference can see the audio and video streams of the live broadcast source, meeting the user needs.

[0139] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0140] An embodiment of the present invention further provides an electronic device, including:

[0141] It includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the various processes of the above-mentioned video conference live broadcast method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0142] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned video conference live broadcast method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0143] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0144] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0145] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0146] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0147] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0148] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0149] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0150] The above is a detailed introduction to a video conference live broadcast method and a video conference live broadcast device provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A video conference live broadcast method, characterized in that: The method comprises: Configuring a virtual terminal on the server, wherein the virtual terminal supports a video conferencing function; When the virtual terminal joins the video conference, the audio and video streams of the video conference are transmitted to the user terminal through the stream pulling address of at least one live broadcast protocol bound to the virtual terminal; When the virtual terminal joins the video conference, the audio and video streams of the video conference are transmitted to the user terminal through the stream pulling address of at least one live broadcast protocol bound to the virtual terminal, including: When the virtual terminal joins the video conference, the streaming modules corresponding to the multiple live broadcast protocols bound to the virtual terminal are called, and the audio and video streams of the video conference are streamed to the cloud server according to at least one streaming address bound to the virtual terminal; Transmitting the audio and video streams of the cloud server to the user terminal according to the pull stream addresses of the multiple live broadcast protocols of the live broadcast source corresponding to the at least one push stream address; The user terminal includes a terminal that has participated in the conference and a terminal that has not participated in the conference; the method also includes: In response to the conference joining request sent by the non-participating terminal, forward the conference joining request to the conference control end, so that the conference control end adds the non-participating terminal to the video conference according to the conference joining request; The responding to the conference joining request sent by the non-participating terminal and forwarding the conference joining request to the conference control terminal so that the conference control terminal joins the non-participating terminal into the video conference according to the conference joining request comprises: Binding the non-participating terminal to the virtual terminal; In response to the non-participating terminal based on the virtual terminal to send a participation request, forwarding the participation request to the conference control terminal, so that the conference control terminal according to the participation request will not participate in the terminal bound to the virtual terminal to join the video conference; The method of transmitting the audio and video stream of the cloud server to the user terminal according to the pull stream addresses of the multiple live broadcast protocols of the live broadcast source corresponding to the at least one push stream address includes: Sending to the user terminal the pull stream addresses of multiple live broadcast protocols of the live broadcast source corresponding to the at least one push stream address, so that the user terminal obtains the corresponding audio and video streams of the cloud server according to the pull stream addresses corresponding to the multiple live broadcast protocols.

2. The method according to claim 1, characterized in that The user terminal includes a visual networking terminal and / or an Internet terminal.

3. The method according to claim 1 or 2, characterized in that: When the virtual terminal joins the video conference, the audio and video streams of the video conference are transmitted to the user terminal through the stream pulling address of at least one live broadcast protocol bound to the virtual terminal, including: When the virtual terminal joins the video conference, the audio and video streams of the target participating terminal in the video conference are obtained; The audio and video streams of the target conference participant terminal are transmitted to the user terminal through the streaming address of at least one live broadcast protocol bound to the virtual terminal.

4. The method according to claim 3, characterized in that The target participating terminals include all participating terminals of the video conference, or one or more preset participating terminals, or participating terminals determined in sequence from all participating terminals.

5. A video conference live broadcast device, characterized in that: The device comprises: A configuration module, used for configuring a virtual terminal on the server, wherein the virtual terminal supports a video conferencing function; A transmission module, used for transmitting the audio and video streams of the video conference to the user terminal through the pull stream address of at least one live broadcast protocol bound to the virtual terminal when the virtual terminal joins the video conference; The transmission module comprises: A streaming processing submodule, which is used to call a streaming module corresponding to a plurality of live broadcast protocols bound to the virtual terminal when the virtual terminal joins a video conference, and to stream the audio and video streams of the video conference to a cloud server according to at least one streaming address bound to the virtual terminal; The pull-stream processing submodule is used to transmit the audio and video stream of the cloud server to the user terminal according to the pull-stream addresses of the multiple live broadcast protocols of the live broadcast source corresponding to the at least one push-stream address; according to the pull-stream addresses of the multiple live broadcast protocols of the live broadcast source corresponding to the at least one push-stream address, transmitting the audio and video stream of the cloud server to the user terminal includes: sending to the user terminal the pull-stream addresses of the multiple live broadcast protocols of the live broadcast source corresponding to the at least one push-stream address, so that the user terminal obtains the corresponding audio and video stream of the cloud server according to the pull-stream addresses corresponding to the multiple live broadcast protocols; The user terminal includes a terminal that has participated in the conference and a terminal that has not participated in the conference; the device also includes: A conference request forwarding module, used for responding to the conference request sent by the non-participating terminal, forwarding the conference request to the conference control end, so that the conference control end adds the non-participating terminal to the video conference according to the conference request; The conference request forwarding module is specifically used to bind the non-participating terminal to the virtual terminal; in response to the conference request sent by the non-participating terminal based on the virtual terminal, forward the conference request to the conference control end, so that the conference control end adds the virtual terminal bound to the non-participating terminal to the video conference according to the conference request.

6. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the steps of the video conference live broadcast method as described in any one of claims 1 to 4 are implemented.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the video conference live broadcast method according to any one of claims 1 to 4 are implemented.

Images