A video conference server and a video conference terminal
By introducing a business middleware module into the video network terminal to parse and process conference control information, the security and efficiency issues in video network conferencing are resolved, and secure and efficient network conference management and scheduling are achieved.
Patent Information
- Application Number
- CN202010769386.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-08-03
- Publication Date
- 2026-01-16
- Estimated Expiration
- 2040-08-03
AI Technical Summary
In existing video conferencing systems, the conferencing management server transmits conferencing control information over the Internet, resulting in poor security, increased complexity of business logic, and low transmission efficiency.
The middleware layer module parses the intermediate conference control information sent by the video network terminal, determines the service type, and sends the parsing results to the corresponding conference scheduling or management module for processing, thus avoiding the direct exposure of the video network conference server to the Internet environment.
It enhances network communication security, simplifies business logic, improves transmission efficiency, and enables network conference management and scheduling in environments without internet access.
Smart Images

Figure CN112073673B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of web conferencing, and more particularly to a video conferencing server and a video conferencing terminal. Background Technology
[0002] The VideoNetwork is a significant milestone in network development. It's a real-time network capable of transmitting high-definition video in real time, propelling numerous internet applications towards high-definition video and enabling high-definition face-to-face interaction. The VideoNetwork employs a Layer 2 proprietary protocol for data transmission, significantly enhancing security while achieving real-time high-definition video transmission across the entire network.
[0003] Web conferencing is an important application scenario for the video network. For example... Figure 1 The diagram illustrates one current implementation method for web conferencing via video network. In this method, the video network dispatching tablet sends conference control information to a conference management server, recording server, message forwarding server, or streaming media server via the internet. These servers are all located within the video network. Control of the web conference is then achieved through these servers and the various video network devices within the same network. Currently, initiating or controlling a web conference via the video network dispatching tablet requires transmitting conference control information over the internet. To enhance communication security, the conference management server typically employs a web (World Wide Web) server and a dispatching server working collaboratively. This means the web server is exposed to the internet to receive data; it then processes the received information and forwards it to the dispatching server for further processing. This avoids directly exposing the dispatching server, which performs the processing, to the internet.
[0004] However, while this server configuration improves communication security, it also undoubtedly brings some drawbacks. For example, it requires consideration of the business logic regarding communication between the web server and the scheduling server, increasing the complexity of the business logic; business information that needs to be processed by the scheduling server must be forwarded through the web server, resulting in lower transmission efficiency; and the web server's exposure to the internet environment leads to poor security. Summary of the Invention
[0005] In view of the above problems, embodiments of the present invention are proposed to provide a video conferencing server and video terminal that overcome or at least partially solve the above problems.
[0006] In a first aspect, the embodiments of the present application disclose a video conference server, which comprises a business intermediate layer module, a protocol processing module, a conference scheduling module and a conference management module connected with the business intermediate layer module respectively;
[0007] The protocol processing module is configured to receive intermediate conference control information sent by a video conference terminal, analyze the intermediate conference control information, and send an analysis result to the business intermediate layer module, wherein the intermediate conference control information is information obtained by the video conference terminal through a video conference protocol from initial conference control information received by the video conference terminal, and the initial conference control information is information sent by a target terminal to the video conference terminal through a local area network;
[0008] The business intermediate layer module is configured to determine a business type to which the intermediate conference control information belongs according to the analysis result sent by the protocol processing module, send the analysis result to the conference scheduling module in the case that the business type to which the intermediate conference control information belongs is a scheduling business type, and send the analysis result to the conference management module in the case that the business type to which the intermediate conference control information belongs is a management business type.
[0009] The conference scheduling module is configured to perform scheduling business processing according to the analysis result sent by the business intermediate layer module.
[0010] The conference management module is configured to perform management business processing according to the analysis result sent by the business intermediate layer module.
[0011] Optionally, the scheduling business processing at least includes starting a conference, stopping a conference and switching a speaker.
[0012] Optionally, the management business processing at least includes user authentication, conference reservation management, address book management and resource on-demand.
[0013] Optionally, the video conference server further comprises a message publishing module connected with the business intermediate layer module.
[0014] The business intermediate layer module is further configured to send the analysis result to the message publishing module in the case that the business type to which the intermediate conference control information belongs is a message business type.
[0015] The message publishing module is configured to perform message publishing business processing according to the analysis result sent by the business intermediate layer module.
[0016] Optionally, the business intermediate layer module is further configured to receive target information pushed by the message publishing module and send the target information to the protocol processing module.
[0017] The protocol processing module is further configured to encapsulate the target information through the video live streaming protocol, and send the encapsulated target information to the video live streaming terminal through the video live streaming transparent channel, so that the video live streaming terminal obtains the target information through analysis, encapsulates the target information through the Internet protocol again, and sends the target information to the target terminal.
[0018] Optionally, the video live streaming conference server further includes an Internet protocol interface module connected with the service intermediate layer module.
[0019] The Internet protocol interface module is configured to receive Internet conference control information sent by the target terminal through the Internet, and send the Internet conference control information to the service intermediate layer module.
[0020] The service intermediate layer module is further configured to determine a service type to which the Internet conference control information belongs, send the Internet conference control information to the conference dispatching module if the service type to which the Internet conference control information belongs is a dispatching service type, and send the Internet conference control information to the conference management module if the service type to which the Internet conference control information belongs is a management service type.
[0021] Optionally, the service intermediate layer module is further configured to receive dispatching feedback information sent by the conference dispatching module, and send the dispatching feedback information to the protocol processing module.
[0022] The protocol processing module is further configured to encapsulate the dispatching feedback information through the video live streaming protocol, and send the encapsulated dispatching feedback information to the video live streaming terminal through the video live streaming transparent channel, so that the video live streaming terminal obtains the dispatching feedback information through analysis, encapsulates the dispatching feedback information through the Internet protocol again, and sends the dispatching feedback information to the target terminal.
[0023] Optionally, the service intermediate layer module is further configured to receive management feedback information sent by the conference management module, and send the management feedback information to the protocol processing module.
[0024] The protocol processing module is further configured to encapsulate the management feedback information through the video live streaming protocol, and send the encapsulated management feedback information to the video live streaming terminal through the video live streaming transparent channel, so that the video live streaming terminal obtains the management feedback information through analysis, encapsulates the management feedback information through the Internet protocol again, and sends the management feedback information to the target terminal.
[0025] In a second aspect, the embodiments of the present application further disclose a video live streaming terminal, which comprises:
[0026] A domain network module and a processing module connected to the domain network module;
[0027] The domain network module is configured to create a wireless local area network, receive initial conference control information sent by a target terminal through the created wireless local area network, and send the initial conference control information to the processing module.
[0028] The processing module is configured to encapsulate the initial conference control information through a video live network protocol to obtain intermediate conference control information, and send the intermediate conference control information to a video live network conference server, so that the video live network conference server performs dispatching service processing or management service processing according to a service type to which the intermediate conference control information belongs.
[0029] Optionally, the domain network module is a wireless Internet hotspot module.
[0030] The video live network conference server provided by the embodiment of the present application comprises a service intermediate layer module and a protocol processing module, a conference scheduling module and a conference management module connected to the service intermediate layer module respectively; the protocol processing module is configured to receive intermediate conference control information sent by a video live network terminal, and analyze the intermediate conference control information and send an analysis result to the service intermediate layer module; the intermediate conference control information is information obtained by the video live network terminal through encapsulation of initial conference control information received by the video live network terminal through a video live network protocol; the initial conference control information is information sent by a target terminal to the video live network terminal through a local area network. In a video live network environment, the video live network conference server receives the intermediate conference control information sent by the video live network terminal without being exposed to an Internet environment. The service intermediate layer module is configured to determine a service type to which the intermediate conference control information belongs according to the analysis result sent by the protocol processing module, send the analysis result to the conference scheduling module in the case that the service type to which the intermediate conference control information belongs is a dispatching service type, and send the analysis result to the conference management module in the case that the service type to which the intermediate conference control information belongs is a management service type. The conference scheduling module is configured to perform dispatching service processing according to the analysis result sent by the service intermediate layer module. The conference management module is configured to perform management service processing according to the analysis result sent by the service intermediate layer module. The video live network conference server provided by the embodiment of the present application can receive conference control information of a target terminal through a video live network terminal in an environment without an Internet, implement management and scheduling of a network conference, and improve the security of network communication. Meanwhile, the video live network conference server integrates dispatching service processing and management service processing, sends the analysis result to a corresponding service processing module for processing according to the service type to which the intermediate conference control information belongs, simplifies service logic, and improves transmission efficiency. BRIEF DESCRIPTION OF DRAWINGS
[0031] Figure 1is a schematic diagram of an architecture for conducting a network conference in the prior art provided by an embodiment of the present application;
[0032] Figure 2 is a structural block diagram of a videoconferencing server provided by an embodiment of the present application;
[0033] Figure 3 is a structural block diagram of a videoconferencing terminal provided by an embodiment of the present application;
[0034] Figure 4 is a schematic diagram of an architecture of a videoconferencing system provided by an embodiment of the present application;
[0035] Figure 5 is a schematic diagram of an architecture of a target terminal provided by an embodiment of the present application;
[0036] Figure 6 is a schematic diagram of a signal flow in a process of implementing a network conference by a videoconferencing server provided by an embodiment of the present application. DETAILED DESCRIPTION
[0037] In order to make the above objectives, characteristics and advantages of the present application more apparent and comprehensible, the present application will be further described in detail below with reference to the drawings and specific embodiments.
[0038] Figure 2 is a structural block diagram of a videoconferencing server provided by an embodiment of the present application; the videoconferencing server comprises a business intermediate layer module 21 and a protocol processing module 22, a conference scheduling module 23 and a conference management module 24 connected with the business intermediate layer module 21 respectively;
[0039] The protocol processing module 22 is configured to receive intermediate conference control information sent by a videoconferencing terminal, and parse the intermediate conference control information, and send the parsing result to the business intermediate layer module 21; wherein the intermediate conference control information is information obtained by the videoconferencing terminal encapsulating the received initial conference control information through a videoconferencing protocol; the initial conference control information is information sent by a target terminal to the videoconferencing terminal through a local area network;
[0040] The business intermediate layer module 21 is configured to determine a business type to which the intermediate conference control information belongs according to the parsing result sent by the protocol processing module 22; in the case that the business type to which the intermediate conference control information belongs is a scheduling business type, send the parsing result to the conference scheduling module 23; in the case that the business type to which the intermediate conference control information belongs is a management business type, send the parsing result to the conference management module 24;
[0041] The conference scheduling module 23 is configured to perform scheduling business processing according to the parsing result sent by the business intermediate layer module 21;
[0042] The conference management module 24 is configured to manage the service processing according to the analysis result sent by the service intermediate layer module 21.
[0043] It should be noted that the service intermediate layer module 21, the protocol processing module 22, the conference scheduling module 23, and the conference management module 24 are various functional modules of the WebRTC conference server for implementing the network conference. The intermediate conference control information carries the related information of the network conference; the related information of the network conference can be information for implementing the conference scheduling or information for implementing the conference management. The protocol processing module 22 is connected with the WebRTC terminal through the WebRTC, that is, the WebRTC terminal can transmit the intermediate conference control information to the protocol processing module 22 of the WebRTC conference server through the WebRTC transmission channel between the WebRTC terminal and the WebRTC conference server. Here, the WebRTC terminal can receive the initial conference control information sent by the target terminal through the local area network and process the initial conference control information to obtain the intermediate conference control information. Thus, in the entire process, the Internet can not be relied on, and the WebRTC conference server is avoided from being exposed to the Internet environment. Preferably, the target terminal can be a dedicated WebRTC tablet, and the functions of the target terminal include but are not limited to initiating, establishing, and controlling the conference. The target terminal can also be a smart device installed with a WebRTC conference scheduling application, for example, a smart phone installed with a WebRTC conference scheduling application.
[0044] Of course, during the network conference, the WebRTC conference server can also feed back some processing results after processing the intermediate conference control information. In the case where the service type to which the intermediate conference control information belongs is the scheduling service type, the WebRTC conference server also returns the scheduling feedback information to the target terminal through the WebRTC terminal. The scheduling service processing is a service signaling related to the network conference scheduling, for example, the scheduling service processing at least includes starting the conference, stopping the conference, and switching the speaker, but is not limited thereto. Taking the scheduling service processing of starting the conference as an example, the scheduling feedback information can be that the conference starting is successful or the conference starting fails. Specifically, the service intermediate layer module 21 is further configured to receive the scheduling feedback information sent by the conference scheduling module 23 and send the scheduling feedback information to the protocol processing module 22; the protocol processing module 22 is further configured to encapsulate the scheduling feedback information through the WebRTC protocol and send the encapsulated scheduling feedback information to the WebRTC terminal through the WebRTC transmission channel, so that the WebRTC terminal obtains the scheduling feedback information through analysis and re-encapsulates the scheduling feedback information through the Internet protocol and sends the scheduling feedback information to the target terminal. The Internet protocol is the Transmission Control Protocol (TCP).
[0045] In a case where the business type to which the intermediate conference control information belongs is a management business type, the WebRTC conference server will also return management feedback information to the target terminal through the WebRTC terminal. The management business processing is to execute business signaling related to WebRTC conference management; for example, the management business processing at least includes user authentication, conference reservation management, address book management, and resource on-demand. Specifically, the business intermediate layer module 21 is further configured to receive the management feedback information sent by the conference management module 24 and send the management feedback information to the protocol processing module 22; the protocol processing module 22 is further configured to encapsulate the management feedback information through the WebRTC protocol and send the encapsulated management feedback information to the WebRTC terminal through the WebRTC transparent channel, so that the WebRTC terminal obtains the management feedback information through analysis and re-encapsulates the management feedback information through the Internet protocol and sends it to the target terminal. The Internet protocol is the transmission control protocol.
[0046] In the embodiment of the application, the WebRTC conference server comprises a business intermediate layer module and a protocol processing module, a conference scheduling module, and a conference management module connected with the business intermediate layer module respectively. The protocol processing module is configured to receive intermediate conference control information sent by a WebRTC terminal and analyze the intermediate conference control information, and send the analysis result to the business intermediate layer module. The intermediate conference control information is information obtained by the WebRTC terminal encapsulating the initial conference control information received through the WebRTC protocol. The initial conference control information is information sent by a target terminal to the WebRTC terminal through a local area network. In a WebRTC environment, the WebRTC conference server does not need to be exposed to an Internet environment to receive the intermediate conference control information sent by the WebRTC terminal. The business intermediate layer module is configured to determine the business type to which the intermediate conference control information belongs according to the analysis result sent by the protocol processing module, and send the analysis result to the conference scheduling module in a case where the business type to which the intermediate conference control information belongs is a scheduling business type, and send the analysis result to the conference management module in a case where the business type to which the intermediate conference control information belongs is a management business type. The conference scheduling module is configured to perform scheduling business processing according to the analysis result sent by the business intermediate layer module. The conference management module is configured to perform management business processing according to the analysis result sent by the business intermediate layer module. The WebRTC conference server provided in the embodiment of the application can receive the conference control information of the target terminal through the WebRTC terminal in an environment without the Internet, implement the management and scheduling of the WebRTC conference, and improve the security of the network communication. At the same time, the scheduling business processing and the management business processing are integrated, the analysis result is sent to the corresponding business processing module for processing according to the business type to which the intermediate conference control information belongs, the business logic is simplified, and the transmission efficiency is improved.
[0047] In order to facilitate message publishing in the process of the network conference, on the basis of the above-mentioned embodiments of the application, in the embodiments of the application, the WebRTC conference server further comprises a message publishing module connected with the service intermediate layer module.
[0048] The service intermediate layer module is further configured to, in a case where the service type to which the intermediate conference control information belongs is the message service type, send the analysis result to the message publishing module.
[0049] The message publishing module is configured to perform message publishing service processing according to the analysis result sent by the service intermediate layer module.
[0050] It should be noted that the target terminal can send the message to be published to the WebRTC conference server via the WebRTC terminal. That is, the message to be published is transmitted to the WebRTC conference server by carrying the message to be published through the initial conference control information and the intermediate conference control information. The WebRTC conference server performs message publishing service processing through the message publishing module. Of course, the message publishing module can return some feedback information to the target terminal in the process of performing message publishing service processing. Specifically, the service intermediate layer module is further configured to receive target information pushed by the message publishing module and send the target information to the protocol processing module; and the protocol processing module is further configured to encapsulate the target information through the WebRTC protocol and send the encapsulated target information to the WebRTC terminal through the WebRTC transparent channel, so that the WebRTC terminal obtains the target information by analysis and re-encapsulates the target information through the Internet protocol and sends the target information to the target terminal.
[0051] In order to improve the compatibility of the WebRTC conference server, on the basis of the above-mentioned embodiments of the application, in the embodiments of the application, the WebRTC conference server further comprises an Internet protocol interface module connected with the service intermediate layer module.
[0052] The Internet protocol interface module is configured to receive Internet conference control information sent by a target terminal through the Internet and send the Internet conference control information to the service intermediate layer module.
[0053] The service intermediate layer module is further configured to determine the service type to which the Internet conference control information belongs; in a case where the service type to which the Internet conference control information belongs is the dispatch service type, send the Internet conference control information to the conference dispatch module; and in a case where the service type to which the Internet conference control information belongs is the management service type, send the Internet conference control information to the conference management module.
[0054] It should be explained that in the environment without the Internet, the target terminal realizes the network conference by the video networking terminal through the video networking. Of course, the conference control information can also be transmitted to the video networking conference server through the Internet in the environment without the video networking. Thus, the video networking conference server can realize the network conference in the environment only with the video networking or in the environment only with the Internet. The Internet protocol interface module can be an HTTP (Hyper Text Transfer Protocol) interface module.
[0055] Figure 3 A structure block diagram of the video networking terminal provided by an embodiment of the application is shown; the video networking terminal comprises: a local area network module 31 and a processing module 32 connected with the local area network module 31;
[0056] The local area network module 31 is configured to create a wireless local area network, receive the initial conference control information sent by the target terminal through the created wireless local area network, and send the initial conference control information to the processing module 32.
[0057] The processing module 32 is configured to encapsulate the initial conference control information through the video networking protocol to obtain intermediate conference control information, and send the intermediate conference control information to the video networking conference server, so that the video networking conference server performs the dispatching service processing or the management service processing according to the business type to which the intermediate conference control information belongs.
[0058] It should be explained that the video networking terminal supports the video networking protocol and can communicate in the video networking. The target terminal can be a dedicated video networking tablet, and the functions thereof include but are not limited to: initiating, establishing and controlling the conference; the target terminal can also be a smart device installed with the video networking conference dispatching application program, for example: a smart phone installed with the video networking conference dispatching application program, etc.
[0059] The target terminal and the video networking terminal can communicate through the wireless local area network created by the video networking terminal. Thus, the target terminal can also send the initial conference control information to the video networking terminal without relying on the Internet. Preferably, the processing module comprises a media forwarding unit and a video networking protocol processing unit; the media forwarding unit is configured to forward the information received by the local area network module to the video networking protocol processing unit; the video networking protocol processing unit is configured to encapsulate the received information through the video networking protocol and send the encapsulated information to the video networking conference server. Preferably, the local area network module 21 is a Wi-Fi (Wireless Fidelity) hotspot module.
[0060] In the embodiment of the application, when the target terminal initiates conference control, the conference control information is transmitted by the video live streaming terminal, so that the video live streaming conference server can successfully receive the conference control information, and the target terminal is prevented from being directly connected to the Internet, thereby improving security; and even in the absence of the Internet, the control of the network conference can be realized.
[0061] As Figure 4 The video live streaming conference system provided by the embodiment of the application is shown in the figure, which comprises the video live streaming conference server provided by the above-mentioned embodiment of the application and the video live streaming terminal provided by the above-mentioned embodiment of the application.
[0062] The target terminal comprises:
[0063] The business processing module is decoupled from the communication module and realizes data encapsulation and transmission by using a communication interface layer.
[0064] The communication module establishes a TCP long connection with the video live streaming terminal, realizes the receiving and sending functions of conference business data and audio and video data, and processes and forwards the messages actively pushed by the conference management server. In the process of communication data transmission, only the protocol header is modified, and no modification is made to other parts of the data.
[0065] The audio and video module 2 is an audio and video software development kit used for audio and video coding and decoding.
[0066] The audio and video module 1 is used to display the audio and video data decoded by the audio and video module 2 on the display unit of the target terminal.
[0067] The hotspot module in the video live streaming terminal is used to create a wireless local area network and receive the conference control information sent by the target terminal connected to the wireless local area network created by it. The conference control information received by the hotspot module is processed by the TCP / IP module and the media forwarding module, encapsulated by the video live streaming protocol processing module using the video live streaming protocol, and sent to the video live streaming conference server through the video live streaming transparent channel.
[0068] The video live streaming conference server supports the video live streaming protocol, receives the conference control information sent by the video live streaming terminal through the protocol processing module, parses the conference control information encapsulated by the video live streaming protocol, and sends the parsing result to the business intermediate layer module; the business intermediate layer module determines the business type to which the intermediate conference control information belongs; in the case where the business type to which the intermediate conference control information belongs is a dispatching business type, the parsing result is sent to the conference dispatching module for dispatching business processing; in the case where the business type to which the intermediate conference control information belongs is a management business type, the parsing result is sent to the conference management module for management business processing.
[0069] Ideally, the video conferencing server is also equipped with an HTTP (Hypertext Transfer Protocol) interface module, which allows access to the video conferencing server via HTTP requests.
[0070] The target terminal is also equipped with a communication software development kit (SDK), providing a unified interface service for data sending and receiving, and supporting TCP and HTTP protocols. The target terminal can also directly initiate video calls using its own video network number through the wireless LAN created by the video network terminal. The video network terminal forwards the audio and video streams to the target terminal for display. As the called party, if the wireless LAN created by the video network terminal is connected to the target terminal, it forwards the video call service signaling to the target terminal, allowing direct operation on the target terminal and supporting audio and video display.
[0071] The target terminal initiates a resource-on-demand service request through the wireless local area network created by the video network terminal. The video network terminal directly executes its own implemented resource-on-demand function, obtains audio and video streams from the recording server by watching live broadcasts, and copies and forwards them to the target terminal.
[0072] It should be noted that the media forwarding module of the video network terminal supports three types of signaling encapsulation and parsing: conference scheduling, conference management, and video telephony, as well as audio and video copying and forwarding functions.
[0073] Signaling parsing can identify the type of the sending application, and depending on the initiator and protocol type, it can choose to perform service pass-through or management pass-through during video network communication.
[0074] The audio and video copying and forwarding function allows the video network terminal to directly copy and forward the audio and video streams received from the speaker, video calls, and on-demand resources to the target terminal; the target terminal's local video stream is then output as an auxiliary source for the video network terminal.
[0075] For the target terminal, the following can be adopted: Figure 5 Configure the architecture shown. The UI (User Interface) module may include, but is not limited to, conferencing, video calling, video on demand, remote control, user login, and settings.
[0076] The service modules include, but are not limited to, a basic conference control module, an audio and video processing module, a resource on-demand module, a password security module, a video phone module, a real-time message processing module, a remote controller control, a user login and setting module. The basic conference control module includes starting / stopping a conference, switching a speaker, one-key point adjustment, group management, quick conference starting, and multi-screen conference; the audio and video processing module includes audio and video encoding and audio and video decoding; the resource on-demand module includes local on-demand and terminal on-demand.
[0077] The interface layer includes a communication interface; and the communication and data module includes HTTPS (HyperText Transfer Protocol over Secure Socket Layer) and WebSocket.
[0078] Referring to Figure 6 A signal flow diagram in a network conference process is provided by the video conferencing server of the embodiment of the present application;
[0079] The target terminal sends conference control information through a wireless local area network created by the video conferencing terminal, and the conference control information in this embodiment is taken as a service instruction for starting a conference for example. After the video conferencing terminal receives the service instruction for starting a conference, the video conferencing terminal encapsulates the service instruction for starting a conference by using a video conferencing protocol, and sends the encapsulated service instruction for starting a conference to the video conferencing server through information transparent transmission. The video conferencing server performs conference validity detection, and starts a conference when the conference is valid, and returns a conference starting result. If the conference validity detection fails, the video conferencing server returns a conference starting failure to the target terminal, and the conference is invalid.
[0080] Of course, the video conferencing server transmits the updated state message to the video conferencing terminal after determining that the conference terminal is updated, and then sends the updated state message to the target terminal, and the target terminal updates the conference terminal state.
[0081] Each of the embodiments in the specification is described in a progressive manner, and each embodiment focuses on the difference from other embodiments, and the same or similar parts between the embodiments can be referred to each other.
[0082] Those skilled in the art should understand that the embodiments of the embodiments of the present application can be provided as a method, an apparatus, or a computer program product. Therefore, the embodiments of the present application can adopt a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present application can adopt a computer program product in the form of one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program code.
[0083] The embodiments of the present application are described with reference to the flowchart illustrations and / or block diagrams of the methods, terminal devices (systems) and computer program products according to the embodiments of the present application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal devices to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal devices, create means for implementing the functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams.
[0084] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal devices to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams.
[0085] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal devices, such that a series of operational steps are carried out on the computer or other programmable terminal devices to produce a computer implemented process so that the instructions executed on the computer or other programmable terminal devices provide steps for implementing the functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams.
[0086] Although preferred embodiments of the present application have been described, those skilled in the art will be able to make additional modifications and variations to these embodiments without departing from the scope of the present application. Accordingly, the appended claims are intended to encompass all such modifications and variations as falling within the scope of the present application.
[0087] Finally, it needs to be mentioned that in this document, relational terms such as first and second and the like can only be used to distinguish one entity or action from another entity or action, without necessarily requiring or implying any actual such relationship or order between or among the entities or actions. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the presence of additional identical elements in the process, method, article, or apparatus that comprises the element.
Claims
1. A video internet network conferencing server, characterized by, The video live streaming conference server comprises a business intermediate layer module, and a protocol processing module, a conference scheduling module and a conference management module connected with the business intermediate layer module respectively; The protocol processing module is configured to receive intermediate conference control information sent by a video live streaming terminal, and parse the intermediate conference control information, and send a parsing result to the business intermediate layer module; wherein the intermediate conference control information is information obtained by the video live streaming terminal encapsulating initial conference control information received by the video live streaming terminal through a video live streaming protocol; and the initial conference control information is information sent by a target terminal to the video live streaming terminal through a local area network; The business intermediate layer module is configured to determine a business type to which the intermediate conference control information belongs according to the parsing result sent by the protocol processing module; in a case where the business type to which the intermediate conference control information belongs is a scheduling business type, send the parsing result to the conference scheduling module; and in a case where the business type to which the intermediate conference control information belongs is a management business type, send the parsing result to the conference management module; The conference scheduling module is configured to perform scheduling business processing according to the parsing result sent by the business intermediate layer module, wherein the scheduling business processing comprises starting a conference, stopping a conference and switching a speaker; The conference management module is configured to perform management business processing according to the parsing result sent by the business intermediate layer module, wherein the management business processing comprises user authentication and conference reservation management; The video live streaming conference server further comprises a message publishing module connected with the business intermediate layer module; The business intermediate layer module is further configured to, in a case where the business type to which the intermediate conference control information belongs is a message business type, send the parsing result to the message publishing module; The message publishing module is configured to perform message publishing business processing according to the parsing result sent by the business intermediate layer module; The video live streaming conference server further comprises an Internet protocol interface module connected with the business intermediate layer module; The Internet protocol interface module is configured to receive Internet conference control information sent by the target terminal through the Internet, and send the Internet conference control information to the business intermediate layer module; The business intermediate layer module is further configured to determine a business type to which the Internet conference control information belongs; in a case where the business type to which the Internet conference control information belongs is a scheduling business type, send the Internet conference control information to the conference scheduling module; and in a case where the business type to which the Internet conference control information belongs is a management business type, send the Internet conference control information to the conference management module; The business intermediate layer module is further configured to receive the management feedback information sent by the conference management module, and send the management feedback information to the protocol processing module; and the protocol processing module is further configured to encapsulate the management feedback information through the video live streaming protocol, and send the encapsulated management feedback information to the video live streaming terminal through the video live streaming transparent channel, so that the video live streaming terminal obtains the management feedback information through analysis, and re-encapsulates the management feedback information through the Internet protocol and sends the management feedback information to the target terminal.
2. The videoconferencing server of claim 1, wherein, The business intermediate layer module is further configured to receive the target information pushed by the message publishing module, and send the target information to the protocol processing module. The protocol processing module is further configured to encapsulate the target information through the video live streaming protocol, and send the encapsulated target information to the video live streaming terminal through the video live streaming transparent channel, so that the video live streaming terminal obtains the target information through analysis, and re-encapsulates the target information through the Internet protocol and sends the target information to the target terminal.
3. The videoconferencing server of claim 1, wherein, The business intermediate layer module is further configured to receive the scheduling feedback information sent by the conference scheduling module, and send the scheduling feedback information to the protocol processing module. The protocol processing module is further configured to encapsulate the scheduling feedback information through the video live streaming protocol, and send the encapsulated scheduling feedback information to the video live streaming terminal through the video live streaming transparent channel, so that the video live streaming terminal obtains the scheduling feedback information through analysis, and re-encapsulates the scheduling feedback information through the Internet protocol and sends the scheduling feedback information to the target terminal.
4. A video internet network terminal, characterized by, The video live streaming terminal comprises a local area network module and a processing module connected to the local area network module; The local area network module is configured to create a wireless local area network, receive initial conference control information sent by a target terminal through the created wireless local area network, and send the initial conference control information to the processing module; The processing module is configured to encapsulate the initial conference control information through a video live streaming protocol to obtain intermediate conference control information, and send the intermediate conference control information to a video live streaming conference server, so that the video live streaming conference server performs scheduling business processing or management business processing according to a business type to which the intermediate conference control information belongs; the scheduling business processing comprises starting a conference, stopping a conference, and switching a speaker; the management business processing comprises user authentication and conference reservation management; the video live streaming conference server receives conference control information sent by a video live streaming terminal through a protocol processing module, and analyzes the conference control information encapsulated by the video live streaming protocol, and sends an analysis result to a business intermediate layer module; the business intermediate layer module determines a business type to which the intermediate conference control information belongs; in a case where the business type to which the intermediate conference control information belongs is a scheduling business type, the analysis result is sent to a conference scheduling module, and the conference scheduling module performs scheduling business processing; in a case where the business type to which the intermediate conference control information belongs is a management business type, the analysis result is sent to a conference management module, and the conference management module performs management business processing. The service intermediate layer module is further configured to send the resolution result to a message publishing module if the service type to which the intermediate conference control information belongs is a message service type; and the message publishing module is configured to perform message publishing service processing according to the resolution result sent by the service intermediate layer module. The vision Internet conference server further comprises an Internet protocol interface module connected with the service intermediate layer module. The Internet protocol interface module is configured to receive Internet conference control information sent by the target terminal through the Internet, and send the Internet conference control information to the service intermediate layer module. The service intermediate layer module is further configured to determine the service type to which the Internet conference control information belongs, send the Internet conference control information to the conference dispatching module if the service type to which the Internet conference control information belongs is a dispatching service type, and send the Internet conference control information to the conference management module if the service type to which the Internet conference control information belongs is a management service type. The service intermediate layer module is further configured to receive management feedback information sent by the conference management module, and send the management feedback information to the protocol processing module; and the protocol processing module is further configured to encapsulate the management feedback information through the vision Internet protocol, and send the encapsulated management feedback information to the vision Internet terminal through the vision Internet transparent channel, so that the vision Internet terminal obtains the management feedback information through analysis, and re-encapsulates the management feedback information through the Internet protocol and sends the management feedback information to the target terminal.
5. The video calling terminal of claim 4, wherein, The local area network module is a wireless Internet hot spot module.
Citation Information
Patent Citations
Method and system for controlling conference over articulated naturality web
CN109218654A
Subtitle display parameter adjusting method, device and system
CN109982027A
Conference terminal list acquisition method and system
CN110519549A
Terminal service control method and terminal service control device
CN111131746A