Audio and video recording method, system and device
By obtaining and controlling the audio and video streams of virtual terminals in the video networking conference, the problem of only 64-bit terminal recording is solved, and audio and video recording of 16-bit and 64-bit terminals is realized, and the video networking service is expanded.
Patent Information
- Application Number
- CN202010256842.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-04-02
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2040-04-02
AI Technical Summary
In video networking meetings, only 64-bit video networking terminals can be used for audio and video recording, and 16-bit video networking terminals cannot be selected, which limits business expansion.
By obtaining a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability from the bridge server, the virtual terminal is controlled to join the conference and stream audio and video to the recording and broadcast server to realize the first terminal's Audio and video recording, supports audio and video recording of 16-bit and 64-bit terminals.
It realizes the use of any terminal for audio and video recording in video networking meetings, expanding the application scope of video networking services.
Smart Images

Figure CN111541858B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of visual networking technology, and in particular to an audio and video recording method, system and device. Background Art
[0002] With the development of video networking, video conferencing has been widely used.
[0003] Currently, in a video networking conference, it is possible to have a 64-bit video networking terminal and a 16-bit video networking terminal appear in a conference started by a client (eg, Pamir) used in a 64-bit video networking conference.
[0004] However, during the process of recording conference audio and video, only 64-bit video network terminals can be used for audio and video recording, and 16-bit video network terminals cannot be used for audio and video recording, resulting in the inability to expand the business of video network. Summary of the invention
[0005] In view of the above problems, embodiments of the present invention are proposed to provide an audio and video recording method, system and device that overcome the above problems or at least partially solve the above problems.
[0006] In order to solve the above problem, an embodiment of the present invention provides an audio and video recording method, which is applied to a conference management system supporting a second addressing capability, and the method includes:
[0007] When a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting a second addressing capability are obtained from a bridge server;
[0008] Controlling the second virtual terminal to join a conference, and allowing the first virtual terminal to join a conference through a conference management system that supports the first addressing capability;
[0009] After the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, the audio and video stream of the second virtual terminal is sent to the recording and broadcasting server; wherein the audio and video stream of the first virtual terminal is the audio and video stream switched from the first terminal to the first virtual terminal.
[0010] Optionally, before acquiring the first virtual terminal supporting the first addressing capability and the second virtual terminal supporting the second addressing capability from the bridge server, the method further includes:
[0011] When a second terminal supporting the second address capability initiates audio and video recording in a converged conference, the audio and video stream corresponding to the second terminal is sent to the recording and broadcasting server.
[0012] Optionally, after the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, and sends the audio and video stream of the second virtual terminal to the recording and broadcasting server, the method further includes:
[0013] Receive the target audio and video returned by the recording and broadcasting server;
[0014] The target audio and video are sent to the conference scheduling terminal.
[0015] Optionally, the first terminal is a 16-bit terminal and the second terminal is a 64-bit terminal.
[0016] In order to solve the above problem, an embodiment of the present invention provides an audio and video recording system, the system includes a conference management system supporting a first addressing capability, a conference management system supporting a second addressing capability and a bridge server, and the method includes:
[0017] When a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, the bridge server sends a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability to the conference management system supporting the second addressing capability;
[0018] The conference management system supporting the second addressing capability controls the second virtual terminal to join the conference;
[0019] The conference management system supporting the first addressing capability controls the first virtual terminal to join the conference;
[0020] The bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal;
[0021] The conference management system supporting the second addressing capability sends the audio and video stream of the second virtual terminal to the recording and broadcasting server; wherein the audio and video stream of the first virtual terminal is the audio and video stream switched from the first terminal to the first virtual terminal.
[0022] In order to solve the above problem, an embodiment of the present invention provides an audio and video recording device, which is applied to a conference management system supporting a second addressing capability, and the device includes:
[0023] An acquisition module, configured to acquire a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability from a bridge server when a first terminal supporting the first addressing capability initiates audio and video recording in a converged conference;
[0024] A control module, used for controlling the second virtual terminal to join a conference, and allowing the first virtual terminal to join a conference through a conference management system that supports the first addressing capability;
[0025] The first sending module is used to send the audio and video stream of the second virtual terminal to the recording and broadcasting server after the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal; wherein the audio and video stream of the first virtual terminal is the audio and video stream switched from the first terminal to the first virtual terminal.
[0026] Optionally, the device further comprises:
[0027] The second sending module is used to send the audio and video stream corresponding to the second terminal to the recording and broadcasting server when the second terminal supporting the second address capability initiates audio and video recording in the converged conference.
[0028] Optionally, the device further comprises:
[0029] A receiving module, used for receiving the target audio and video returned by the recording and broadcasting server;
[0030] The third sending module is used to send the target audio and video to the conference scheduling end.
[0031] Optionally, the first terminal is a 16-bit terminal and the second terminal is a 64-bit terminal.
[0032] In order to solve the above problem, an embodiment of the present invention provides an electronic device, including:
[0033] one or more processors; and
[0034] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the device to perform the above-mentioned audio and video recording method.
[0035] In order to solve the above problem, an embodiment of the present invention provides a computer-readable storage medium, which stores a computer program that enables a processor to execute the above audio and video recording method.
[0036] The embodiments of the present invention include the following advantages:
[0037] In an embodiment of the present invention, when a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, a conference management system supporting a second addressing capability obtains a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability from a bridging server; controls the second virtual terminal to join the conference, and joins the first virtual terminal through the conference management system supporting the first addressing capability; after the bridging server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, the audio and video stream of the second virtual terminal is sent to the recording and broadcasting server; wherein the audio and video stream of the first virtual terminal is the audio and video stream cut from the first terminal to the first virtual terminal, and the first terminal can be selected for audio and video recording, so that the business of the visual network can be expanded. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] Figure 1 A flowchart of an audio and video recording method provided by Embodiment 1 of the present invention is shown;
[0039] Figure 2 A flowchart of an audio and video recording method provided by Embodiment 2 of the present invention is shown;
[0040] Figure 3 A flowchart showing the steps of an audio and video recording system provided by Embodiment 3 of the present invention is shown.
[0041] Figure 4 A structural block diagram of an audio and video recording device provided by Embodiment 3 of the present invention is shown;
[0042] Figure 5 A schematic diagram of a visual network of the present invention is shown;
[0043] Figure 6 A schematic diagram of the hardware structure of a node server of the present invention is shown;
[0044] Figure 7 A schematic diagram of the hardware structure of an access switch of the present invention is shown;
[0045] Figure 8 A schematic diagram of the hardware structure of an Ethernet protocol conversion gateway of the present invention is shown. DETAILED DESCRIPTION
[0046] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
[0047] Reference Figure 1 , shows a flowchart of the steps of an audio and video recording method provided by Embodiment 1 of the present invention, the method can be applied to a conference management system supporting the second addressing capability, and specifically may include the following steps:
[0048] Step 501: When a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting a second addressing capability are obtained from a bridge server.
[0049] In the present invention, the first terminal may be a device in a 16-bit system of a visual network. Specifically, the model of the terminal may be determined according to actual conditions, and the embodiment of the present invention does not limit this.
[0050] The converged conference can be started first, and the audio and video recording request sent by the first terminal can be received through the conference management system supporting the second addressing capability, and the first virtual terminal supporting the first addressing capability and the second virtual terminal supporting the second addressing capability sent by the bridge server can be accepted.
[0051] Among them, the conference management system supporting the second addressing capability can be a 64-bit conference management system, and the second virtual terminal is a virtual terminal corresponding to the 64-bit terminal; the conference management system corresponding to the first terminal supporting the first addressing capability can be a 16-bit conference management system.
[0052] In the present invention, the 64-bit conference management system obtains a group of corresponding virtual terminals from the bridge server, and the 64-bit conference management system sends the 16-bit terminal and the terminal number corresponding to the 16-bit virtual terminal to the 16-bit conference management system.
[0053] It should be noted that the converged conference can be understood as: the 64-bit conference management system of the visual network and the 16-bit conference management system are held in one conference, with the 64-bit conference management system as the main conference management system and the 16-bit conference management system as the sub-conference management system. The client (Pamir) used in the 64-bit visual network conference is used to hold the conference, and the relevant bridge server number and the number of the 16-bit conference management system are configured. The device number of the 64-bit conference management system and the device number of the 16-bit conference management system are added to the relevant device list to hold the conference.
[0054] When a first terminal supporting a first addressing capability initiates audio and video recording in a convergent conference, after obtaining a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability from a bridge server, step 502 is performed.
[0055] Step 502: Control the second virtual terminal to join the conference, and allow the first virtual terminal to join the conference through a conference management system that supports the first addressing capability.
[0056] Optionally, when the conference management system supporting the second addressing capability is a 64-bit conference management system, and the conference management system corresponding to the first terminal supporting the first addressing capability is a 16-bit conference management system, the 64-bit conference management system can join the 64-bit virtual terminal to the meeting, and the 16-bit conference management system can join the 16-bit virtual terminal to the meeting.
[0057] After the second virtual terminal is controlled to join the conference, and the first virtual terminal is allowed to join the conference through the conference management system supporting the first addressing capability, step 503 is executed.
[0058] Step 503: After the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, the audio and video stream of the second virtual terminal is sent to the recording and broadcasting server.
[0059] The audio and video stream of the first virtual terminal is the audio and video stream switched from the first terminal to the first virtual terminal.
[0060] The bridge server can transfer the audio and video stream of the first virtual terminal to the second virtual terminal, and the conference management system supporting the second addressing capability can send the audio and video stream of the second virtual terminal to the recording and broadcasting server.
[0061] Optionally, when the conference management system supporting the second addressing capability is a 64-bit conference management system, and the conference management system corresponding to the first terminal supporting the first addressing capability is a 16-bit conference management system, the 16-bit conference management system switches the audio and video stream corresponding to the first terminal to the first virtual terminal, and then sends the corresponding audio and video stream to the bridging server.
[0062] The bridging server maps the audio and video stream corresponding to the first virtual terminal and the audio and video stream corresponding to the second virtual terminal to obtain a mapping relationship between the two. The bridging server sends the received audio and video stream of the first virtual terminal to the second virtual terminal according to the protocol and stream switching channel between the first virtual terminal and the second virtual terminal to complete the mapping of the audio and video streams of the first virtual terminal and the second virtual terminal.
[0063] The recording and broadcasting server may generate a recording and broadcasting service number, and the recording and broadcasting service number refers to a service number that can be recorded and provided by the storage gateway.
[0064] In an embodiment of the present invention, when a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, a conference management system supporting a second addressing capability obtains a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability from a bridging server; controls the second virtual terminal to join the conference, and joins the first virtual terminal through the conference management system supporting the first addressing capability; after the bridging server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, the audio and video stream of the second virtual terminal is sent to the recording and broadcasting server; wherein the audio and video stream of the first virtual terminal is the audio and video stream cut from the first terminal to the first virtual terminal, and the first terminal can be selected for audio and video recording, so that the business of the visual network can be expanded.
[0065] Reference Figure 2 , shows a flowchart of the steps of an audio and video recording method provided by Embodiment 2 of the present invention, which can be applied to a conference management system supporting a second addressing capability, and specifically may include the following steps:
[0066] Step 601: When a second terminal supporting the second address capability initiates audio and video recording in a converged conference, the audio and video stream corresponding to the second terminal is sent to a recording and broadcasting server.
[0067] In the present invention, the second terminal may be a 64-bit terminal, which refers to a device in a 64-bit system of the visual network.
[0068] The convergent conference may be started first, and the audio and video recording request sent by the second terminal may be received through the conference management system supporting the second addressing capability.
[0069] Specifically, the second terminal and the first terminal can be added to the Pamir interface device list, and a bridge server and a conference management system number that supports the first addressing capability can be configured to start a converged conference. After receiving the audio and video recording request initiated by the second terminal, the conference management system that supports the second addressing capability controls the second virtual terminal to perform audio and video recording.
[0070] The first terminal may be a 16-bit terminal, the conference management system supporting the second addressing capability may be a 64-bit conference management system, and the conference management system supporting the first addressing capability may be a 16-bit conference management system.
[0071] Step 602: When a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting a second addressing capability are obtained from a bridge server.
[0072] In the present invention, the first terminal may be a device in a 16-bit system of a visual network. Specifically, the model of the terminal may be determined according to actual conditions, and the embodiment of the present invention does not limit this.
[0073] The converged conference can be started first, and the audio and video recording request sent by the first terminal can be received through the conference management system supporting the second addressing capability, and the first virtual terminal supporting the first addressing capability and the second virtual terminal supporting the second addressing capability sent by the bridge server can be accepted.
[0074] Among them, the conference management system supporting the second addressing capability can be a 64-bit conference management system, and the second virtual terminal is a virtual terminal corresponding to the 64-bit terminal; the conference management system corresponding to the first terminal supporting the first addressing capability can be a 16-bit conference management system.
[0075] In the present invention, the 64-bit conference management system obtains a group of corresponding virtual terminals from the bridge server, and the 64-bit conference management system sends the 16-bit terminal and the terminal number corresponding to the 16-bit virtual terminal to the 16-bit conference management system.
[0076] It should be noted that the converged conference can be understood as: the 64-bit conference management system of the visual network and the 16-bit conference management system are held in one conference, with the 64-bit conference management system as the main conference management system and the 16-bit conference management system as the sub-conference management system. The client (Pamir) used in the 64-bit visual network conference is used to hold the conference, and the relevant bridge server number and the number of the 16-bit conference management system are configured. The device number of the 64-bit conference management system and the device number of the 16-bit conference management system are added to the relevant device list to hold the conference.
[0077] When a first terminal supporting the first addressing capability initiates audio and video recording in a convergent conference, after obtaining a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability from a bridge server, step 603 is performed.
[0078] Step 603: Control the second virtual terminal to join the conference, and allow the first virtual terminal to join the conference through the conference management system that supports the first addressing capability.
[0079] Optionally, when the conference management system supporting the second addressing capability is a 64-bit conference management system, and the conference management system corresponding to the first terminal supporting the first addressing capability is a 16-bit conference management system, the 64-bit conference management system can join the 64-bit virtual terminal to the meeting, and the 16-bit conference management system can join the 16-bit virtual terminal to the meeting.
[0080] After the second virtual terminal is controlled to join the conference, and the first virtual terminal is allowed to join the conference through the conference management system supporting the first addressing capability, step 604 is executed.
[0081] Step 604: After the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, the audio and video stream of the second virtual terminal is sent to the recording and broadcasting server.
[0082] The audio and video stream of the first virtual terminal is the audio and video stream switched from the first terminal to the first virtual terminal.
[0083] The bridge server can transfer the audio and video stream of the first virtual terminal to the second virtual terminal, and the conference management system supporting the second addressing capability can send the audio and video stream of the second virtual terminal to the recording and broadcasting server.
[0084] Optionally, when the conference management system supporting the second addressing capability is a 64-bit conference management system, and the conference management system corresponding to the first terminal supporting the first addressing capability is a 16-bit conference management system, the 16-bit conference management system switches the audio and video stream corresponding to the first terminal to the first virtual terminal, and then sends the corresponding audio and video stream to the bridging server.
[0085] The bridging server maps the audio and video stream corresponding to the first virtual terminal and the audio and video stream corresponding to the second virtual terminal to obtain a mapping relationship between the two. The bridging server sends the received audio and video stream of the first virtual terminal to the second virtual terminal according to the protocol and stream switching channel between the first virtual terminal and the second virtual terminal to complete the mapping of the audio and video streams of the first virtual terminal and the second virtual terminal.
[0086] The recording and broadcasting server may generate a recording and broadcasting service number, and the recording and broadcasting service number refers to a service number that can be recorded and provided by the storage gateway.
[0087] After the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal and sends the audio and video stream of the second virtual terminal to the recording and broadcasting server, step 605 is executed.
[0088] Step 605: Receive the target audio and video returned by the recording and broadcasting server.
[0089] In the present invention, the recording and broadcasting server can send the recorded target audio and video to the conference management system that supports the second addressing capability.
[0090] After receiving the target audio and video returned by the recording and broadcasting server, step 606 is executed.
[0091] Step 606: Send the target audio and video to the conference scheduling end.
[0092] In the present invention, the conference management system supporting the second addressing capability can send the target audio and video to the conference scheduling terminal after receiving the target audio and video returned by the recording and broadcasting server.
[0093] In an embodiment of the present invention, when a second terminal supporting the second address capability initiates audio and video recording in a converged conference, the conference management system supporting the second address capability sends the audio and video stream corresponding to the second terminal to the recording and broadcasting server. When a first terminal supporting the first address capability initiates audio and video recording in a converged conference, the conference management system supporting the second address capability obtains a first virtual terminal supporting the first address capability and a second virtual terminal supporting the second address capability from a bridging server; controls the second virtual terminal to join the conference, and joins the first virtual terminal through the conference management system supporting the first address capability; after the bridging server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, the audio and video stream of the second virtual terminal is sent to the recording and broadcasting server; receives the target audio and video returned by the recording and broadcasting server, and sends the target audio and video to the conference scheduling end, so that the first terminal or the second terminal can be arbitrarily selected for audio and video recording, thereby expanding the business of the visual network.
[0094] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.
[0095] Reference Figure 3 , shows a flowchart of the steps of an audio and video recording system provided by Embodiment 3 of the present invention. The method can be applied to a system including a conference management system supporting a first addressing capability, a conference management system supporting a second addressing capability, and a bridge server, and can specifically include the following steps:
[0096] Step 701: When a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, a bridge server sends a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability to a conference management system supporting the second addressing capability.
[0097] Step 702: The conference management system supporting the second addressing capability controls the second virtual terminal to join the conference.
[0098] Step 703: The conference management system supporting the first addressing capability controls the first virtual terminal to join the conference.
[0099] Step 704: The bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal.
[0100] Step 705: The conference management system supporting the second addressing capability sends the audio and video streams of the second virtual terminal to the recording and broadcasting server.
[0101] The audio and video stream of the first virtual terminal is the audio and video stream switched from the first terminal to the first virtual terminal.
[0102] In an embodiment of the present invention, when a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, a bridging server sends a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability to a conference management system supporting the second addressing capability, the conference management system supporting the second addressing capability controls the second virtual terminal to join the conference, the conference management system supporting the first addressing capability controls the first virtual terminal to join the conference, the bridging server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, and the conference management system supporting the second addressing capability sends the audio and video stream of the second virtual terminal to the recording and broadcasting server, so that the first terminal can be selected for audio and video recording, thereby expanding the business of the visual network.
[0103] The specific implementation steps of this embodiment have been described in detail in the method section and will not be repeated here.
[0104] Reference Figure 4 , shows a structural block diagram of an audio and video recording device provided in Embodiment 3 of the present invention. The audio and video recording device 800 can be applied to a conference management system supporting the second addressing capability. The device specifically includes:
[0105] The acquisition module 801 is used to acquire a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability from a bridge server when a first terminal supporting the first addressing capability initiates audio and video recording in a convergent conference.
[0106] The control module 802 is used to control the second virtual terminal to join the conference, and to allow the first virtual terminal to join the conference through the conference management system that supports the first addressing capability.
[0107] The first sending module 803 is used to send the audio and video stream of the second virtual terminal to the recording and broadcasting server after the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal; wherein the audio and video stream of the first virtual terminal is the audio and video stream switched from the first terminal to the first virtual terminal.
[0108] Optionally, the device further comprises:
[0109] The second sending module is used to send the audio and video stream corresponding to the second terminal to the recording and broadcasting server when the second terminal supporting the second address capability initiates audio and video recording in the converged conference.
[0110] Optionally, the device further comprises:
[0111] A receiving module, used to receive the target audio and video returned by the recording and broadcasting server;
[0112] The third sending module is used to send the target audio and video to the conference scheduling end.
[0113] Optionally, the first terminal is a 16-bit terminal and the second terminal is a 64-bit terminal.
[0114] In an embodiment of the present invention, a conference management system that supports the second addressing capability can, through an acquisition module, obtain a first virtual terminal that supports the first addressing capability and a second virtual terminal that supports the second addressing capability from a bridge server when a first terminal that supports the first addressing capability initiates audio and video recording in a converged conference; then, through a control module, control the second virtual terminal to join the conference, and join the first virtual terminal through the conference management system that supports the first addressing capability; finally, through a first sending module, after the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, the audio and video stream of the second virtual terminal is sent to the recording and broadcasting server; wherein, the audio and video stream of the first virtual terminal is the audio and video stream cut from the first terminal to the first virtual terminal, which can realize the selection of the first terminal for audio and video recording, so that the business of the visual network can be expanded.
[0115] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0116] An embodiment of the present invention further provides an electronic device, including:
[0117] one or more processors; and
[0118] One or more machine-readable media having instructions stored thereon, when executed by one or more processors, enable the device to perform the audio and video recording method as described above.
[0119] An embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program that enables a processor to execute the above-mentioned audio and video recording method.
[0120] The visual Internet is an important milestone in the development of the Internet. It is a real-time network that can realize real-time transmission of high-definition video and push many Internet applications towards high-definition video and high-definition face-to-face communication.
[0121] The visual network adopts real-time high-definition video exchange technology. It can integrate the required services such as high-definition video conferencing, video monitoring, intelligent monitoring analysis, emergency command, digital radio and television, delayed TV, online teaching, live broadcast, VOD on demand, TV mail, personalized recording (PVR), intranet (self-operated) channels, intelligent video broadcast control, information release and dozens of other video, voice, picture, text, communication, data and other services on a single system platform, and realize high-definition quality video playback through TV or computer.
[0122] In order to enable those skilled in the art to better understand the embodiments of the present invention, the visual network is introduced as follows:
[0123] Some of the technologies used in the visual Internet of Things are as follows:
[0124] Network Technology
[0125] The network technology innovation of visual networking improves the traditional Ethernet to cope with the huge potential video traffic on the network. Different from simple network packet switching (Packet Switching) or network circuit switching (Circuit Switching), visual networking technology uses Packet Switching to meet the streaming needs. Visual networking technology has the flexibility, simplicity and low price of packet switching, and the quality and security guarantee of circuit switching, realizing the seamless connection of the whole network switching virtual circuit and data format.
[0126] Switching Technology
[0127] Visual networking uses the two advantages of Ethernet: asynchronism and packet switching. It eliminates Ethernet defects under the premise of full compatibility, and has seamless end-to-end connection across the entire network, directly connects to user terminals, and directly carries IP data packets. User data does not require any format conversion within the entire network. Visual networking is a more advanced form of Ethernet and a real-time switching platform that can achieve large-scale real-time transmission of high-definition video across the entire network, which is currently unattainable on the Internet, and pushes many network video applications towards high definition and unification.
[0128] Server Technology
[0129] The server technology on the visual network and unified video platform is different from the traditional server. Its streaming media transmission is based on connection-oriented. Its data processing capability is independent of traffic and communication time. A single network layer can include signaling and data transmission. For voice and video services, the complexity of streaming media processing on the visual network and unified video platform is much simpler than data processing, and its efficiency is more than 100 times higher than that of traditional servers.
[0130] Storage Technology
[0131] The ultra-high-speed storage technology of the unified video platform adopts the most advanced real-time operating system to adapt to the media content with ultra-large capacity and ultra-large flow, mapping the program information in the server command to the specific hard disk space. The media content no longer passes through the server, but is directly delivered to the user terminal in an instant. The user generally waits for less than 0.2 seconds. The optimized sector distribution greatly reduces the mechanical movement of the hard disk head seeking, and the resource consumption accounts for only 20% of the same level of IP Internet, but it generates 3 times more concurrent traffic than the traditional hard disk array, and the overall efficiency is improved by more than 10 times.
[0132] Network Security Technology
[0133] The structural design of the visual network completely eradicates the network security issues that plague the Internet through separate licensing for each service and complete isolation of equipment and user data. Generally, anti-virus programs and firewalls are not required, and attacks by hackers and viruses are eliminated, providing users with a structurally worry-free and secure network.
[0134] Service Innovation Technology
[0135] The unified video platform integrates services and transmission. Whether it is a single user, a private network user or a network, it is just an automatic connection. User terminals, set-top boxes or PCs are directly connected to the unified video platform to obtain rich and colorful multimedia video services in various forms. The unified video platform uses a "recipe-style" table configuration mode to replace traditional complex application programming. Complex applications can be implemented with very little code, realizing "unlimited" new business innovation.
[0136] The networking of the visual network is as follows:
[0137] Visual networking is a centrally controlled network structure. The network can be a tree network, star network, ring network, etc., but on this basis, there needs to be a centralized control node in the network to control the entire network.
[0138] like Figure 5 As shown in the figure, the visual network is divided into two parts: access network and metropolitan area network.
[0139] The equipment in the access network can be divided into three categories: node server, access switch, and terminal (including various set-top boxes, encoding boards, storage, etc.). The node server is connected to the access switch, and the access switch can be connected to multiple terminals and can be connected to Ethernet.
[0140] The node server is a node in the access network that performs centralized control functions and can control access switches and terminals. The node server can be directly connected to the access switch or directly connected to the terminal.
[0141] Similarly, the devices in the metropolitan area network can also be divided into three categories: metropolitan area servers, node switches, and node servers. The metropolitan area servers are connected to the node switches, and the node switches can be connected to multiple node servers.
[0142] The node server is a node server of the access network part, that is, the node server belongs to both the access network part and the metropolitan area network part.
[0143] The metropolitan area server is a node with centralized control function in the metropolitan area network, which can control the node switch and node server. The metropolitan area server can be directly connected to the node switch or the node server.
[0144] It can be seen from this that the entire visual network is a hierarchical and centrally controlled network structure, and the network controlled by the node server and the metropolitan area server can be various structures such as tree, star, and ring.
[0145] Figuratively speaking, the access network part can form a unified video platform (the part in the dotted circle), and multiple unified video platforms can form a visual network; each unified video platform can be interconnected through the metropolitan area and wide area visual networks.
[0146] Visual networking equipment classification
[0147] 1.1 The devices in the visual network of the embodiment of the present invention can be mainly divided into three categories: servers, switches (including Ethernet gateways), terminals (including various set-top boxes, encoding boards, storage devices, etc.). The visual network as a whole can be divided into a metropolitan area network (or a national network, a global network, etc.) and an access network.
[0148] 1.2 The equipment in the access network can be mainly divided into three categories: node server, access switch (including Ethernet gateway), terminal (including various set-top boxes, encoding boards, storage, etc.).
[0149] The specific hardware structure of each access network device is as follows:
[0150] Node server:
[0151] like Figure 6 As shown, it mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;
[0152] Among them, the packets coming from the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of checking the address table 205 on the incoming packets, thereby obtaining the packet's guidance information; and according to the packet's guidance information, the packet is stored in the queue of the corresponding packet buffer 206; if the queue of the packet buffer 206 is close to full, it is discarded; the switching engine module 202 polls all packet buffer queues, and forwards if the following conditions are met: 1) the port sending buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements the control of the hard disk, including the initialization, reading and writing of the hard disk; the CPU module 203 is mainly responsible for the protocol processing between the access switch and the terminal (not shown in the figure), the configuration of the address table 205 (including the downstream protocol packet address table, the upstream protocol packet address table, and the data packet address table), and the configuration of the disk array module 204.
[0153] Access switch:
[0154] like Figure 7 As shown, it mainly includes a network interface module (a downlink network interface module 301, an uplink network interface module 302), a switching engine module 303 and a CPU module 304;
[0155] Among them, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the destination address (DA), source address (SA), data packet type and packet length of the packet meet the requirements. If they meet the requirements, the corresponding stream identifier (stream-id) is allocated and enters the switching engine module 303, otherwise it is discarded; the packet (downlink data) coming from the uplink network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 304 enters the switching engine module 303; the switching engine module 303 processes the incoming packet The address table 306 is looked up to obtain the packet's guidance information; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in combination with the stream identifier (stream-id); if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downstream network interface to the upstream network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the packet's guidance information; if the queue of the packet buffer 307 is nearly full, it is discarded.
[0156] The switching engine module 303 polls all packet buffer queues. In the embodiment of the present invention, there are two situations:
[0157] If the queue is from the downlink network interface to the uplink network interface, it is forwarded if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero; 3) a token generated by the bit rate control module is obtained;
[0158] If the queue is not going from the downstream network interface to the upstream network interface, it is forwarded if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.
[0159] The code rate control module 308 is configured by the CPU module 304 to generate tokens for all packet buffer queues from the downstream network interface to the upstream network interface within a programmable interval to control the code rate of the upstream forwarding.
[0160] The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306 , and configuration of the bit rate control module 308 .
[0161] Ethernet protocol conversion gateway :
[0162] like Figure 8 As shown, it mainly includes a network interface module (a downlink network interface module 401, an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a bit rate control module 408, an address table 406, a packet buffer 407 and a MAC adding module 409, and a MAC deleting module 410.
[0163] The data packet from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the Ethernet MACDA, Ethernet MACSA, Ethernet lengthorframetype, visual network destination address DA, visual network source address SA, visual network data packet type and packet length of the data packet meet the requirements, and if they meet the requirements, the corresponding stream identifier (stream-id) is assigned; then, the MAC deletion module 410 subtracts MACDA, MACSA, lengthorframetype (2 bytes) and enters the corresponding receiving buffer, otherwise it is discarded;
[0164] The downlink network interface module 401 detects the sending buffer of the port. If there is a packet, it obtains the Ethernet MACDA of the corresponding terminal according to the visual network destination address DA of the packet, adds the Ethernet MAC DA of the terminal, the MACSA of the Ethernet protocol conversion gateway, and the Ethernet length or frame type, and sends it.
[0165] The functions of other modules in the Ethernet protocol conversion gateway are similar to those of the access switch.
[0166] terminal:
[0167] It mainly includes network interface module, business processing module and CPU module; for example, the set-top box mainly includes network interface module, audio and video encoding and decoding engine module, CPU module; the encoding board mainly includes network interface module, audio and video encoding engine module, CPU module; the memory mainly includes network interface module, CPU module and disk array module.
[0168] 1.3 The equipment in the metropolitan area network can be divided into two categories: node server, node switch, and metropolitan area server. Among them, the node switch mainly includes network interface module, switching engine module and CPU module; the metropolitan area server mainly includes network interface module, switching engine module and CPU module.
[0169] 2. Definition of Visual Network Data Packet
[0170] 2.1 Access Network Data Packet Definition
[0171] The data packet of the access network mainly includes the following parts: destination address (DA), source address (SA), reserved bytes, payload (PDU), and CRC.
[0172] As shown in the following table, the data packet of the access network mainly includes the following parts:
[0173] DA S Reserved Payload CRC
[0174] in:
[0175] The destination address (DA) consists of 8 bytes. The first byte indicates the type of data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), with a maximum of 256 possibilities. The second to sixth bytes are the metropolitan area network address, and the seventh and eighth bytes are the access network address.
[0176] The source address (SA) is also composed of 8 bytes and has the same definition as the destination address (DA).
[0177] The reserved bytes consist of 2 bytes;
[0178] The payload part has different lengths depending on the type of datagram. If it is a protocol packet, it is 64 bytes. If it is a single multicast data packet, it is 32+1024=1056 bytes. Of course, it is not limited to the above two types.
[0179] CRC consists of 4 bytes and its calculation method follows the standard Ethernet CRC algorithm.
[0180] 2.2 Definition of Metropolitan Area Network Data Packet
[0181] The topology of the metropolitan area network is a graph. There may be two or more connections between two devices, that is, there may be more than two connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metropolitan area network address of a metropolitan area network device is unique. In order to accurately describe the connection relationship between metropolitan area network devices, a parameter: a label is introduced in the embodiment of the present invention to uniquely describe a metropolitan area network device.
[0182] The definition of labels in this manual is similar to the definition of labels in MPLS (Multi-Protocol Label Switch). Assuming that there are two connections between device A and device B, there are two labels for the data packet from device A to device B, and there are two labels for the data packet from device B to device A. Labels are divided into input labels and output labels. Assuming that the label of the data packet entering device A (input label) is 0x0000, the label of the data packet when leaving device A (output label) may become 0x0001. The access process of the metropolitan area network is a centralized access process, which means that the address allocation and label allocation of the metropolitan area network are dominated by the metropolitan area server, and the node switch and node server are only passively executed. This is different from the label allocation of MPLS, which is the result of mutual negotiation between the switch and the server.
[0183] As shown in the following table, the data packets of the metropolitan area network mainly include the following parts:
[0184] DA S Reserved Label Payload CRC
[0185] That is, destination address (DA), source address (SA), reserved byte (Reserved), label, payload (PDU), CRC. The label format can refer to the following definition: the label is 32 bits, of which the upper 16 bits are reserved and only the lower 16 bits are used. It is located between the reserved bytes and payload of the data packet.
[0186] Based on the above characteristics of the visual network, one of the core concepts of an embodiment of the present invention is proposed. When a first terminal supporting a first addressing capability in a converged conference initiates audio and video recording, a conference management system supporting a second addressing capability obtains a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability from a bridging server; controls the second virtual terminal to join the conference, and joins the first virtual terminal through the conference management system supporting the first addressing capability; after the bridging server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, the audio and video stream of the second virtual terminal is sent to the recording and broadcasting server; wherein, the audio and video stream of the first virtual terminal is the audio and video stream cut from the first terminal to the first virtual terminal, which can realize the selection of the first terminal for audio and video recording, so that the business of the visual network can be expanded.
[0187] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0188] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0189] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0190] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0191] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0192] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.
[0193] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
[0194] The above is a detailed introduction to the audio and video recording method, system and device provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
Claims
1. An audio and video recording method, characterized in that: Applied to a conference management system supporting a second addressing capability, the method comprising: When a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability are obtained from a bridge server, wherein the conference management system supporting the second addressing capability is a 64-bit conference management system, then the second virtual terminal is a virtual terminal corresponding to the 64-bit terminal, and the conference management system corresponding to the first terminal supporting the first addressing capability is a 16-bit conference management system; Controlling the second virtual terminal to join a conference, and allowing the first virtual terminal to join a conference through a conference management system that supports the first addressing capability; After the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, the audio and video stream of the second virtual terminal is sent to the recording and broadcasting server; wherein the audio and video stream of the first virtual terminal is the audio and video stream switched from the first terminal to the first virtual terminal.
2. The method according to claim 1, characterized in that Before acquiring the first virtual terminal supporting the first addressing capability and the second virtual terminal supporting the second addressing capability from the bridge server, the method further includes: When a second terminal supporting a second addressing capability initiates audio and video recording in a converged conference, an audio and video stream corresponding to the second terminal is sent to the recording and broadcasting server.
3. The method according to claim 1, characterized in that After the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal, and sends the audio and video stream of the second virtual terminal to the recording and broadcasting server, the method further includes: Receive the target audio and video returned by the recording and broadcasting server; The target audio and video are sent to the conference scheduling terminal.
4. The method according to claim 1, characterized in that The first terminal is a 16-bit terminal, and the second terminal is a 64-bit terminal.
5. An audio and video recording system, characterized in that: The system includes a conference management system supporting a first addressing capability, a conference management system supporting a second addressing capability, and a bridge server, and the system includes: When a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, the bridging server sends a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability to the conference management system supporting the second addressing capability, wherein the conference management system supporting the second addressing capability is a 64-bit conference management system, then the second virtual terminal is a virtual terminal corresponding to the 64-bit terminal, and the conference management system corresponding to the first terminal supporting the first addressing capability is a 16-bit conference management system; The conference management system supporting the second addressing capability controls the second virtual terminal to join the conference; The conference management system supporting the first addressing capability controls the first virtual terminal to join the conference; The bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal; The conference management system supporting the second addressing capability sends the audio and video stream of the second virtual terminal to the recording and broadcasting server; wherein the audio and video stream of the first virtual terminal is the audio and video stream switched from the first terminal to the first virtual terminal.
6. An audio and video recording device, characterized in that: Applicable to a conference management system supporting a second addressing capability, the device comprising: An acquisition module, used for acquiring, when a first terminal supporting a first addressing capability initiates audio and video recording in a converged conference, a first virtual terminal supporting the first addressing capability and a second virtual terminal supporting the second addressing capability from a bridge server, wherein the conference management system supporting the second addressing capability is a 64-bit conference management system, then the second virtual terminal is a virtual terminal corresponding to the 64-bit terminal, and the conference management system corresponding to the first terminal supporting the first addressing capability is a 16-bit conference management system; A control module, used for controlling the second virtual terminal to join a conference, and allowing the first virtual terminal to join a conference through a conference management system that supports the first addressing capability; The first sending module is used to send the audio and video stream of the second virtual terminal to the recording and broadcasting server after the bridge server transfers the audio and video stream of the first virtual terminal to the second virtual terminal; wherein the audio and video stream of the first virtual terminal is the audio and video stream switched from the first terminal to the first virtual terminal.
7. The device according to claim 6, characterized in that The device also includes: The second sending module is used to send the audio and video stream corresponding to the second terminal to the recording and broadcasting server when the second terminal supporting the second addressing capability initiates audio and video recording in the convergent conference.
8. The device according to claim 6, characterized in that The device also includes: A receiving module, used for receiving the target audio and video returned by the recording and broadcasting server; The third sending module is used to send the target audio and video to the conference scheduling end.
9. The device according to claim 6, characterized in that The first terminal is a 16-bit terminal, and the second terminal is a 64-bit terminal.
10. An electronic device, characterized in that: include: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to execute the audio and video recording method according to any one of claims 1 to 4.
11. A computer-readable storage medium, characterized in that: The computer program stored therein enables the processor to execute the audio and video recording method described in any one of claims 1 to 4.
