Interactive video network transmission method and system, recording and broadcasting host and storage medium

Abstract

The embodiment of the application provides an interactive video network transmission method, system, recording and broadcasting host and storage medium, the network quality of the main recording and broadcasting host is monitored, when the network quality of the main recording and broadcasting host meets a preset congestion condition, the video data to be transmitted is transmitted from the recording and broadcasting host by using a TCP transmission protocol in a picture transmission mode, and the video data transmitted in the picture transmission mode is received under the condition that the network quality of the main recording and broadcasting host meets a first preset congestion condition. Through the TCP congestion control mechanism, when the bandwidth is insufficient, the sending rate of TCP is actively reduced, packet loss and invalid transmission are avoided, the quality of network transmission can be effectively improved, the basic transmission of video is guaranteed, the packet loss rate of network data packets is reduced, and the transmission efficiency of media data is improved. In addition, the video picture transmission mode can reduce the video data to be transmitted, thereby reducing the packet loss rate when the network environment is congested, improving the transmission efficiency of media data, and finally optimizing the interactive effect.

Description

Technical Field

[0001] This application relates to the field of network device management technology, and in particular to interactive video network transmission methods, systems, recording and broadcasting hosts and storage media. Background Technology

[0002] In the cloud-based interactive recording and broadcasting host, in order to ensure the real-time transmission of media data, the UDP (User Datagram Protocol) network transmission protocol is used to complete the transmission of video and audio data.

[0003] Due to the complexity of the network environment, packet loss is inevitable during network transmission. Video packet loss causes stuttering at the receiving end, while audio packet loss causes noise or stuttering. To avoid these problems, when the receiving application layer detects packet loss, it notifies the sending application layer to retransmit the lost data packets. In a good network environment, this retransmission is necessary and beneficial. However, in a poor network environment, the network bandwidth is insufficient for the transmission of video and audio data. In this case, continuing to add more retransmissions not only fails to solve the packet loss problem but also worsens it, affecting media data transmission and ultimately impacting the overall system usability. Summary of the Invention

[0004] The purpose of this application is to provide an interactive video network transmission method, system, recording host, and storage medium to improve the transmission efficiency of media data when the network environment is poor. The specific technical solution is as follows:

[0005] In a first aspect, embodiments of this application provide an interactive video network transmission system, the system comprising: a main recording host and at least one slave recording host;

[0006] The main recording host is used to obtain its own network quality; when the network quality of the main recording host meets the first preset congestion condition, the video data to be transmitted is transmitted using the TCP transmission protocol in image transmission mode, wherein the image transmission mode means transmitting data in the form of images by capturing images.

[0007] The slave recording host is used to receive video data transmitted in image transmission mode when the network quality of the master recording host meets the first preset congestion condition.

[0008] In one possible implementation, the main recording host is further configured to: obtain the network quality of the slave recording host; when the network quality of the main recording host meets a first preset smooth flow condition and there is a slave recording host whose network quality meets a second preset congestion condition, transmit the video data to be transmitted using the UDP transmission protocol in video stream transmission mode and the TCP transmission protocol in image transmission mode; send a first message to the slave recording host indicating that the video data to be transmitted is being transmitted simultaneously in video stream transmission mode and image transmission mode, wherein the video stream transmission mode indicates that the data is transmitted in the form of a video encoded bitstream through video encoding;

[0009] The recording host is also used to obtain its own network quality; when it receives the first message and its own network quality meets the second preset congestion condition, it receives video data transmitted in the image transmission mode; when it receives the first message and its own network quality does not meet the second preset congestion condition, it receives video data transmitted in the video stream transmission mode.

[0010] In one possible implementation, the main recording host is further configured to: transmit the video data to be transmitted in image transmission mode using the TCP transmission protocol when the network quality of the main recording host meets the second preset smooth condition and there is a slave recording host whose network quality meets the second preset congestion condition; and send a second message to the slave recording host indicating that the video data to be transmitted is transmitted in image transmission mode.

[0011] The recording host is further configured to receive, upon receiving the second message, the video data to be transmitted in image transmission mode.

[0012] In one possible implementation, the main recording host is further configured to: transmit the video data to be transmitted using the UDP transmission protocol in a video stream transmission mode when the network quality of the main recording host meets the second preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition; and send a third message to the slave recording host indicating that the video data to be transmitted is being transmitted in a video stream transmission mode.

[0013] The recording host is further configured to receive video data to be transmitted in video stream transmission mode upon receiving the third message.

[0014] In one possible implementation, the main recording host is further configured to: transmit video data to be transmitted using the UDP transmission protocol in a video stream transmission mode when the network quality of the main recording host meets the first preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition; and send a third message to the slave recording host.

[0015] The recording host is further configured to receive video data to be transmitted in video stream transmission mode upon receiving the third message.

[0016] In one possible implementation, the recording host is specifically used to: during the data reception process, obtain the first data packet loss rate of the data packet finally received by itself after the Nth retransmission of the data packet; if the first data packet loss rate within a preset time period is greater than a preset first packet loss rate threshold, determine that its own network quality meets a second preset congestion condition; and send a congestion message to the main recording host, wherein N is a preset integer greater than 1.

[0017] The main recording host is also used to determine, upon receiving a congestion message from the slave recording host, that the slave recording host meets a second preset congestion condition.

[0018] In one possible implementation, the main recording host is specifically configured to: during the data reception process, acquire a second data packet loss rate of the data packet it finally receives after the Nth retransmission of the data packet; if the second data packet loss rate within a preset time period is not greater than a preset second packet loss rate threshold, determine that its network quality meets a first preset smooth flow condition; if the second data packet loss rate within a preset time period is not greater than a preset third packet loss rate threshold, and there is a first data packet loss rate greater than the preset second packet loss rate threshold, determine that its network quality meets a second preset smooth flow condition; if the second data packet loss rate within a preset time period is greater than a preset fourth packet loss rate threshold, determine that its network quality meets a first preset congestion condition; wherein, the preset second packet loss rate threshold is less than the preset third packet loss rate threshold, and the preset third packet loss rate threshold is less than the preset fourth packet loss rate threshold.

[0019] In one possible implementation, the main recording host is specifically used to: capture images of the video data to be transmitted at preset capture intervals when the network quality of the main recording host meets the first preset congestion condition, thereby obtaining images to be transmitted; and transmit the images to be transmitted using the TCP transmission protocol.

[0020] In one possible implementation, the interactive video network transmission system further includes: a server;

[0021] The main recording host is specifically used to upload the image to be transmitted to the server via an HTTP URL, and after the image to be transmitted is uploaded, to send an upload completion message of the image to be transmitted to the slave recording host.

[0022] The recording host is specifically used to download and play the image to be transmitted from the server according to the HTTP URL after receiving the upload completion message.

[0023] Secondly, embodiments of this application provide an interactive video network transmission method, applied to a main recording host, the method comprising:

[0024] Obtain the network quality of the main recording host;

[0025] When the network quality of the main recording host meets the first preset congestion condition, the video data to be transmitted is transmitted using the TCP transmission protocol in image transmission mode, wherein the image transmission mode means transmitting data in the form of images by capturing pictures.

[0026] In one possible implementation, the method further includes:

[0027] Obtain network quality information from the recording host;

[0028] When the network quality of the main recording host meets the first preset smooth condition and there is a slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted in video stream transmission mode using the UDP transmission protocol and in image transmission mode using the TCP transmission protocol. The video stream transmission mode means that the data is transmitted in the form of video encoded bitstream through video encoding.

[0029] A first message is sent to the recording host indicating that the video data to be transmitted is being transmitted simultaneously in both video stream transmission mode and image transmission mode.

[0030] In one possible implementation, the method further includes:

[0031] When the network quality of the main recording host meets the second preset smooth condition and there is a slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted in image transmission mode using the TCP transmission protocol.

[0032] A second message is sent from the recording host indicating that the video data to be transmitted is being transmitted in image transmission mode.

[0033] In one possible implementation, the method further includes:

[0034] When the network quality of the main recording host meets the second preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted in video stream transmission mode using the UDP transmission protocol.

[0035] A third message is sent from the recording host indicating that the video data to be transmitted is being transmitted in video stream transmission mode.

[0036] In one possible implementation, the method further includes:

[0037] When the network quality of the main recording host meets the first preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted in video stream transmission mode using the UDP transmission protocol.

[0038] Send a third message to the recording host.

[0039] In one possible implementation, obtaining the network quality from the recording host includes:

[0040] Upon receiving a congestion message from the recording host, it is determined that the recording host meets the second preset congestion condition.

[0041] In one possible implementation, obtaining the network quality of the main recording host includes:

[0042] During the process of receiving data by the main recording host, the second data packet loss rate of the data packet finally received by the main recording host after the Nth retransmission of the data packet is obtained, wherein N is a pre-set integer greater than 1;

[0043] If the second data packet loss rate within the preset time period is not greater than the preset second packet loss rate threshold, it is determined that the network quality of the main recording host meets the first preset smooth condition.

[0044] If the second data packet loss rate within a preset time period is not greater than the preset third packet loss rate threshold, and there is a first data packet loss rate greater than the preset second packet loss rate threshold, the network quality of the main recording host is determined to meet the second preset smooth condition; wherein, the preset second packet loss rate threshold is less than the preset third packet loss rate threshold.

[0045] If the second data packet loss rate within a preset time period is greater than the preset fourth packet loss rate threshold, it is determined that the network quality of the main recording host meets the first preset congestion condition; wherein, the preset third packet loss rate threshold is less than the preset fourth packet loss rate threshold.

[0046] In one possible implementation, the step of transmitting the video data to be transmitted using the TCP transmission protocol in image transmission mode, when the network quality of the main recording host meets a first preset congestion condition, includes:

[0047] When the network quality of the main recording host meets the first preset congestion condition, the video data to be transmitted is captured at a preset capture interval to obtain the image to be transmitted.

[0048] The image to be transmitted is transmitted using the TCP transport protocol.

[0049] In one possible implementation, transmitting the image to be transmitted using the TCP transport protocol includes:

[0050] The image to be transmitted is uploaded to the server via an HTTP URL.

[0051] After the image to be transmitted is uploaded, an upload completion message for the image to be transmitted is sent to the recording host.

[0052] Thirdly, embodiments of this application provide an interactive video network transmission method, applied to a recording and broadcasting host, the method comprising:

[0053] When the network quality of the main recording host meets the first preset congestion condition, video data transmitted using the TCP transmission protocol in image transmission mode is received, wherein the image transmission mode means that the data is transmitted in the form of an image by capturing a screenshot.

[0054] In one possible implementation, the method further includes:

[0055] Obtain the network quality from the recording host;

[0056] Upon receiving the first message and provided that the network quality of the recording host meets the second preset congestion condition, video data transmitted in image transmission mode is received.

[0057] Upon receiving the first message and when the network quality of the recording host does not meet the second preset congestion condition, video data transmitted in a video stream transmission mode is received, wherein the video stream transmission mode means transmitting data in the form of a video encoded stream through video encoding.

[0058] In one possible implementation, the method further includes:

[0059] Upon receiving the second message, the video data to be transmitted is received in image transmission mode.

[0060] In one possible implementation, the method further includes:

[0061] Upon receiving a third message, the system receives the video data to be transmitted in video stream transmission mode.

[0062] In one possible implementation, obtaining the network quality from the recording host includes:

[0063] During the data reception process, the first data packet loss rate of the data packet finally received from the recording host after the Nth retransmission of the data packet is obtained;

[0064] If the first data packet loss rate within the preset time period is greater than the preset first packet loss rate threshold, it is determined that the network quality of the recording host meets the second preset congestion condition.

[0065] A congestion message is sent to the main recording host, wherein N is a pre-set integer greater than 1.

[0066] In one possible implementation, receiving video data transmitted in image transmission mode includes:

[0067] After receiving the upload completion message from the main recording host, the image to be transmitted is downloaded from the server and played according to the HTTP URL.

[0068] Fourthly, embodiments of this application provide a recording and broadcasting host, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;

[0069] Memory, used to store computer programs;

[0070] When a processor executes a program stored in memory, it implements the steps of the interactive video network transmission method described in the second and third aspects.

[0071] Fifthly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the interactive video network transmission method steps described in the second and third aspects.

[0072] Beneficial effects of the embodiments in this application:

[0073] The interactive video network transmission method, system, recording host, and storage medium provided in this application embodiment allow the main recording host to monitor its own network quality. When the network quality meets a first preset congestion condition, the main recording host uses the TCP transmission protocol to transmit video data in image transmission mode. Image transmission mode means transmitting data as images by capturing screenshots. The recording host receives the video data transmitted in image transmission mode when the main recording host's network quality meets the first preset congestion condition. Because TCP is connection-oriented, reliable, and has a congestion control mechanism, it actively reduces the TCP sending rate when bandwidth is insufficient to avoid packet loss and invalid transmission, effectively improving network transmission quality, ensuring basic video transmission, reducing network data packet loss rate, and improving media data transmission efficiency. Furthermore, switching the video transmission mode from video stream transmission mode to image transmission mode reduces the amount of video data transmitted, thereby reducing packet loss rate during network congestion and improving media data transmission efficiency. Of course, implementing any product or method of this application does not necessarily require achieving all of the above advantages simultaneously. Attached Figure Description

[0074] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other embodiments can be obtained based on these drawings without creative effort.

[0075] Figure 1 This is a schematic diagram of a first structure of an interactive video network transmission system according to an embodiment of this application;

[0076] Figure 2 This is a schematic diagram of a second structure of the interactive video network transmission system according to an embodiment of this application;

[0077] Figure 3 This is a schematic diagram illustrating a third application of the interactive video network transmission system according to an embodiment of this application;

[0078] Figure 4 This is a fourth flowchart illustrating the interactive video network transmission system according to an embodiment of this application;

[0079] Figure 5 This is a fifth flowchart illustrating the interactive video network transmission system according to an embodiment of this application;

[0080] Figure 6 This is a sixth flowchart illustrating the interactive video network transmission system according to an embodiment of this application;

[0081] Figure 7This is a seventh flowchart illustrating the interactive video network transmission system according to an embodiment of this application;

[0082] Figure 8 This is an eighth flowchart illustrating the interactive video network transmission system according to an embodiment of this application;

[0083] Figure 9 This is a first flowchart of an interactive video network transmission method according to an embodiment of this application. Detailed Implementation

[0084] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art based on this application are within the scope of protection of this application.

[0085] First, let me explain the terminology used in this application:

[0086] TCP: Transmission Control Protocol. The TCP transport protocol is a connection-oriented, reliable, byte-stream-based transport layer communication protocol with congestion control and flow control mechanisms.

[0087] UDP is a connectionless transport layer protocol in the OSI (Open System Interconnection) reference model. It provides a simple, unreliable, transaction-oriented message delivery service. UDP has the disadvantage of not providing packet grouping, assembly, and ordering. In other words, after a message is sent, the receiver does not send an acknowledgment message, and the sender cannot know whether its data has arrived safely and completely.

[0088] This application provides an interactive video network transmission system, see [link to relevant documentation]. Figure 1 It includes: a main recording host and at least one slave recording host.

[0089] The main recording host is used to obtain its own network quality; when the network quality of the main recording host meets the first preset congestion condition, the video data to be transmitted is transmitted using the TCP transmission protocol in image transmission mode, wherein the image transmission mode means transmitting data in the form of images by capturing images.

[0090] The slave recording host is used to receive video data transmitted in image transmission mode when the network quality of the master recording host meets the first preset congestion condition.

[0091] The master recording host is the presenter in a conference or lecture, while the slave recording hosts are the listeners. In one example, an interactive video network transmission system may include one master recording host and multiple slave recording hosts. It's important to understand that the distinction between master and slave recording hosts lies only in their roles as presenter and listener, not in their hardware architecture. In some scenarios, the roles of master and slave recording hosts can be interchanged.

[0092] The network quality of a device can be obtained based on at least one of its network parameters, such as bandwidth, latency, and packet loss rate. The main recording host determines its own network quality using at least one of these parameters. The first preset congestion condition can be customized based on actual conditions. If the device's network quality meets the first preset congestion condition, it indicates extremely poor network quality. For example, if the device's bandwidth is less than a first preset bandwidth threshold, it is determined that the device meets the first preset congestion condition; if the device's latency is greater than a first preset latency threshold, it is determined that the device meets the first preset congestion condition; if the device's packet loss rate is less than a first preset packet loss rate threshold, it is determined that the device meets the first preset congestion condition. If the main recording host's network quality meets the first preset congestion condition, it indicates that the main recording host's current network quality is extremely poor. In this case, the main recording host uses the TCP transmission protocol to transmit the video data to be transmitted in image transmission mode.

[0093] In this application embodiment, the image transmission mode refers to transmitting data in image form by capturing images. The specific image format can be customized according to actual conditions, for example, it can be JPEG (Joint Photographic Experts Group) format, etc. The capturing method can also be customized according to actual conditions. In one example, the main recording host can capture images of the video data to be transmitted at preset capturing intervals to obtain the images to be transmitted; the images to be transmitted are then transmitted using the TCP transmission protocol. The preset capturing interval can be a preset time interval or a preset frame interval, etc., all of which are within the protection scope of this application.

[0094] In this embodiment, the main recording host transmits the video data to be transmitted in image transmission mode using the TCP transmission protocol when the current network is extremely poor. Since the TCP transmission protocol has congestion control and flow control mechanisms, by adjusting the TCP sending rate, packet loss and invalid transmission can be avoided, which can effectively improve the quality of network transmission and ensure the normal transmission of the video data to be transmitted under extremely poor network conditions.

[0095] In one possible embodiment, the main recording host is further configured to: obtain the network quality of the slave recording host; when the network quality of the main recording host meets a first preset smooth flow condition and there is a slave recording host whose network quality meets a second preset congestion condition, transmit the video data to be transmitted using the UDP transmission protocol in video stream transmission mode and the TCP transmission protocol in image transmission mode; send a first message to the slave recording host indicating that the video data to be transmitted is being transmitted simultaneously in video stream transmission mode and image transmission mode, wherein the video stream transmission mode indicates that the data is transmitted in the form of a video encoded bitstream through video encoding.

[0096] The recording host is also used to obtain its own network quality; when it receives the first message and its own network quality meets the second preset congestion condition, it receives video data transmitted in the image transmission mode; when it receives the first message and its own network quality does not meet the second preset congestion condition, it receives video data transmitted in the video stream transmission mode.

[0097] In this embodiment, the video transmission mode of the video data includes a video stream transmission mode and an image transmission mode. The video stream transmission mode refers to generating a bitstream from the original video data according to a specified encoding format for transmission. For example, the H.264 encoding protocol can be used to encode the video data into a video stream for transmission.

[0098] The recording host obtains its network quality based on at least one of its network parameters, such as bandwidth, latency, and packet loss rate. The main recording host can obtain the network quality of the slave recording hosts. The second preset congestion condition can be customized according to actual conditions; if the device's network quality meets the second preset congestion condition, it indicates extremely poor network quality. The first preset smooth flow condition can also be customized according to actual conditions; if the device's network quality meets the first preset smooth flow condition, it indicates good or medium network quality. If the main recording host's network quality meets the first preset smooth flow condition, it indicates that the main recording host's current network quality is good or medium; if the slave recording host meets the second preset congestion condition, it indicates that the slave recording host's network quality is extremely poor. In this case, the main recording host uses the UDP transmission protocol to transmit the video data in video stream transmission mode and the TCP transmission protocol to transmit the video data in image transmission mode. If the network quality of the recording host meets the second preset congestion condition, it indicates that the current network quality of the recording host is extremely poor. In this case, video data transmitted in image transmission mode is received. If the network quality of the recording host does not meet the second preset congestion condition, it indicates that the current network quality of the recording host is not extremely poor. In this case, video data transmitted in bitstream transmission mode is received. The first and second preset congestion conditions can be the same or different, and both can be customized according to the actual scenario.

[0099] In this embodiment, when the main recording host has good or medium network quality, and the receiver host has extremely poor network quality, the main recording host transmits data simultaneously in the form of bitstream and images. This ensures that the main recording host can better utilize network bandwidth to transmit video data when the network quality is good or medium, thereby improving the quality of video data transmission. At the same time, the receiver host can also choose the method of receiving video data according to its own network quality, ensuring that network bandwidth is fully utilized to receive better quality video data.

[0100] In one possible embodiment, the main recording host is further configured to: transmit the video data to be transmitted in image transmission mode using the TCP transmission protocol when the network quality of the main recording host meets the second preset smooth condition and there is a slave recording host whose network quality meets the second preset congestion condition; and send a second message to the slave recording host indicating that the video data to be transmitted is transmitted in image transmission mode.

[0101] The recording host is further configured to receive, upon receiving the second message, the video data to be transmitted in image transmission mode.

[0102] The second preset network connectivity condition can be customized according to actual conditions. If the network quality of the device meets the second preset connectivity condition, it indicates that the network quality of the device is poor. If the network quality of the main recording host meets the second preset connectivity condition, it means that the current network quality of the main recording host is poor. In the case of extremely poor network quality of the main recording host, the main recording host uses the TCP transmission protocol to transmit the video data to be transmitted in video and image transmission mode.

[0103] In this embodiment of the application, when the main recording host has poor network quality and the network quality of the host receiver is extremely poor, the video data to be transmitted is transmitted using the TCP transmission protocol in a video and image transmission mode, which can ensure the best sending and receiving quality of the video data under such circumstances.

[0104] In one possible embodiment, the main recording host is further configured to: transmit video data to be transmitted using the UDP transmission protocol in a video stream transmission mode when the network quality of the main recording host meets the second preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition; and send a third message to the slave recording host indicating that the video data to be transmitted is being transmitted in a video stream transmission mode.

[0105] The recording host is further configured to receive video data to be transmitted in video stream transmission mode upon receiving the third message.

[0106] In this embodiment, when the main recording host has poor network quality but the network quality of the data source is not extremely poor, the video data to be transmitted is transmitted using the UDP transmission protocol in video stream transmission mode, which can ensure better transmission quality of the video data.

[0107] In one possible embodiment, the main recording host is further configured to: transmit video data to be transmitted using the UDP transmission protocol in a video stream transmission mode when the network quality of the main recording host meets the first preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition; and send a third message to the slave recording host.

[0108] The recording host is further configured to receive video data to be transmitted in video stream transmission mode upon receiving the third message.

[0109] In this embodiment, when the main recording host has good or medium network quality, and the network quality of the host is not extremely poor, the video data to be transmitted is transmitted using the UDP transmission protocol in video stream transmission mode, which can ensure better transmission quality and efficiency of video data.

[0110] In one possible embodiment, the slave recording host is specifically used to: during the data reception process, obtain the first data packet loss rate of the data packet it finally receives after the Nth retransmission of the data packet; if the first data packet loss rate within a preset time period is greater than a preset first packet loss rate threshold, determine that its own network quality meets a second preset congestion condition; and send a congestion message to the master recording host, wherein N is a preset integer greater than 1.

[0111] The number of retransmissions N, preset duration, first packet loss rate, and preset first packet loss rate threshold can all be customized according to actual conditions. For example, N can be set to 1, 2, or 3, the preset duration can be set to 5 seconds, 10 seconds, or 20 seconds, and the first packet loss rate and preset first packet loss rate threshold can be set to 3%, 5%, or 7%. In one example, if the recording host sends two retransmission commands to the main recording host and waits 300ms, then after obtaining the second retransmission data packet from the main recording host, if the packet loss rate of the data packet finally received from the main recording host is 10% within 10 seconds, which is greater than the packet loss rate threshold of 5%, it is determined that the network quality of the main recording host is extremely poor, and a congestion message is sent to the main recording host.

[0112] The main recording host is also used to determine, upon receiving a congestion message from the slave recording host, that the slave recording host meets a second preset congestion condition.

[0113] In this embodiment of the application, the network quality of the primary recording host and the main recording host is obtained based on the packet loss rate, providing a basis for determining the method of transmitting video data from the primary recording host and the main recording host.

[0114] In one possible embodiment, the main recording host is specifically configured to: during the data reception process, acquire a second data packet loss rate of the data packet it finally receives after the Nth retransmission of the data packet; if the second data packet loss rate within a preset time period is not greater than a preset second packet loss rate threshold, determine that its network quality meets a first preset smooth flow condition; if the second data packet loss rate within a preset time period is not greater than a preset third packet loss rate threshold, and there is a first data packet loss rate greater than the preset second packet loss rate threshold, determine that its network quality meets a second preset smooth flow condition; if the second data packet loss rate within a preset time period is greater than a preset fourth packet loss rate threshold, determine that its network quality meets a first preset congestion condition; wherein, the preset second packet loss rate threshold is less than the preset third packet loss rate threshold, and the preset third packet loss rate threshold is less than the preset fourth packet loss rate threshold.

[0115] The number of retransmissions N, preset duration, first data packet loss rate, second data packet loss rate, preset second packet loss rate threshold, preset third packet loss rate threshold, and preset fourth packet loss rate threshold can all be customized according to actual conditions. For example, N can be set to 1, 2, or 3, the preset duration can be set to 5 seconds, 10 seconds, or 20 seconds, and the first data packet loss rate, second data packet loss rate, preset second packet loss rate threshold, preset third packet loss rate threshold, and preset fourth packet loss rate threshold can be set to 0%, 2%, 5%, etc.

[0116] In one example, during the data reception process, the main recording host obtains the packet loss rate of the data packet it finally receives after waiting 300ms for the second retransmission data packet. If the packet loss rate within 60s is no greater than 1%, it determines that its network quality meets the first preset smooth flow condition; if the packet loss rate within 60s is no greater than 3% and greater than 1%, it determines that its network quality meets the second preset smooth flow condition, where 1% is less than 3%; if the packet loss rate within 10s is greater than the packet loss rate threshold of 10%, it determines that its network quality meets the first preset congestion condition, where 3% is less than 10%.

[0117] In this embodiment, the network quality of the primary recording host and the secondary recording host is obtained based on the packet loss rate, providing a basis for selecting the method of transmitting video data. At the same time, the judgment conditions of network quality can be set according to the actual situation, so that the method of transmitting video data can be better adapted to the network quality at that time, ensuring the normal transmission of video data.

[0118] In one possible embodiment, the main recording host is specifically used to: capture images of the video data to be transmitted at a preset capture interval when the network quality of the main recording host meets a first preset congestion condition, thereby obtaining an image to be transmitted; and transmit the image to be transmitted using the TCP transmission protocol.

[0119] The preset capture interval can be customized according to actual conditions, such as 50 milliseconds, 100 milliseconds, or 200 milliseconds, or every 3 frames, every 5 frames, or every 10 frames. When the main recording host detects that its network quality meets the first preset congestion condition, it switches the video transmission mode from video stream transmission mode to image transmission mode and the video transmission protocol from UDP to TCP. At this time, the video is transmitted in image transmission mode, and the video is composed of multiple consecutive images. According to the preset capture interval, the video data to be transmitted is captured to obtain the image to be transmitted, and then the image to be transmitted is transmitted using the TCP transmission protocol.

[0120] In this embodiment of the application, the use of interval image capture in the image transmission mode can greatly reduce the amount of video data transmitted, thereby reducing the packet loss rate when the network environment is congested and improving the transmission efficiency of media data.

[0121] In one possible embodiment, the interactive video network transmission system further includes: a server;

[0122] The main recording host is specifically used to upload the image to be transmitted to the server via HTTP (Hypertext Transfer Protocol) URL (Uniform Resource Locator), and after the image to be transmitted is uploaded, it sends an upload completion message to the slave recording host.

[0123] The recording host is specifically used to download and play the image to be transmitted from the server according to the HTTP URL after receiving the upload completion message.

[0124] After receiving the upload completion message, the recording host downloads the image to be transmitted from the server according to the HTTP URL of the image to be transmitted. In one example, after the image is downloaded, it is sent to a DSP (Digital Signal Processor) for decoding into YUV data, and then the YUV data is sent to a display device for display. Simultaneously, the YUV data can be re-encoded into an H.264 bitstream and encapsulated using RTP (Real-time Transport Protocol) for remote preview display. YUV is an image data format. "Y" represents luminance, or grayscale value, and "U" and "V" represent chrominance.

[0125] In this embodiment of the application, the image to be transmitted is uploaded or downloaded via HTTP URL, which provides a transmission method for the image to be transmitted and ensures the normal transmission of the image to be transmitted.

[0126] When network quality changes, the main recording host can switch the video data transmission method based on its own network quality and that of the slave recording hosts. In one example, when the main recording host's network quality changes from very poor to very poor, and the slave recording host's network quality does not meet the very poor standard, the system will switch from using TCP in image transmission mode to using UDP in bitstream transmission mode. This ensures full utilization of network bandwidth throughout the interactive process, guarantees normal video transmission, and optimizes the interactive experience.

[0127] The following example illustrates the application of an interactive video network transmission system in interactive teaching. (See also...) Figure 2 The interactive video network transmission system includes: a main recording host, slave recording hosts, a server, client users, a maintenance and support module, and terminals at classroom teaching points.

[0128] The main recording and broadcasting host is located in the main classroom, and the secondary recording and broadcasting hosts are located in the secondary classrooms. The main classroom is used for teaching and instruction and includes the main recording and broadcasting host, audio pickup equipment, amplification equipment, video display equipment, all-in-one computers, courseware playback computers, audio processing equipment, video capture equipment, etc.

[0129] The sound pickup device can be an array microphone, a microphone, a hanging microphone, etc., used to collect on-site sound and send the collected sound information to the main recording host.

[0130] Amplification equipment can be speakers, used to amplify the audio information received by the main recording host.

[0131] The video display device can be a monitor, used to display the video information received by the main recording host.

[0132] The all-in-one machine is used for information exchange with the main recording host.

[0133] The computer used for playing courseware is used to transmit the teaching courseware screen information from the main classroom to the main recording host.

[0134] The audio processing device can be an audio host, used to process the speaker's audio information and send it to the main recording host. The main recording host can use the UDP transport protocol to transmit the received audio data. Since the main classroom is used for teaching and lecturing, a dedicated audio host is needed to process the speaker's audio information in order to ensure that good audio information can be received from the classroom.

[0135] Video capture devices can be various cameras used to capture video information on site and transmit the video information to the main recording and broadcasting host.

[0136] The functions of the main recording host can be found in the interactive video network transmission system described above, and will not be repeated here.

[0137] The classroom is used for listening to lectures. Compared with the main classroom, it does not require a computer for playing courseware and audio processing equipment for teaching. It includes a recording host, sound pickup equipment, sound amplification equipment, video display equipment, all-in-one machine, video capture equipment, etc.

[0138] The functions of the sound pickup equipment, amplification equipment, video display equipment, all-in-one machine, and video acquisition equipment are the same as those of the main classroom mentioned above. The functions of the recording host can be found in the interactive video network transmission system mentioned above, and will not be repeated here.

[0139] The server is used for information exchange between various terminals.

[0140] Client users include mobile and PC clients, supporting interaction and access via both PC and mobile devices.

[0141] The maintenance support module is used to maintain network communication between the main classroom, the secondary classrooms, and the server.

[0142] The classroom teaching point terminal is a simpler learning scenario, which includes sound pickup equipment, amplification equipment, video display equipment, and teaching point terminal.

[0143] Among them, the teaching point terminal can be a relatively inexpensive audio and video processing device with weak processing power, which can only be used in the classroom. The teaching point terminal is connected to the sound pickup device, the sound amplification device, and the video display device to complete the acquisition and display of audio and video information.

[0144] In one example, to enhance the functionality of the interactive video network transmission system, the system may also provide media services, conference control services, etc. These services can be implemented through the server or through other devices, and are all within the scope of protection of this application.

[0145] In one example, see Figure 3 The system assists the main lecturer in the main classroom to complete the interactive teaching process through teaching aid application software. The teaching aid application software has two core functions during recorded lectures: screen sharing and desktop sharing.

[0146] Screen sharing allows students in the main classroom and secondary classrooms to write on the same screen. Operations performed on the main classroom screen are simultaneously displayed on the display devices in other secondary classrooms, including the courseware screen in the main classroom.

[0147] Desktop sharing allows the main classroom to share the computer's presentation slides in real time with all other classrooms. In this mode, those classrooms can only view the slides and cannot interact with them. Desktop sharing is suitable for scenarios where presentation resources cannot be shared with other classrooms via teaching aids during the lesson.

[0148] Specifically, the main classroom and the secondary classrooms can synchronize the transmission of courseware through their respective teaching aids. It can also be used in the process of recording and broadcasting lectures, where the main classroom sends the courseware screen to the server through the main recording host, and the secondary classroom obtains the courseware information through the secondary recording host.

[0149] The main classroom and the secondary classrooms can complete teaching interactions through their respective teaching aids, such as taking attendance and asking questions, and can also share desktops between the main classroom and the secondary classrooms.

[0150] In one example, see Figure 4In a scenario without teaching aids, the main classroom's courseware sending interaction process is as follows: The lecturer in the main classroom initiates the interaction by notifying the server through the main recording host in the main classroom. Users in the secondary classroom join the interaction by controlling the recording host through the interactive video service platform. By default, the main classroom is notified that there are no teaching aids and that the courseware stream needs to be obtained. After receiving the request to obtain the courseware stream, the main classroom uploads the courseware stream to the server and notifies the secondary classroom that the stream is currently being sent. The secondary classroom then receives the courseware stream from the server.

[0151] In scenarios with teaching support applications, the main classroom's courseware sending interaction process is as follows: The user in the secondary classroom initiates the teaching support application, connects to the secondary classroom's recording host, and notifies the secondary recording host that desktop sharing is not enabled and courseware is not being retrieved. The secondary classroom then notifies the main classroom that it does not need to send the courseware stream. The main classroom stops sending the courseware stream and notifies the secondary classroom to stop sending it as well. The user in the main classroom initiates desktop sharing through the teaching support application and notifies the secondary classroom's teaching support application to start desktop sharing. After accepting desktop sharing, the user in the secondary classroom notifies the main classroom that desktop sharing is enabled and that courseware is needed. The main classroom uploads the courseware stream to the server, and the secondary classroom receives the courseware stream from the server and displays it on the shared desktop. In the main classroom, the user disables desktop sharing via the teaching aid application and notifies the teaching aid application in the secondary classroom to end desktop sharing. The teaching aid in the secondary classroom stops desktop sharing and notifies the secondary classroom that desktop sharing is not enabled and that courseware is not being retrieved. The secondary classroom then notifies the main classroom that it does not need to send courseware streams. The main classroom then stops sending courseware streams and notifies the secondary classroom to stop sending courseware streams.

[0152] In one possible embodiment, the interactive video network transmission system enables the transmission of courseware images between the main classroom and the secondary classrooms based on network conditions.

[0153] In one example, see Figure 5 , Figure 5 The flowchart for sending courseware images from the main classroom to the secondary classroom, based on network conditions, is as follows: Under conditions of good or medium network quality in the main classroom, if the secondary classroom's network quality is extremely poor, the main classroom instructs the secondary classroom to send only the courseware stream; if the secondary classroom's network quality is not extremely poor, the main classroom instructs the secondary classroom to send both the courseware stream and courseware images. Under conditions of poor network quality in the main classroom, if the secondary classroom's network quality is extremely poor, the main classroom instructs the secondary classroom to send only the courseware stream; if the secondary classroom's network quality is not extremely poor, the main classroom instructs the secondary classroom to send only the courseware images. The receiving end receives the best quality video data based on its own network quality.

[0154] Figure 6When the main classroom does not need to send courseware images to the secondary classroom, the sending strategy is as follows: The main classroom notifies the secondary classroom that it will not send courseware streams and images at this time.

[0155] Figure 7 The receiving strategy when the classroom needs to receive courseware is as follows: The mode in which the classroom obtains video data from the server depends on the mode in which the main classroom sends video data to the server. In one example, when the main classroom transmits video data to the server in bitstream mode, the classroom obtains bitstream data from the server. When the main classroom transmits video data to the server in image mode, the classroom obtains image data from the server.

[0156] Figure 8 The receiving strategy is as follows: when the classroom does not need to receive the courseware screen, the classroom does not need to obtain the courseware screen from the server.

[0157] This application also provides an interactive video network transmission method, applied to a main recording host, see [link to relevant documentation]. Figure 9 The method includes:

[0158] In step S11, the network quality of the main recording host is obtained.

[0159] In step S12, if the network quality of the main recording host meets the first preset congestion condition, the video data to be transmitted is transmitted in image transmission mode using the TCP transmission protocol. The image transmission mode means transmitting data in the form of images by capturing pictures.

[0160] In one possible implementation, the method further includes:

[0161] Obtain network quality information from the recording host;

[0162] When the network quality of the main recording host meets the first preset smooth flow condition and there is a slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted using the UDP transmission protocol in video stream transmission mode and the TCP transmission protocol in image transmission mode. The video stream transmission mode means transmitting data in the form of a video encoded bitstream through video encoding. A first message indicating that the video data to be transmitted is being transmitted simultaneously in both video stream transmission mode and image transmission mode is sent to the slave recording host.

[0163] In one possible implementation, the method further includes:

[0164] When the network quality of the main recording host meets the second preset smooth condition and there is a slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted in image transmission mode using the TCP transmission protocol; a second message indicating that the video data to be transmitted is transmitted in image transmission mode is sent to the slave recording host.

[0165] In one possible implementation, the method further includes:

[0166] When the network quality of the main recording host meets the second preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted in video stream transmission mode using the UDP transmission protocol; a third message indicating that the video data to be transmitted is transmitted in video stream transmission mode is sent to the slave recording host.

[0167] In one possible implementation, the method further includes:

[0168] When the network quality of the main recording host meets the first preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted using the UDP transmission protocol in video stream transmission mode; and a third message is sent to the slave recording host.

[0169] In one possible implementation, obtaining the network quality from the recording host includes:

[0170] Upon receiving a congestion message from the recording host, it is determined that the recording host meets the second preset congestion condition.

[0171] In one possible implementation, obtaining the network quality of the main recording host includes:

[0172] During the data reception process of the main recording host, a second data packet loss rate is obtained for the data packet finally received by the main recording host after the Nth retransmission of the data packet, where N is a preset integer greater than 1; if the second data packet loss rate within a preset time period is not greater than a preset second packet loss rate threshold, it is determined that the network quality of the main recording host meets a first preset smooth flow condition; if the second data packet loss rate within a preset time period is not greater than a preset third packet loss rate threshold, and there is a first data packet loss rate greater than the preset second packet loss rate threshold, it is determined that the network quality of the main recording host meets a second preset smooth flow condition; wherein, the preset second packet loss rate threshold is less than the preset third packet loss rate threshold;

[0173] If the second data packet loss rate within a preset time period is greater than the preset fourth packet loss rate threshold, it is determined that the network quality of the main recording host meets the first preset congestion condition; wherein, the preset third packet loss rate threshold is less than the preset fourth packet loss rate threshold.

[0174] In one possible implementation, the step of transmitting the video data to be transmitted using the TCP transmission protocol in image transmission mode, when the network quality of the main recording host meets a first preset congestion condition, includes:

[0175] When the network quality of the main recording host meets the first preset congestion condition, the video data to be transmitted is captured at preset capture intervals to obtain the image to be transmitted; the image to be transmitted is then transmitted using the TCP transmission protocol.

[0176] In one possible implementation, transmitting the image to be transmitted using the TCP transport protocol includes:

[0177] The image to be transmitted is uploaded to the server via an HTTP URL; after the image to be transmitted is uploaded, an upload completion message is sent to the recording host.

[0178] This application also provides an interactive video network transmission method, applied to a recording and broadcasting host, the method comprising:

[0179] When the network quality of the main recording host meets the first preset congestion condition, video data transmitted using the TCP transmission protocol in image transmission mode is received, wherein the image transmission mode means that the data is transmitted in the form of an image by capturing a screenshot.

[0180] In one possible implementation, the method further includes:

[0181] The system acquires the network quality of the recording host; upon receiving a first message and the network quality of the recording host meets a second preset congestion condition, it receives video data transmitted in image transmission mode; upon receiving the first message and the network quality of the recording host does not meet the second preset congestion condition, it receives video data transmitted in video stream transmission mode, wherein the video stream transmission mode indicates that data is transmitted in the form of a video encoded stream through video encoding.

[0182] In one possible implementation, the method further includes:

[0183] Upon receiving the second message, the video data to be transmitted is received in image transmission mode.

[0184] In one possible implementation, the method further includes:

[0185] Upon receiving a third message, the system receives the video data to be transmitted in video stream transmission mode.

[0186] In one possible implementation, obtaining the network quality from the recording host includes:

[0187] During the data reception process, the first data packet loss rate of the data packet finally received from the recording host after the Nth retransmission of the data packet is obtained; if the first data packet loss rate within a preset time period is greater than the preset first packet loss rate threshold, it is determined that the network quality of the recording host meets the second preset congestion condition; a congestion message is sent to the main recording host, wherein N is a preset integer greater than 1.

[0188] In one possible implementation, receiving video data transmitted in image transmission mode includes:

[0189] After receiving the upload completion message from the main recording host, the image to be transmitted is downloaded from the server and played according to the HTTP URL.

[0190] The communication bus mentioned in the recording host can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in the diagram, but this does not mean that there is only one bus or one type of bus.

[0191] The communication interface is used for communication between the aforementioned electronic devices and other devices.

[0192] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.

[0193] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0194] In another embodiment provided in this application, a computer-readable storage medium is also provided, which stores a computer program that, when executed by a processor, implements the steps of any of the above-described interactive video network transmission methods.

[0195] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (SSD)).

[0196] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0197] The various embodiments in this specification are described in a related manner, and the same or similar parts between the various embodiments can be referred to each other.

[0198] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application are included within the scope of protection of this application.

Claims

1. An interactive video network transmission system, characterized in that, The system includes: a main recording host and at least one slave recording host; The main recording host is used to obtain its own network quality; when the network quality of the main recording host meets the first preset congestion condition, the video data to be transmitted is transmitted using the TCP transmission protocol in image transmission mode, wherein the image transmission mode means transmitting data in the form of images by capturing images. The slave recording host is used to receive video data transmitted in image transmission mode when the network quality of the master recording host meets the first preset congestion condition. The main recording host is further configured to: obtain the network quality of the slave recording host; when the network quality of the main recording host meets a first preset smooth flow condition and there is a slave recording host whose network quality meets a second preset congestion condition, transmit the video data to be transmitted using the UDP transmission protocol in video stream transmission mode and the TCP transmission protocol in image transmission mode; send a first message to the slave recording host indicating that the video data to be transmitted is being transmitted simultaneously in video stream transmission mode and image transmission mode, wherein the video stream transmission mode indicates that the data is transmitted in video encoded bitstream form through video encoding; The recording host is also used to obtain its own network quality; when it receives the first message and its own network quality meets the second preset congestion condition, it receives video data transmitted in the image transmission mode; when it receives the first message and its own network quality does not meet the second preset congestion condition, it receives video data transmitted in the video stream transmission mode.

2. The system according to claim 1, characterized in that, The main recording host is also used to: transmit video data to be transmitted in image transmission mode using TCP transmission protocol when the network quality of the main recording host meets the second preset smooth condition and there is a slave recording host whose network quality meets the second preset congestion condition. Send a second message to the recording host indicating that the video data to be transmitted is being transmitted in image transmission mode; The recording host is further configured to receive, upon receiving the second message, the video data to be transmitted in image transmission mode.

3. The system according to claim 1, characterized in that, The main recording host is also used to: transmit video data to be transmitted in video stream transmission mode using UDP transmission protocol when the network quality of the main recording host meets the second preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition. Send a third message to the recording host indicating that the video data to be transmitted is being transmitted in a video stream transmission mode; The recording host is further configured to receive video data to be transmitted in video stream transmission mode upon receiving the third message.

4. The system according to claim 1, characterized in that, The main recording host is also used to: transmit video data to be transmitted in video stream transmission mode using UDP transmission protocol when the network quality of the main recording host meets the first preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition. Send a third message to the recording host; The recording host is further configured to receive video data to be transmitted in video stream transmission mode upon receiving the third message.

5. The system according to claim 1, characterized in that, The recording host is specifically used to: during the data reception process, obtain the first data packet loss rate of the data packet it finally receives after the Nth retransmission of the data packet; if the first data packet loss rate within a preset time period is greater than the preset first packet loss rate threshold, determine that its own network quality meets the second preset congestion condition. Send a congestion message to the main recording host, wherein N is a pre-set integer greater than 1; The main recording host is also used to determine, upon receiving a congestion message from the slave recording host, that the slave recording host meets a second preset congestion condition.

6. The system according to claim 4, characterized in that, The main recording host is specifically used to: during the data reception process, obtain the second data packet loss rate of the data packet it finally receives after the Nth retransmission of the data packet; if the second data packet loss rate within a preset time period is not greater than the preset second packet loss rate threshold, determine that its own network quality meets the first preset smooth condition. If the second data packet loss rate within the preset time period is not greater than the preset third packet loss rate threshold, and there is a first data packet loss rate greater than the preset second packet loss rate threshold, it is determined that its network quality meets the second preset smooth condition. If the second data packet loss rate within a preset time period is greater than the preset fourth packet loss rate threshold, it is determined that the network quality meets the first preset congestion condition; wherein, the preset second packet loss rate threshold is less than the preset third packet loss rate threshold, and the preset third packet loss rate threshold is less than the preset fourth packet loss rate threshold.

7. The system according to claim 1, characterized in that, The main recording host is specifically used for: when the network quality of the main recording host meets the first preset congestion condition, capturing images of the video data to be transmitted at preset capture intervals to obtain images to be transmitted; and transmitting the images to be transmitted using the TCP transmission protocol.

8. The system according to claim 7, characterized in that, The interactive video network transmission system also includes: a server; The main recording host is specifically used to upload the image to be transmitted to the server via an HTTP URL, and after the image to be transmitted is uploaded, to send an upload completion message of the image to be transmitted to the slave recording host. The recording host is specifically used to download and play the image to be transmitted from the server according to the HTTP URL after receiving the upload completion message.

9. An interactive video network transmission method, characterized in that, Applied to a main recording host, the method includes: Obtain the network quality of the main recording host; When the network quality of the main recording host meets the first preset congestion condition, the video data to be transmitted is transmitted in image transmission mode using the TCP transmission protocol, wherein the image transmission mode means transmitting data in the form of images by capturing images. The method further includes: Obtain network quality information from the recording host; When the network quality of the main recording host meets the first preset smooth condition and there is a slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted in video stream transmission mode using the UDP transmission protocol and in image transmission mode using the TCP transmission protocol. The video stream transmission mode means that the data is transmitted in the form of video encoded bitstream through video encoding. A first message is sent to the slave recording host indicating that the video data to be transmitted is being transmitted simultaneously in both video stream transmission mode and image transmission mode, so that the slave recording host receives the video data transmitted in the image transmission mode if its network quality meets the second preset congestion condition, and receives the video data transmitted in the video stream transmission mode if its network quality does not meet the second preset congestion condition.

10. The method according to claim 9, characterized in that, The method further includes: When the network quality of the main recording host meets the second preset smooth condition and there is a slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted in image transmission mode using the TCP transmission protocol. A second message is sent from the recording host indicating that the video data to be transmitted is being transmitted in image transmission mode.

11. The method according to claim 9, characterized in that, The method further includes: When the network quality of the main recording host meets the second preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted in video stream transmission mode using the UDP transmission protocol. A third message is sent from the recording host indicating that the video data to be transmitted is being transmitted in video stream transmission mode.

12. The method according to claim 9, characterized in that, The method further includes: When the network quality of the main recording host meets the first preset smooth condition and there is no slave recording host whose network quality meets the second preset congestion condition, the video data to be transmitted is transmitted in video stream transmission mode using the UDP transmission protocol. Send a third message to the recording host.

13. The method according to claim 9, characterized in that, The acquisition of network quality from the recording host includes: Upon receiving a congestion message from the recording host, it is determined that the recording host meets the second preset congestion condition.

14. The method according to claim 12, characterized in that, The process of obtaining the network quality of the main recording host includes: During the process of receiving data by the main recording host, the second data packet loss rate of the data packet finally received by the main recording host after the Nth retransmission of the data packet is obtained, wherein N is a pre-set integer greater than 1; If the second data packet loss rate within the preset time period is not greater than the preset second packet loss rate threshold, it is determined that the network quality of the main recording host meets the first preset smooth condition. If the second data packet loss rate within a preset time period is not greater than the preset third packet loss rate threshold, and there is a first data packet loss rate greater than the preset second packet loss rate threshold, the network quality of the main recording host is determined to meet the second preset smooth condition; wherein, the preset second packet loss rate threshold is less than the preset third packet loss rate threshold. If the second data packet loss rate within a preset time period is greater than the preset fourth packet loss rate threshold, it is determined that the network quality of the main recording host meets the first preset congestion condition; wherein, the preset third packet loss rate threshold is less than the preset fourth packet loss rate threshold.

15. The method according to claim 9, characterized in that, When the network quality of the main recording host meets the first preset congestion condition, the video data to be transmitted is transmitted using the TCP transmission protocol in image transmission mode, including: When the network quality of the main recording host meets the first preset congestion condition, the video data to be transmitted is captured at a preset capture interval to obtain the image to be transmitted. The image to be transmitted is transmitted using the TCP transport protocol.

16. The method according to claim 15, characterized in that, The process of transmitting the image to be transmitted using the TCP transport protocol includes: The image to be transmitted is uploaded to the server via an HTTP URL. After the image to be transmitted is uploaded, an upload completion message for the image to be transmitted is sent to the recording host.

17. An interactive video network transmission method, characterized in that, Applied to a recording host, the method includes: When the network quality of the main recording host meets the first preset congestion condition, video data transmitted using the TCP transmission protocol in image transmission mode is received, wherein the image transmission mode means that the data is transmitted in the form of images by capturing images. The method further includes: Obtain the network quality from the recording host; Upon receiving the first message and provided that the network quality of the recording host meets the second preset congestion condition, video data transmitted in image transmission mode is received. Upon receiving the first message and when the network quality of the recording host does not meet the second preset congestion condition, video data transmitted in a video stream transmission mode is received, wherein the video stream transmission mode means that data is transmitted in the form of a video encoded stream through video encoding. The first message is: when the network quality of the main recording host meets the first preset smooth condition and there is a slave recording host whose network quality meets the second preset congestion condition, after the main recording host transmits the video data to be transmitted using the UDP transmission protocol in video stream transmission mode and the TCP transmission protocol in image transmission mode, the main recording host sends a message to the slave recording host indicating that it is simultaneously transmitting the video data to be transmitted in both video stream transmission mode and image transmission mode.

18. The method according to claim 17, characterized in that, The method further includes: Upon receiving the second message, the video data to be transmitted is received in image transmission mode.

19. The method according to claim 17, characterized in that, The method further includes: Upon receiving a third message, the system receives the video data to be transmitted in video stream transmission mode.

20. The method according to claim 17, characterized in that, The process of obtaining the network quality from the recording host includes: During the data reception process, the first data packet loss rate of the data packet finally received from the recording host after the Nth retransmission of the data packet is obtained; If the first data packet loss rate within the preset time period is greater than the preset first packet loss rate threshold, it is determined that the network quality of the recording host meets the second preset congestion condition. A congestion message is sent to the main recording host, wherein N is a pre-set integer greater than 1.

21. The method according to claim 17, characterized in that, The receiving of video data transmitted in image transmission mode includes: After receiving the upload completion message from the main recording host, the image to be transmitted is downloaded from the server and played using the HTTP URL.

22. A recording and playback host, characterized in that, It includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; Memory, used to store computer programs; When a processor executes a program stored in memory, it implements the steps of the interactive video network transmission method according to any one of claims 9-21.

23. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the interactive video network transmission method according to any one of claims 9-21.

Images