Audio-video streaming processing device and audio-video streaming data processing method

Abstract

The invention discloses an audio-video streaming processing device and an audio-video streaming data processing method. The audio-video streaming processing device comprises a first concentrator, a switching unit, a first main control unit and a second main control unit. The first master control unit transmits data according to a first communication protocol and a second communication protocol, and the transmission bandwidth of the first communication protocol is larger than that of the second communication protocol. The second master control unit performs data transmission according to a second communication protocol. When the first video stream and the second video stream are both transmitted according to the second communication protocol, the switching unit enables the second video stream to be transmitted to the second main control unit.

Description

TECHNICAL FIELD

[0001] The present application relates to a signal processing device and a signal processing method, in particular to a video and audio stream processing device and a video and audio stream data processing method. BACKGROUND

[0002] In order to provide a better viewing experience for the viewer, it is common to use a camera, a microphone and other stream signal input devices to record stream data for live broadcast.

[0003] Generally, the stream signal input device is used to transmit the recorded stream data to a host device (such as a notebook computer, a desktop computer, a tablet computer, etc.), and the host device can edit the stream data and then transmit the stream data to the Internet for real-time playing.

[0004] However, when multiple stream signal input devices simultaneously transmit stream data using the same communication protocol with low bandwidth, the stream data of the multiple stream signal input devices will have low resolution due to the limited available bandwidth during transmission, resulting in the host device being unable to provide high-quality stream data to the Internet. For example, if a conventional stream signal processing (or relay) device receives two video streams transmitted using the second generation universal serial bus (USB 2.0) communication protocol, even if the internal communication protocol control unit of the device can support the third generation universal serial bus (USB 3.0), the output video stream will still not meet the highest resolution supported by the USB 2.0 communication protocol due to the limited USB 2.0 channel pins. In this case, the resolution of the output video stream will be lower than that of the input video stream, and the user will not be able to enjoy the best viewing experience.

[0005] Therefore, how to provide a device and a data processing method that can support high-quality stream data transmission is one of the problems to be solved in the field. SUMMARY

[0006] To solve the above technical problems, the present application provides a video and audio stream processing device and a video and audio stream data processing method. By switching channels, the device can use different host units to transmit multiple video and audio streams when the transmission bandwidth is insufficient. In this way, the multiple video and audio streams with insufficient transmission bandwidth can be transmitted through different host units, avoiding the situation where the multiple video and audio streams simultaneously occupy the transmission bandwidth of the same host unit when the transmission bandwidth is insufficient, resulting in a decrease in resolution. Thus, the purpose of supporting high-quality stream data transmission is achieved.

[0007] To achieve the above object, the present application provides a video and audio stream processing device, which comprises a first hub, a switching unit, a first master control unit and a second master control unit. The first hub receives a first video stream. The switching unit is electrically connected with the first hub and receives a second video stream. The first master control unit is electrically connected with the first hub and can transmit data by using a first communication protocol and a second communication protocol, wherein the transmission bandwidth of the first communication protocol is larger than that of the second communication protocol. The second master control unit is electrically connected with the switching unit and transmits data by using the second communication protocol. When the first video stream and the second video stream are transmitted by using the second communication protocol, the switching unit transmits the second video stream to the second master control unit.

[0008] To achieve the above object, the present application provides a video and audio stream processing device, which comprises a first hub, a switching unit, a first master control unit and a second master control unit. The first hub receives a first video stream. The switching unit is electrically connected with the first hub and receives a second video stream. The first master control unit is electrically connected with the first hub and can transmit data by using a first communication protocol and a second communication protocol, wherein the transmission bandwidth of the first communication protocol is larger than that of the second communication protocol. The second master control unit is electrically connected with the switching unit and transmits data by using the second communication protocol. When the first video stream and the second video stream are transmitted by using the second communication protocol, the switching unit transmits the second video stream to the second master control unit.

[0009] Based on the above, the video and audio stream processing device and the video and audio stream processing method of the present application can transmit the video and audio streams transmitted by using the same second communication protocol by using different master control units, so that the video and audio streams transmitted by using the same second communication protocol can be transmitted by using the transmission bandwidth of different master control units, thereby avoiding the situation that the transmission bandwidth of the second communication protocol of a master control unit is occupied by multiple video and audio streams simultaneously, and the resolution of the video and audio streams is reduced, and the purpose of supporting high-quality stream data transmission is achieved. BRIEF DESCRIPTION OF DRAWINGS

[0010] The accompanying drawings, which are included to provide a further understanding of the present application and constitute a part of this application, illustrate embodiments of the present application and together with the description serve to explain the present application. In the drawings:

[0011] Figure 1 FIG. 1 is a schematic diagram of an embodiment of the video and audio stream processing device according to the present application.

[0012] Figure 2 FIG. 2 is a schematic diagram of an embodiment of a video stream processing device according to an embodiment of the present application.

[0013] Figure 3 FIG. 3 is a schematic diagram of a flow of a method of processing video stream data according to an embodiment of the present application. DETAILED DESCRIPTION

[0014] The technical solutions in the embodiments of the present application will be clearly and completely described with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0015] Reference is made to Figure 1 , Figure 1 FIG. 1 is a schematic diagram of an embodiment of a video stream processing device according to the present application. The video stream processing device 1 is electrically connected with a first video device 2 and a second video device 3. The video stream processing device 1 is configured to receive a first video stream S1 from the first video device 2 and a second video stream S2 from the second video device 3, and transmit the first video stream S1 and the second video stream S2 to an external electronic device. The first video device 2 and the second video device 3 are, for example, network cameras, but the present application is not limited thereto. The first video stream S1 and the second video stream S2 can be video streams conforming to a first communication protocol or a second communication protocol according to the specifications of the first video device 2 and the second video device 3. The first video stream S1 and the second video stream S2 are high-resolution video streams. For example, the first video stream S1 and the second video stream S2 are high-resolution video streams of 4K image frames or video streams of image frames larger than 1080P. The first communication protocol and the second communication protocol are the same communication standard, the transmission bandwidth of the first communication protocol is larger than that of the second communication protocol, and the first communication protocol is downward compatible with the second communication protocol. For example, the first communication protocol is the third generation universal serial bus communication protocol, and the second communication protocol is the second generation universal serial bus communication protocol, but the present application is not limited thereto. The external electronic device is, for example, an electronic device such as a notebook computer, a tablet computer, or a desktop computer.

[0016] The audio and video stream processing device 1 comprises a first input terminal 10, a second input terminal 20, a first hub 30, a switching unit 40, a first master control unit 50, a processing module 60 and a second master control unit 70. The first input terminal 10 is electrically connected with the first video device 2 for receiving the first video stream S1 from the first video device 2. The second input terminal 20 is electrically connected with the second video device 3 for receiving the second video stream S2 from the second video device 3. In the embodiment, the first input terminal 10 and the second input terminal 20 are communication interfaces which support both the first communication protocol and the second communication protocol. In the embodiment of the universal serial bus communication protocol, the first input terminal 10 and the second input terminal 20 can be the third generation universal serial bus communication protocol connector which supports both the third generation universal serial bus communication protocol and the second generation universal serial bus communication protocol. The first hub 30 is electrically connected with the first input terminal 10 and the switching unit 40 for receiving the first video stream S1 from the first input terminal 10 and the second video stream S2 from the switching unit 40. The switching unit 40 is electrically connected with the second input terminal 20 and the first hub 30. The switching unit 40 receives the second video stream S2 from the second input terminal 20. The switching unit 40 optionally transmits the second video stream S2 to the first hub 30 or the second master control unit 70. The switching unit 40 can be a multiplexer, but the present application is not limited thereto. The first master control unit 50 is electrically connected with the first hub 30 and the processing module 60. The first master control unit 50 receives the first video stream S1 and the second video stream S2 from the first hub 30 and processes the received video streams and then transmits the video streams to the connected external electronic device. The first master control unit 50 can transmit data in the first communication protocol and the second communication protocol. The first master control unit 50 is, for example, a communication protocol control chip which has the first communication protocol and is downward compatible with the second communication protocol. The second master control unit 70 can transmit data in the second communication protocol. The second master control unit 70 is, for example, a communication protocol control chip which has the second communication protocol. The processing module 60 is electrically connected with the first master control unit 50 and the switching unit 40. The processing module 60 reads the communication protocol information of the first video stream S1 and the second video stream S2 from the first master control unit 50 to confirm the communication protocols used by the first video stream S1 and the second video stream S2 and to decide whether to control the switching unit 40 to switch so that the second video stream S2 is transmitted to the first master control unit 50 or the second master control unit 70. In some embodiments, the processing module 60 and the first master control unit 50 can be implemented in a single communication protocol control chip, and the processing module 60, the first master control unit 50 and the second master control unit 70 can be separate or any two of them can be combined or all of them can be integrated in the same integrated circuit chip. The skilled person can design according to the actual needs, but the present application is not limited by the different embodiments described above.

[0017] When the processing module 60 determines that both the first video stream S1 and the second video stream S2 are transmitted by the second communication protocol, the processing module 60 controls the switching unit 40 to switch so that the second input terminal 20 is not connected to the first hub 30 and is connected to the second master unit 70 for communication, and the switching unit 40 transmits the second video stream S2 to the second master unit 70. For example, the processing module 60 generates a switching unit control signal based on the determination result, and the switching unit 40 switches based on the received switching unit control signal. When the processing module 60 determines that the first video stream S1 and the second video stream S2 are not both transmitted by the second communication protocol (for example, both the first video stream S1 and the second video stream S2 are transmitted by the first communication protocol, or one of the first video stream S1 and the second video stream S2 is transmitted by the first communication protocol and the other is transmitted by the second communication protocol), the processing module 60 controls the switching unit 40 to switch so that the second input terminal 20 is connected to the first hub 30 for communication and is not connected to the second master unit 70 for communication, and the switching unit 40 transmits the second video stream S2 to the first master unit 50 through the first hub 30. In this embodiment, since the first video stream S1 and the second video stream S2 are not both transmitted by the second communication protocol, the situation of two video streams occupying the transmission bandwidth of the second communication protocol of the same master unit at the same time does not occur. In addition, when both the first video stream S1 and the second video stream S2 are transmitted by the first communication protocol, since the first communication protocol has sufficient bandwidth, the first video stream S1 and the second video stream S2 can be transmitted simultaneously without reducing the resolution of the video stream, so the first video stream S1 and the second video stream S2 can be transmitted to the first master unit 50 simultaneously for subsequent processing, achieving the purpose of supporting high-quality stream data transmission. When one of the first video stream S1 and the second video stream S2 is transmitted by the second communication protocol, since only one video stream uses the second communication protocol, the transmission bandwidth of the second communication protocol is not shared by other video streams, so the first master unit 50 can receive different video streams by the first communication protocol and the second communication protocol respectively without reducing the resolution of the video stream, achieving the purpose of supporting high-quality stream data transmission.

[0018] Therefore, when the high resolution first video stream S1 and the second video stream S2 are transmitted by the second communication protocol, the first video stream S1 and the second video stream S2 are transmitted to the external electronic device through the transmission channel of the first host unit 50 and the second host unit 70 respectively. That is, the first video stream S1 and the second video stream S2 do not need to share the transmission bandwidth of the second communication protocol of the single host unit for the transmission of the video stream, effectively avoiding the situation that the resolution of the video stream is reduced due to the sharing of the transmission bandwidth of the second communication protocol of the single host unit, thereby achieving the purpose of supporting high-quality stream data transmission.

[0019] Please refer to Figure 2 , Figure 2 Another embodiment of the video stream processing device of the present application is shown in the figure. Figure 2 And Figure 1 The difference between the two is that Figure 2 The video stream processing device 1 further comprises a third input terminal 80 and a second hub 90. The third input terminal 80 is electrically connected to the audio device 4 to receive the audio signal S3 from the audio device 4. The audio device 4 is, for example, a microphone device, and the present application is not limited thereto. In this embodiment, the third input terminal 80 is a communication interface supporting the second communication protocol specification. The third input terminal 80 can be a second generation universal serial bus communication protocol connector, which supports the second generation universal serial bus communication protocol. The second hub 90 is electrically connected to the third input terminal 80, the switching unit 40 and the second host unit 70. The second hub 90 receives the audio signal S3 from the third input terminal 80 and the second video stream S2 from the switching unit 40, and transmits the audio signal S3 and the second video stream S2 to the second host unit 70. In this embodiment, the bandwidth occupied by the audio signal S3 is very small, so the audio signal S3 can share the bandwidth of the second communication protocol of the single host unit with the second video stream S2, and the video stream sharing the bandwidth of the second communication protocol with the audio signal S3 does not reduce its resolution. Therefore, when the processing module 60 determines that the first video stream S1 and the second video stream S2 are transmitted by the second communication protocol, the processing module 60 controls the switching unit 40 to switch, and the switching unit 40 transmits the second video stream S2 to the second host unit 70 through the second hub 90. Therefore, the first video stream S1 and the second video stream S2 are transmitted to the external electronic device through the transmission channel of the first host unit 50 and the second host unit 70 respectively, avoiding the situation that the resolution of the video stream is reduced due to the sharing of the transmission bandwidth of the second communication protocol of the single host unit by the first video stream S1 and the second video stream S2, thereby achieving the purpose of supporting high-quality stream data transmission.

[0020] Please refer toFigure 1 、 Figure 2 and Figure 3 , Figure 3 Fig. 1 is a schematic diagram of a video stream processing device according to an embodiment of the present application;

[0021] Step S100: receiving a first video stream and a second video stream. In this step, the video stream processing device 1 receives the first video stream S1 and the second video stream S2 from the first video device 2 and the second video device 3, respectively, through the first input terminal 10 and the second input terminal 20.

[0022] Step S200: transmitting the first video stream and the second video stream to a first master unit. In an initial state, the switching unit 40 transmits the first video stream S1 and the second video stream S2 to the first master unit 50 through the first hub 30.

[0023] Step S300: determining whether the video streams are transmitted by a second communication protocol. In this step, the processing module 60 reads the communication protocol information of the first video stream S1 and the second video stream S2 from the first master unit 50 to confirm the communication protocol used by the first video stream S1 and the second video stream S2. When it is determined that the first video stream S1 and the second video stream S2 are transmitted by the second communication protocol, step S400 is performed, otherwise, step S500 is performed.

[0024] Step S400: transmitting the first video stream to the first master unit and transmitting the second video stream to a second master unit. In this step, when the processing module 60 determines that the first video stream S1 and the second video stream S2 are transmitted by the second communication protocol, the processing module 60 controls the switching unit 40 to switch so that the switching unit 40 is not communicatively connected to the first hub 30 and the switching unit 40 is communicatively connected to the second master unit 70, and the switching unit 40 transmits the second video stream S2 to the second master unit 70. Thus, the first video stream S1 is transmitted to the first master unit 50 through the first hub 30, and the second video stream S2 is transmitted to the second master unit 70 through the switching unit 40. In an embodiment, the video stream processing device 1 further has a third input terminal 80 and a second hub 90. The second hub 90 receives an audio signal S3 from the third input terminal 80 and the second video stream S2 from the switching unit 40. The video stream processing device 1 transmits the audio signal S3 and the second video stream S2 to the second master unit 70 through the second hub 90.

[0025] Step S500: transmitting the first video stream and the second video stream to the first host unit. In this step, the first video stream S1 is transmitted by the first communication protocol, and the second video stream S2 is transmitted by the first communication protocol or the second communication protocol, and the processing module 60 controls the switching unit 40 to switch the switching unit 40 to be communicatively connected with the first hub 30. In this way, the video stream processing device 1 transmits the first video stream S1 to the first host unit 50 through the first hub 30, and transmits the second video stream S2 to the first host unit 50 through the first hub 30 through the switching unit 40.

[0026] In summary, the video stream processing device and the video stream data processing method of the present application can transmit multiple video streams by different host units in the case of insufficient transmission bandwidth, so that the video streams transmitted by the same second communication protocol can be transmitted by different host units in the case of insufficient transmission bandwidth, avoiding the case that multiple video streams simultaneously occupy the second communication protocol transmission bandwidth of the same host unit in the case of insufficient transmission bandwidth, thus reducing the resolution of the video stream. Therefore, the present application can support high-quality stream data transmission in the case of insufficient second communication protocol transmission bandwidth of a single host unit to simultaneously transmit multiple video streams transmitted by the second communication protocol.

[0027] It should be noted that in this document, the terms "comprising", "including", or any other variant thereof are intended to cover non-exclusive inclusions, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent to such a process, method, article or device. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of another identical element in the process, method, article or device including the element.

[0028] The embodiments of the present application are described above in conjunction with the drawings, but the present application is not limited to the specific embodiments described above, which are only illustrative and not restrictive, and those of ordinary skill in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope of protection of the claims, which all belong to the protection scope of the present application.

Claims

1. An audio-video streaming processing device, characterized by, The video stream processing device comprises: a first hub receiving a first video stream; a switching unit electrically connected to the first hub and receiving a second video stream; a first master unit electrically connected to the first hub and capable of data transmission in a first communication protocol and a second communication protocol, the transmission bandwidth of the first communication protocol being greater than that of the second communication protocol; and a second master unit electrically connected to the switching unit and capable of data transmission in the second communication protocol. When the first video stream and the second video stream are both transmitted in the second communication protocol, the switching unit transmits the second video stream to the second master unit. When the first video stream is transmitted in the first communication protocol and the second video stream is transmitted in the first communication protocol or the second communication protocol, the first hub transmits the first video stream to the first master unit, and the switching unit transmits the second video stream to the first master unit through the first hub.

2. The apparatus of claim 1, wherein In an initial state, the switching unit transmits the second video stream to the first master unit through the first hub.

3. The apparatus of claim 1, wherein the processor is further configured to: The video stream processing device further comprises:

4. The apparatus of claim 1, wherein the processor is further configured to: a second hub electrically connected to the switching unit and the second master unit, receiving an audio signal and transmitting the audio signal to the second master unit. When the first video stream and the second video stream are both transmitted in the second communication protocol, the switching unit transmits the second video stream to the second master unit through the second hub. The video stream processing device further comprises a processing module electrically connected to the switching unit, which controls the switching unit to transmit the second video stream to the second master unit when the first video stream and the second video stream are both transmitted in the second communication protocol.

5. The apparatus of claim 1, wherein the video stream is a video-on-demand (VOD) stream. The first communication protocol is the third generation universal serial bus communication protocol, and the second communication protocol is the second generation universal serial bus communication protocol.

6. The apparatus of claim 1, wherein the video stream is a video-on-demand (VOD) stream. The video stream processing device has a first input, a second input, a first hub, a switching unit, a first master unit and a second master unit, the first master unit is compatible with a first communication protocol and a second communication protocol, the second master unit is at least compatible with the second communication protocol and the transmission bandwidth of the second communication protocol is less than that of the first communication protocol, and the processing method comprises:

7. A method for processing video and audio streaming data, suitable for a video and audio streaming processing device, the method comprising: receiving a first video stream and a second video stream through the first input and the second input, respectively; and when the first video stream and the second video stream are both transmitted in the second communication protocol, transmitting the first video stream to the first master unit through the first hub and transmitting the second video stream to the second master unit through the switching unit. The processing method further comprises:

8. The treatment method of claim 7, wherein, ​ When the first video stream is transmitted in the first communication protocol and the second video stream is transmitted in the first communication protocol or the second communication protocol, the first video stream is transmitted to the first master unit through the first hub and the second video stream is transmitted to the first master unit through the first hub by the switching unit.

9. The treatment method of claim 7, wherein, The audio-video stream processing device further has a third input end and a second hub, and the processing method further comprises: receiving an audio signal through the third input end; and transmitting the audio signal and the second video stream to the second master unit through the second hub.

10. The treatment method of claim 7, wherein, The processing method further comprises: In an initial state, the switching unit transmits the second video stream to the first master unit through the first hub.

Images