Live acquisition system
Patent Information
- Application Number
- CN202522224355.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-21
- Publication Date
- 2026-09-11
- Estimated Expiration
- 2035-10-21
AI Technical Summary
[0004]本实用新型的主要目的在于提供一种直播采集系统,可以解决现有技术中直播采集方案存在功能单一、场景适应性差的问题
本实用新型提供一种直播采集系统,直播采集系统包括发射端和接收端;其中,发射端包括:视频输入接口,用于接收第一视频信号;音频采集单元,用于采集第一音频信号;发射端处理模块,与视频输入接口和音频采集单元连接,用于接收第一视频信号以及第一音频信号,输出第一视频信号和第一音频信号对应的编码数据流;编码数据流由第一视频信号中提取的视频数据与混合音频信号进行编码得到的,混合音频信号由第一视频信号中分离出的源音频信号与第一音频信号混合得到的;无线发射模块,用于将待发送的编码数据流通过无线方式发送至接收端;其中,接收端包括:无线接收模块,用于接收编码数据流;解码模块,与无线接收模块连接,用于接收编码数据流,输出解码后的第二视频信号;采集输出模块,与解码模块的输出端连接,用于将解码模块输出的第二视频信号转换为预设格式的数据,并通过数据输出接口输出至外部电子设备。
Smart Images

Figure CN224746583U_ABST
Abstract
Description
Technical Field
[0001] This utility model relates to the field of electronic circuit technology, and in particular to a live broadcast acquisition system. Background Technology
[0002] In scenarios such as live streaming, video conferencing, and online education, capturing and streaming audio and video signals from devices like cameras and computers to a network platform is a core step. Traditional solutions primarily rely on wired video capture cards, connecting the signal source and the capture card via high-definition multimedia interface cables or serial digital interface cables, and then connecting to a computer via a universal serial bus interface. While this method is stable, the constraints of cables severely limit the flexibility and mobility of shooting, especially in scenarios such as outdoor live streaming and multi-camera mobile shooting.
[0003] To address mobility issues, wireless screen projection or wireless image transmission devices have emerged. These devices typically include a transmitter and a receiver, enabling wireless transmission of audio and video signals from the signal source to a remote display device. However, existing wireless devices are primarily designed for display; their receivers usually only decode and output to a monitor, lacking the ability to collect signals as a data source and output them to a computer for secondary processing. Users wishing to achieve wireless acquisition still need to connect an additional wired video capture card (also known as a video recorder) to the receiver's output port, leading to system redundancy and increased costs. Furthermore, in live streaming scenarios, it is often necessary to mix the host's commentary with the background audio from the video source, but existing wireless devices typically lack integrated microphones and real-time mixing capabilities. Moreover, existing devices usually only support a single wireless mode, preventing users from flexibly switching between wireless and wired inputs on the same device depending on the environment, lacking redundancy and flexibility. Therefore, existing technological solutions suffer from limited functionality and poor adaptability to various scenarios. Utility Model Content
[0004] The main purpose of this utility model is to provide a live streaming acquisition system that can solve the problems of limited functionality and poor adaptability to various scenarios in existing live streaming acquisition solutions.
[0005] To achieve the above objectives, the first aspect of this utility model provides a live streaming acquisition system, which includes a transmitter and a receiver. The transmitting end includes: A video input interface is used to receive the first video signal; An audio acquisition unit is used to acquire the first audio signal; The transmitting end processing module is connected to the video input interface and the audio acquisition unit, and is used to receive the first video signal and the first audio signal, and output the encoded data stream corresponding to the first video signal and the first audio signal; the encoded data stream is obtained by encoding the video data extracted from the first video signal and the mixed audio signal, and the mixed audio signal is obtained by mixing the source audio signal separated from the first video signal with the first audio signal. A wireless transmission module is used to wirelessly transmit the encoded data stream to be sent to the receiving end; The receiving end includes: A wireless receiving module is used to receive the encoded data stream; A decoding module, connected to the wireless receiving module, is used to receive the encoded data stream and output the decoded second video signal; The acquisition output module is connected to the output end of the decoding module and is used to convert the second video signal output by the decoding module into data in a preset format and output it to an external electronic device through a data output interface.
[0006] The present invention has the following beneficial effects: This utility model provides a live streaming acquisition system, which includes a transmitter and a receiver. The transmitter includes: a video input interface for receiving a first video signal; an audio acquisition unit for acquiring a first audio signal; a transmitter processing module connected to the video input interface and the audio acquisition unit, for receiving the first video signal and the first audio signal, and outputting encoded data streams corresponding to the first video signal and the first audio signal; the encoded data streams are obtained by encoding video data extracted from the first video signal and a mixed audio signal, and the mixed audio signal is obtained by mixing the source audio signal separated from the first video signal with the first audio signal; and a wireless transmission module for wirelessly transmitting the encoded data stream to be sent to the receiver. The receiver includes: a wireless receiving module for receiving the encoded data stream; a decoding module connected to the wireless receiving module for receiving the encoded data stream and outputting a decoded second video signal; and an acquisition output module connected to the output of the decoding module for converting the second video signal output by the decoding module into data of a preset format and outputting it to an external electronic device through a data output interface.
[0007] The above system supports wireless input at the receiving end, providing great flexibility and reliability for live streaming. It is highly adaptable to various scenarios and flexible and reliable. Furthermore, the system is highly integrated and multi-functional. This application integrates the functions of wireless image transmission, audio mixer and video capture card into one system. Users only need one set of equipment to meet various live streaming needs, which significantly reduces the number of devices, simplifies system connection and reduces usage costs. Attached Figure Description
[0008] To more clearly illustrate the technical solutions in the embodiments of this utility model or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this utility model. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0009] in: Figure 1 This is an application environment diagram of a live streaming acquisition system according to an embodiment of this utility model; Figure 2 This is a structural block diagram of the transmitter of a live broadcast acquisition system according to an embodiment of the present utility model; Figure 3 This is a structural block diagram of the receiving end of a live broadcast acquisition system according to an embodiment of the present utility model; Figure 4 This is a flowchart of a transmission method for live broadcast acquisition according to an embodiment of the present utility model; Figure 5 This is a flowchart of a receiving method for live broadcast acquisition in an embodiment of the present utility model; Figures 6(a), 6(b), 6(c), 6(d), 6(e), 6(f), 6(g), 6(h), 6(i), 6(j), 6(k), 6(l), 6(m), 6(n), 6(o), 6(p), 6(q), 6(r), and 6(s) Figures 6(t) to 6(u) This is a circuit diagram of a live broadcast acquisition system according to an embodiment of the present invention; Figure 7 This is a structural block diagram of the computer device in an embodiment of the present utility model. Detailed Implementation
[0010] The technical solutions of the present utility model will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of the present utility model, and not all embodiments. Based on the embodiments of the present utility model, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the protection scope of the present utility model.
[0011] This application provides a live streaming acquisition system. The system consists of two parts: a transmitter and a receiver, and is capable of wireless transmission of video signals, real-time mixing of audio signals, flexible switching between wired and wireless video sources, and final signal acquisition and output.
[0012] Please see Figure 1 , Figure 1 This paper illustrates a typical application environment for the live streaming acquisition system provided in this application embodiment. In this environment, signal source 1 (e.g., a professional camera, camcorder, or smartphone) is connected to transmitter 10 via a physical cable. Transmitter 10 processes and encodes the received audio and video signals, and then sends the data stream to receiver 20 via a wireless network. While receiving and decoding the wireless signal, receiver 20 can also receive video signals from another signal source (e.g., a computer 30 playing a presentation) via a wired interface. Receiver 20 can select between these two signal sources and transmit the selected signal (e.g., UVC / UAC data) to computer 30 via a data output interface for acquisition, recording, or live streaming. Correspondingly, receiver 20 can also synchronously output the selected signal image to an external display 40 via a separate video loop-out interface (e.g., HDMI loop-out signal) for real-time monitoring by the on-site director or host.
[0013] The following will combine Figure 2 and Figure 3 The specific structure and working principle of the transmitter 10 and receiver 20 in this embodiment are described in detail.
[0014] Please see Figure 2 , Figure 2 This is a structural block diagram of the transmitter of a live broadcast acquisition system according to an embodiment of the present invention, as shown below. Figure 2 The transmitter shown includes: Video input interface 11 is used to receive the first video signal; Audio acquisition unit 12 is used to acquire the first audio signal; The transmitting end processing module 13, connected to the video input interface 11 and the audio acquisition unit 12, is used to receive the first video signal and the first audio signal, and output the encoded data stream corresponding to the first video signal and the first audio signal; the encoded data stream is obtained by encoding video data extracted from the first video signal and a mixed audio signal, and the mixed audio signal is obtained by mixing the source audio signal separated from the first video signal with the first audio signal; specifically, it is used to separate the source audio signal from the first video signal, mix the source audio signal with the first audio signal to generate a mixed audio signal, and encode the video data extracted from the first video signal with the mixed audio signal to generate an encoded data stream to be sent; The wireless transmission module 14 is used to wirelessly transmit the encoded data stream to be transmitted to the receiving end; In one feasible implementation, the transmitter further includes a bidirectional power supply circuit 15, which is connected to the first power supply interface and the video input interface. This bidirectional power supply circuit powers the transmitter itself through the first power supply interface while simultaneously providing reverse power to an external device providing the first video signal through the video input interface. The bidirectional power supply circuit includes a control circuit composed of two metal-oxide-semiconductor field-effect transistors, such as the circuit consisting of Q1 and Q2 in the schematic diagram of the TX terminal. The audio acquisition unit includes a built-in microphone or an external audio input interface.
[0015] Please see Figure 2 The transmitter 10 mainly includes a video input interface 11, an audio acquisition unit 12, a transmitter processing module 13, a wireless transmission module 14, and a bidirectional power supply circuit 15.
[0016] Specifically, in this embodiment, the video input interface 11 can be configured as a Universal Serial Bus Type-C interface, which supports display port alternation mode. The signal source 1 (e.g., a camera or mobile phone that supports video output via this type of interface) provides a first video signal to the transmitter 10 via the video input interface 11. This first video signal is a digital audio-visual signal, such as a video with a resolution of 1920x1080 and a frame rate of 60 frames per second, which simultaneously contains video data and raw audio data (i.e., the source audio signal).
[0017] The audio acquisition unit 12 is used to acquire the first audio signal. In this embodiment, the audio acquisition unit 12 can be a microelectromechanical system (MEMS) microphone integrated on the internal circuit board of the transmitter 10. This microphone is used to acquire ambient sound from the live broadcast, commentary from the host, and other additional audio content that needs to be added. The acquired analog audio signal is processed by an internal analog-to-digital converter to generate a digital audio signal.
[0018] The transmitter processing module 13, as the core processing unit of the transmitter 10, is electrically connected to both the video input interface 11 and the audio acquisition unit 12. In this embodiment, the transmitter processing module 13 can be implemented by multiple chips working together. For example, the first video signal from the video input interface 11 first enters an interface conversion chip (such as a chip with the model number GSV1201S). Since the first video signal is in display port format, the chip converts it into a standard high-definition multimedia interface signal format for subsequent processing. The converted high-definition multimedia interface signal is sent to a main control chip, such as a chip with the model number AM8360D. This main control chip, as the main part of the transmitter processing module 13, first performs an audio-video separation operation, that is, separating the video data stream and the audio data stream from the input high-definition multimedia interface signal. The separated audio data, i.e., the source audio signal, is usually in the format of the integrated circuit's built-in audio bus.
[0019] Subsequently, the main control chip sends the separated source audio signal (integrated circuit built-in audio bus format) to a dedicated audio processing chip, such as the WN8034ET32 chip. Simultaneously, the first audio signal (e.g., the host's narration) acquired and digitized by the audio acquisition unit 12 is also sent to the audio processing chip in integrated circuit built-in audio bus format. This audio processing chip has a built-in digital mixing function, capable of mixing the two audio signals in integrated circuit built-in audio bus format in real time to generate a single mixed audio signal. The mixing algorithm can be a simple superposition of the two signals, or a weighted average based on a preset volume ratio to control the relative volume of the background noise and the narration. The generated mixed audio signal is then sent back to the main control chip via the integrated circuit built-in audio bus.
[0020] Next, the main control chip performs the encoding operation. It repackages and compresses the previously separated, unmodified video data with the received, mixed audio signal. The encoding process can employ efficient video coding standards to significantly reduce the data bitrate while maintaining image quality, thereby generating an encoded data stream suitable for wireless transmission.
[0021] The wireless transmission module 14 is connected to the transmitter processing module 13 and is used to wirelessly transmit the generated encoded data stream. In this embodiment, the wireless transmission module 14 can be a wireless fidelity module supporting the 5 GHz band. This module receives the encoded data stream from the main control chip, modulates and amplifies it via radio frequency, and then transmits it through the antenna. Using the 5 GHz band effectively avoids the congested 2.4 GHz band, thereby reducing signal interference and providing a more stable and high-speed transmission channel.
[0022] Furthermore, the transmitter 10 in this embodiment also includes an optimized bidirectional power supply circuit 15. This circuit is connected to a separate power supply interface (e.g., another Universal Serial Bus Type-C interface dedicated to power input) and a video input interface 11. The bidirectional power supply circuit 15 may internally include a control circuit composed of two metal-oxide-semiconductor field-effect transistors (MOSFETs). Its operating logic is as follows: when the user supplies power to the transmitter 10 itself through the power supply interface (e.g., by connecting a charger supporting a fast charging protocol), this circuit not only provides operating voltage to the various modules of the transmitter 10, but also controls one of the MOSFETs to conduct, outputting power in reverse through the power transmission pin of the video input interface 11 to charge the connected signal source 1 (e.g., a mobile phone). This design greatly facilitates the user and effectively prevents the signal source device from being interrupted due to power depletion during long-term live broadcasts.
[0023] Figure 3 This is a structural block diagram of the receiver 20 of a live broadcast acquisition system according to an embodiment of the present invention, as shown below. Figure 3 The receiver shown includes: The receiving end 20 includes: Wireless receiving module 21, used to receive the encoded data stream; The decoding module 22 is connected to the wireless receiving module and is used to receive the encoded data stream and output the decoded second video signal, that is, to decode the received encoded data stream into the second video signal. Wired video input interface 23 is used to receive a third video signal; The switching module 24 has its input terminals connected to the output terminal of the decoding module and the wired video input interface, respectively. The switching module is used to select one of the second video signal and the third video signal as the output signal; for example, according to a preset switching logic, it selects one of the second video signal and the third video signal as the output signal. The acquisition and output module 25 is connected to the output terminal of the switching module and is used to convert the output signal output by the switching module into data in a preset format and output it to an external electronic device through a data output interface.
[0024] In one feasible implementation, when only wireless acquisition is used, the wired video input interface 23 and the switching module 24 can be removed. In this case, the acquisition output module 25 can be connected to the output of the decoding module to convert the second video signal output by the decoding module into data in a preset format and output it to an external electronic device through the data output interface.
[0025] In one feasible implementation, the preset switching logic of the switching module is as follows: when a signal input is detected at the wired video input interface, the third video signal is preferentially selected as the output signal.
[0026] In one feasible implementation, the acquisition output module is further configured to synchronously output the output signal from the switching module to an external display device through an independent video loop-out interface 26.
[0027] In one feasible implementation, the receiving end has a second power supply interface and a third power supply interface, as well as a power switching circuit 27; the third power supply interface is the data output interface connected to an external electronic device; the power switching circuit is used to preferentially select the power supply of the second power supply interface to power the receiving end when both the second power supply interface and the third power supply interface are connected to a power source.
[0028] In one feasible implementation, the switching module includes a physical switching button for manually switching between the second video signal and the third video signal based on user operation of the physical switching button.
[0029] Please continue reading. Figure 3 This is a functional block diagram of the receiver 20 in this embodiment. The receiver 20, as the acquisition center of the entire system, mainly includes a wireless receiving module 21, a decoding module 22, a wired video input interface 23, a switching module 24, an acquisition output module 25, a video loop-out interface 26, and a power switching circuit 27.
[0030] The wireless receiving module 21 is used to receive the encoded data stream sent by the transmitter 10. It corresponds to the wireless transmitting module 14 of the transmitter 10, and in this embodiment, it can also be a 5 GHz band wireless fidelity module.
[0031] The decoding module 22 is connected to the wireless receiving module 21. Its function is to decode the received encoded data stream to restore it into a processable baseband audio and video signal. In this embodiment, the decoding module 22 can be a dedicated decoding chip, such as the AM8268D chip. This chip receives the data stream from the wireless receiving module 21, performs H.265 decoding, and outputs a standard, uncompressed high-definition multimedia interface signal. This signal, transmitted and decoded wirelessly, is defined as the second video signal.
[0032] The wired video input interface 23 is a physical interface on the receiver 20 used to receive video signals from a local wired signal source. In this embodiment, this interface can be a standard High Definition Multimedia Interface Type-A input port. Users can connect the display output of the computer 30, another camera, or any device with a High Definition Multimedia Interface output to this port, defining the signal as a third video signal.
[0033] The switching module 24 is the core component for implementing wired / wireless dual-mode input switching. Its input terminals are connected to the output terminal of the decoding module 22 (i.e., the second video signal) and the wired video input interface 23 (i.e., the third video signal), respectively. The switching module 24 selects one of these two signals as the final output signal according to a preset switching logic. In this embodiment, the switching module 24 can be a high-speed video switching chip (e.g., a chip with the model number PI3WVR13412), which functions as a two-to-one switcher. Its preset switching logic is set to "wired priority." Specifically, this can be achieved by connecting the control selection pin of the switching chip to the hot-plug detection pin of the wired video input interface 23. When the wired video input interface 23 is not connected to any device, its hot-plug detection pin is low, and the switching chip defaults to selecting the wireless signal (second video signal) from the decoding module 22 as the output. Once a user inserts a valid high-definition multimedia interface cable into the wired video input interface 23, its hot-plug detection pin is pulled high. This level change triggers the switching chip, causing it to immediately switch to selecting the signal (third video signal) from the wired video input interface 23 as the output. This automatic switching mechanism provides a reliable backup solution for live streaming; when the wireless signal is unstable, inserting a wired backup signal allows for seamless takeover.
[0034] The acquisition output module 25, connected to the output of the switching module 24, is the core of the "capture card" function. It converts the signal output by the switching module 24 into data in a preset format and outputs it to the external electronic device 30 via a data output interface. In this embodiment, the acquisition output module 25 can be a high-performance video acquisition chip, such as the MS2131 chip. This chip receives high-definition multimedia interface signals from the switching module 24 and performs two key tasks. First, it converts the audio and video signals into standard data streams conforming to the Universal Serial Bus (USB) video and audio protocols. This means that after the receiver 20 is connected to the computer 30, it will be recognized by the operating system (such as Windows or macOS) as a standard driverless camera device, allowing users to directly use it in various live streaming software (such as OBS Studio), video conferencing software, or recording software without installing any additional drivers, thus providing excellent compatibility. The converted data is transmitted to the computer 30 through a data output interface (in this embodiment, a USB Type-C interface).
[0035] Secondly, the acquisition and output module 25 also integrates a loop-out function. Internally, it splits the input signal into two paths: one path is used for conversion between Universal Serial Bus video and audio protocols, while the other path is output directly to an independent video loop-out interface 26 without any processing or delay. In this embodiment, the video loop-out interface 26 is a standard High Definition Multimedia Interface Type-A output port. Users can connect a display 40 to this port to monitor the currently acquired image in real time, whether it comes from a wireless or wired source, thus ensuring the real-time nature of the monitored image.
[0036] The power switching circuit 27 is used for intelligent management of the power supply to the receiver 20. The receiver 20 has two possible power sources: a first power supply interface, such as a dedicated DC power adapter interface; and a second power supply interface, namely the data output interface (Universal Serial Bus Type-C interface) connected to the computer 30, which can also provide some power. The function of the power switching circuit 27 is that when it detects that both the first and second power supply interfaces are connected to power, it will preferentially select the external power supply from the first power supply interface to power the entire receiver 20. This avoids or reduces drawing power from the computer 30's Universal Serial Bus interface, which is especially beneficial for users using laptops for live streaming, reducing the power burden on the laptop and extending its battery life.
[0037] This utility model provides a live streaming acquisition system. The receiver simultaneously supports wireless and wired input and can freely switch between wireless and wired modes, providing great flexibility and reliability for live streaming. When the wireless environment is interfered with, it can seamlessly switch to a stable wired backup signal to ensure uninterrupted live streaming. It is highly adaptable to various scenarios and highly flexible and reliable. Compared with the prior art, the technical solution provided by this application also has the following beneficial effects: 1. High integration, multi-purpose. This application highly integrates the functions of wireless image transmission, audio mixer, wired / wireless switcher, and video capture card into one system. Users only need one set of equipment to meet various live streaming needs, significantly reducing the number of devices, simplifying system connection, and lowering usage costs. 2. Strong scenario adaptability, flexible and reliable. The receiver simultaneously supports wireless and wired input and can automatically or manually switch according to preset logic, providing great flexibility and reliability for live streaming. When the wireless environment is interfered with, it can seamlessly switch to a stable wired backup signal to ensure uninterrupted live streaming. 3. Enriching live streaming content and enhancing interactivity. The integrated microphone mixing function in the transmitter allows the voice of the anchor or live commentator to be mixed with the background audio of the video source in real time, greatly enriching the audio content of the live broadcast and enhancing the interactivity and professionalism of the program. 4. Optimized user experience and user-friendly design. The bidirectional power supply design of the transmitter and the intelligent power switching circuit of the receiver improve the ease of use and convenience of the device.
[0038] Please refer to the following: Figure 4 and Figure 5 The working process of this embodiment is further described from the perspectives of method flow and signaling interaction.
[0039] Please see Figure 4 , Figure 4 This is a flowchart of a transmission method for live broadcast acquisition according to an embodiment of this application. The transmission method includes the following steps: 401. Receive the first video signal and acquire the first audio signal; 402. Separate the source audio signal from the first video signal and mix the source audio signal with the first audio signal to generate a mixed audio signal; 403. Encode the video data extracted from the first video signal and the mixed audio signal to generate an encoded data stream to be sent; 404. The encoded data stream to be sent is transmitted wirelessly.
[0040] Please see Figure 5 , Figure 5 This is a flowchart of a receiving method for live streaming acquisition in an embodiment of this application, as shown below. Figure 5 The receiving method shown includes the following steps: 501. Receive an encoded data stream containing video and audio sent by the transmitter, and decode the encoded data stream into a second video signal; 502. According to the preset switching logic, select one of the second video signal and the third video signal received through the wired video input interface as the output signal; The step of selecting one of the second video signal and the third video signal received through the wired video input interface as the output signal according to the preset switching logic includes: When a signal input is detected at the wired video input interface, the third video signal is preferentially selected as the output signal.
[0041] 503. Convert the output signal into data in a preset format and output it to an external electronic device through a data output interface.
[0042] In one feasible implementation where only wireless acquisition is supported, step 502 will not be executed, and step 503 will be executed directly. In this case, step 503 is used to convert the second video signal into data in a preset format and output it to an external electronic device through a data output interface.
[0043] like Figure 4 and Figure 5 As shown, the entire live broadcast acquisition method includes the transmitting end process and the receiving end process.
[0044] like Figure 4 As shown, at the transmitting end, in step 401, the transmitting end 10 receives a first video signal from the signal source 1 through the video input interface 11, and its audio acquisition unit 12 acquires a first audio signal from the scene. Subsequently, in step 402, the transmitting end processing module 13 separates the source audio signal from the first video signal, and then mixes the source audio signal with the first audio signal to generate a mixed audio signal. Afterwards, in step 403, the video data and the mixed audio signal are encoded to generate an encoded data stream. Finally, in step 404, the encoded data stream is transmitted through the wireless transmission module 14.
[0045] like Figure 5As shown, at the receiving end, firstly in step 501, the wireless receiving module 21 of the receiving end 20 receives the encoded data stream. Then, the decoding module 22 decodes it into a second video signal. Next, in step 502, the switching module 24 detects whether there is a third video signal input at the wired video input interface 23. If there is, the third video signal is selected as the output signal in step 502; otherwise, the second video signal is selected as the output signal in step 502. Finally, in step 503, the acquisition output module 25 converts the selected signal into data of a preset format (Universal Serial Bus video / audio type) (e.g., the preset format data conforms to the USB Video Class UVC protocol and the USB Audio Class UAC protocol), and outputs it to the computer 30 through the data output interface.
[0046] This application provides a transmission / reception method for live streaming acquisition. The receiver supports both wireless and wired input and can freely switch between wireless and wired, providing great flexibility and reliability for live streaming. When the wireless environment is interfered with, it can seamlessly switch to a stable wired backup signal to ensure uninterrupted live streaming. It is highly adaptable to various scenarios and is flexible and reliable.
[0047] To illustrate that the technical solution of this application is not limited to a specific physical interface type, but has broad interface compatibility, the following embodiments are provided. The core processing logic of these embodiments, such as audio mixing, wireless transmission, wired / wireless switching, and acquisition functions, is exactly the same as that of the embodiments described above. The main difference lies in the specific form of the input and output interfaces.
[0048] As an optional implementation, in this embodiment, the video input interface 11 of the transmitter 10 is configured as a standard High Definition Multimedia Interface (HMI) Type A input interface, replacing the Universal Serial Bus (USB) Type C interface in Embodiment 1. This design allows the transmitter 10 to be directly connected to the output of most professional cameras, camcorders, or computer graphics cards via common HMI cables. Since the input signal is already in a standard HMI format, the GSV1201S chip used in Embodiment 1 to convert the display port signal to an HMI signal can be omitted, thereby simplifying the circuit design and reducing costs. The first video signal from this HMI input interface can be directly sent to the main control chip (such as AM8360D) of the transmitter processing module 13 for subsequent audio and video separation, mixing, and encoding processing. Other parts of the transmitter 10, such as the audio acquisition unit 12 and the wireless transmission module 14, maintain the same structure and function as in Embodiment 1.
[0049] Accordingly, in the receiver 20 of this embodiment, the data output interface for connecting to the computer 30 is configured as a Universal Serial Bus 3.0 Type A interface, replacing the original Universal Serial Bus Type C interface. Data signals conforming to the Universal Serial Bus video / audio protocols output by the acquisition output module 25 (such as the MS2131 chip) are connected to this Type A physical port via circuit wiring. This change allows the receiver 20 to be easily connected to a large number of desktop computers or older laptops still using Universal Serial Bus Type A interfaces, greatly expanding the applicability of the device. Other parts of the receiver 20, such as the wired video input interface 23, the switching module 24, and the video loop-out interface 26, maintain the same structure and function as in Embodiment 1.
[0050] As can be seen from this embodiment, the core of the technical solution protected by this application lies in the combination and cooperation of functional modules, rather than being limited to a specific physical interface. Whether using Universal Serial Bus Type-C, High Definition Multimedia Interface, or DisplayPort as video input, or using Universal Serial Bus Type-C, Universal Serial Bus Type-A, or even Thunderbolt interface as data output, it does not depart from the protection scope of this application.
[0051] To primarily demonstrate other optional implementations of audio input and signal source switching logic to meet the needs of more professional or flexible application scenarios, the following embodiments are provided.
[0052] In this embodiment, the audio acquisition unit 12 in the transmitter 10 has been improved. It is no longer a fixed built-in microphone, but rather designed as a 3.5mm stereo audio input jack. This jack can be configured to support microphone-level or line-level input. This design provides users with great flexibility: when high-quality vocal recording is required, users can connect a professional lavalier microphone or desktop condenser microphone; when mixing background music or multiple audio streams from a professional mixing console is needed, the mixing console's line output can be connected here. External audio signals from this 3.5mm jack, after analog-to-digital conversion and preprocessing by the audio codec inside the transmitter 10, are also sent to the audio processing chip (such as WN8034ET32) via the integrated circuit's built-in audio bus format, and mixed with the source audio signal separated from the first video signal. This provides a more professional audio solution for live streaming.
[0053] Alternatively, in another embodiment, the control logic of the switching module 24 in the receiver 20 can also be modified. It is no longer the automatic switching logic of "wired priority" in Embodiment 1, but rather a manual switching logic. Specifically, a physical switching button can be added to the casing of the receiver 20 device. The signal output of this button is connected to the control selection pin of the video switching chip (such as PI3WVR13412). Each press by the user causes a level change in this pin (e.g., from high to low or from low to high), thereby triggering the switching chip to switch between the two input sources (i.e., the wireless signal from the decoding module 22 and the wired signal from the wired video input interface 23). For example, initially displaying a wireless image, pressing once switches to a wired image, and pressing again switches back to a wireless image. This manual switching method allows the on-site director to actively and precisely control the timing of image switching according to the needs of the live broadcast content, such as switching between remote camera positions and local presentation images, thus making it suitable for professional production scenarios with high requirements for image control.
[0054] It is understood that the variations of this embodiment can be used in combination with the embodiments of 1 or 2. For example, a system with both a 3.5 mm audio input interface and a manual switching button can be manufactured to provide maximum flexibility.
[0055] To illustrate that the "module" defined in this application is a functional division, its physical implementation can be either multiple discrete components or a highly integrated single chip, the following embodiment is provided. This embodiment illustrates an implementation scheme using a high-performance system-on-a-chip.
[0056] In the transmitter 10 of this embodiment, the transmitter processing module 13, which in Embodiment 1 consisted of an interface conversion chip (GSV1201S), a main control chip (AM8360D), and an audio processing chip (WN8034ET32), has all its functions replaced by a high-performance system-on-a-chip (SoC). This SoC integrates multiple hardware processing units, including but not limited to: a video input processor capable of directly receiving signals from a display port or high-definition multimedia interface; a multi-channel digital signal processor or a dedicated audio processing core capable of performing complex operations such as audio-video separation, digital mixing of multiple audio streams (source audio and external microphone audio), volume adjustment, and noise suppression; a high-performance H.265 / HEVC hardware encoder; and a wireless communication baseband processor. The digital output of the audio acquisition unit 12 (such as a microelectromechanical system microphone) and the signals from the video input interface 11 are directly input to this SoC, which internally completes all separation, mixing, and encoding tasks, and directly outputs the encoded data stream to the radio frequency front-end circuit, which is functionally equivalent to the wireless transmission module 14. This highly integrated solution can significantly reduce the number of components on the circuit board, shrink the product size, and lower overall power consumption and production costs.
[0057] Similarly, in the receiver 20 of this embodiment, the functions of the separate decoding module 22 (AM8268D), switching module 24 (PI3WVR13412), and acquisition output module 25 (MS2131) in Embodiment 1 are replaced by a powerful receiver system-on-a-chip (SoC). This SoC integrates a wireless communication baseband and media access control layer, an H.265 / HEVC hardware decoder, a simple 2x2 video matrix (capable of switching and loop-out), and a complete Universal Serial Bus (USB) controller. This controller internally contains firmware for the USB video and audio protocol stacks. Signals from the wireless receiver module 21 and the wired video input interface 23 are both input to this SoC. It selects one signal for processing based on the control signals from external pins (which can be automatic detection logic or manual button signals), and then splits the signal into two paths: one is directly output to the video loop-out interface 26, and the other is processed by the internal protocol stack and output to the data output interface by the USB physical layer.
[0058] Although the internal hardware architecture of this embodiment is completely different from that of the above embodiments, they are completely equivalent in terms of external interface, functional performance, and user operation process. This fully demonstrates that the innovation of the technical solution claimed in this application lies in the functional architecture combination of "mixing + encoding + wireless" at the transmitting end and "wireless / wired + switching + acquisition" at the receiving end, rather than the specific hardware model or integration level that implements these functions.
[0059] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.
[0060] Further, please refer to Figures 6(a), 6(b), 6(c), 6(d), 6(e), 6(f), 6(g), 6(h), 6(i), 6(j), 6(k), 6(l), 6(m), 6(n), 6(o), 6(p), 6(q), 6(r), and 6(s). Figures 6(t) to 6(u) Figures 6(a), 6(b), 6(c), 6(d), 6(e), 6(f), 6(g), 6(h), 6(i), 6(j), 6(k), 6(l), 6(m), 6(n), 6(o), 6(p), 6(q), 6(r), and 6(s) Figures 6(t) to 6(u) Figures 6(a), 6(b), 6(c), 6(d), 6(e), 6(f), 6(g), 6(h), 6(i), 6(j), 6(k), 6(l), 6(m), 6(n), 6(o), 6(p), 6(q), 6(r), and 6(s) are circuit schematics of a live broadcast acquisition system according to an embodiment of this utility model. Figures 6(t) to 6(u) The working principle of the circuit diagram shown is as follows: 1) The schematic diagram of the TX end (i.e., the aforementioned transmitter) includes... Figures 6(a) to 6(i) The principle of the TX side is as follows: In the schematic diagram of the TX end, the TYPE-C connector at CN1 is the uplink port. After connecting to devices such as cameras, mobile phones, and PCs, the DP signal is transmitted to the U7 chip GSV1201S. The U7 chip encodes and decodes the signal into a 1080P HDMI signal and sends it to the AM8360D chip at U10. At this time, the AM8360D chip performs audio separation and sends it to the U9 chip WN8034ET32 via I2S signal. The MK1 chip is for microphone pickup. The sound picked up by the microphone is transmitted to the WN8034ET32. The WN8034ET32 uses its internal algorithm to mix the audio signal transmitted from the AM8360D chip with the microphone audio signal. After processing, it sends the signal back to the AM8360D chip via I2S for video and audio signal encoding and compression. After compression, it is transmitted to the U5 WIFI module and transmitted wirelessly via 5G to the U10 module at the RX end (i.e., the aforementioned receiving end) for signal processing and encoding / decoding.
[0061] The TYPE-C port on CN2 is the PD power supply interface. The PD charger supplies power to the core board inside the TX port through this interface. The dual MOS circuit composed of Q1 and Q2 (i.e. the bidirectional power supply circuit mentioned above) is the core design to realize bidirectional power supply of the Type-C interface. Its core functions include power path switching, reverse current protection, and dynamic current distribution. It can supply 65W to the upstream port CN1 socket and can also supply power to the board.
[0062] The button labeled SW2 is the pairing button. Press and hold for 5 seconds to enter pairing mode. The LED indicator lights (D1 / D2 / D3 / D4) will change from slow flashing to fast flashing after a 5-second press. Once paired successfully with the RX terminal, the LEDs will remain constantly lit. The button labeled SW1 is the reset button. Press and hold this button while powering on the device to enter burning mode when firmware is being burned or upgraded.
[0063] The MT3683 in the U2 slot is a DC-DC high-voltage to low-voltage converter chip with a high input voltage of 24V and a regulated output voltage of 5V. The TLV62569DBVR in the U8 slot is a DC-DC converter chip used to regulate a voltage of 1.08V to power the core chip in the U7 slot. The TLV62569DBVR in the U4 slot is a DC-DC converter chip used to regulate a voltage of 3.3V to power the core chips U7, U5, U9, and U10. The TLV62569DBVR in the U3 slot is a DC-DC converter chip used to regulate a voltage of 1.35V to power the core chip U10.
[0064] 2) The schematic diagram of the RX end (i.e., the receiver mentioned above) includes: Figures 6(j) to 6(u) The principle of the RX end is as follows: In the schematic diagram of the RX end, U10 is the WIFI module. After receiving the signal sent from the TX end, the module transmits it to the AM8268D chip at U6 for decoding into an HDMI signal. The processed HDMI signal is then sent to the Switch chip PI3WVR13412 at U12. The function of the PI3WVR13412 switch chip is to select the wired input of the HDMI socket with the J4 interface. The PI3WVR13412 chip prioritizes the wired input channel. When a wireless signal is transmitted and the HDMI socket with the J4 interface is also connected to the PC, the PI3WVR13412 will prioritize the wired input by default, and the wireless input channel will be cut off. After receiving the HDMI signal, the PI3WVR13412 chip transmits it to the MS2131 acquisition chip (U1). This core function can loop out one 1080P HDMI signal to the HDMI connector on the J1 interface, and convert another signal to a USB protocol signal to the J6 TYPE-C interface for transmission to the PC for acquisition and recording. Since the J6 TYPE-C interface is a female port with a reversible designation, the VL162 chip (U18) is needed to perform signal flipping.
[0065] J9 is the microphone signal input interface. The microphone signal is sent to the ES7243E chip at U16. The ES7243E chip is an analog-to-digital converter chip. After the analog signal passes through the ES7243E, it is converted into an I2S digital signal and sent to the MS2131 chip at U1 for audio mixing processing. Then, it is output as an I2S digital signal to the CJC4344H chip at U17. This chip is a digital-to-analog converter chip. After the digital signal passes through the CJC4344H, it is converted into an analog signal and output to the headphone jack at J10 for external output.
[0066] J7 is a TYPE-C 5V power connector. After the charger is plugged in, the CC protocol fixes the input to 5V to power the core board. The circuit composed of Q1, Q2, and Q3 is a dual power supply switching circuit (i.e., the power switching circuit mentioned above). The main purpose of this circuit is that when the TYPE-C connector at J7 is plugged in and powered by the charger, and the TYPE-C interface at J6 is also connected to the PC for data acquisition, the circuit composed of Q1, Q2, and Q3 will default to powering from the TYPE-C interface at J7, disconnecting the power supply at J6 and no longer drawing power from the PC to save power for the computer. When both TYPE-C connectors are plugged in at the same time, the VBUS2 power supply is supplied to the gate (G) of the 3401 MOSFET at Q1, causing the MOSFET at Q1 to be cut off. The VBUS2 power supply pulls the collector (C) low through the base (B) of the MOSFET at Q2, causing the gate (G) of the MOSFET at Q3 to be in a low potential state, thereby turning on the VBUS2 power supply to the source (S) and supplying power to the core board.
[0067] The SW8 button is for pairing and programming. Press and hold it for 3 seconds while powered on to enter pairing mode. To program or upgrade firmware, press and hold the SW8 button before powering on to enter programming or upgrade mode. The LED on the RX end is the power indicator; it will remain lit when powered on.
[0068] The TLV62569DBVR chip in the U8 slot is a DC-DC converter used to regulate a 1.32V power supply to the U6 core chip; the TLV62569DBVR chip in the U7 slot is a DC-DC converter used to regulate a 1.8V power supply to the U6 core chip; the TLV62569DBVR chip in the U5 slot is a DC-DC converter used to regulate a 3.3V power supply to the U6 and U12 core chips; the AMS1117-2.5V chip in the U22 slot is an LDO chip used to regulate a 2.5V power supply to the U1 core chip; the TLV62569DBVR chip in the U23 slot is a DC-DC converter used to regulate a 1.1V power supply to the U1 core chip; and the AMS1117-3.3V chip in the U21 slot is an LDO chip used to regulate a 3.3V power supply to the U1, U16, and U17 core chips.
[0069] It is understood that the circuit schematic shown in Figure 6 is only one feasible implementation method of this application, and not the only implementation method. This application cannot exhaustively list them here. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of this application should be included within the protection scope of this application.
[0070] Figure 7 An internal structural diagram of a computer device in one embodiment is shown. This computer device can specifically be a terminal or a server. Figure 7 As shown, the computer device includes a processor, memory, and a network interface connected via a system bus. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and may also store a computer program, which, when executed by the processor, causes the processor to perform the aforementioned methods. The internal memory may also store a computer program, which, when executed by the processor, causes the processor to perform the aforementioned methods. Those skilled in the art will understand that… Figure 7 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0071] In one embodiment, a computer device is provided, including a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform actions such as... Figure 4 and Figure 5 The steps are shown.
[0072] In one embodiment, a computer-readable storage medium is provided storing a computer program that, when executed by a processor, causes the processor to perform the following actions: Figure 4 and Figure 5 The steps are shown.
[0073] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments described above. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.
[0074] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0075] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.
Claims
1. A live acquisition system, characterized by, The live streaming acquisition system includes a transmitter and a receiver; The transmitting end includes: A video input interface is used to receive the first video signal; An audio acquisition unit is used to acquire the first audio signal; The transmitting end processing module is connected to the video input interface and the audio acquisition unit, and is used to receive the first video signal and the first audio signal, and output the encoded data stream corresponding to the first video signal and the first audio signal; the encoded data stream is obtained by encoding the video data extracted from the first video signal and the mixed audio signal, and the mixed audio signal is obtained by mixing the source audio signal separated from the first video signal with the first audio signal. A wireless transmission module is used to wirelessly transmit the encoded data stream to be transmitted to the receiving end; The receiving end includes: A wireless receiving module is used to receive the encoded data stream; A decoding module, connected to the wireless receiving module, is used to receive the encoded data stream and output the decoded second video signal; The acquisition output module is connected to the output end of the decoding module and is used to convert the second video signal output by the decoding module into data in a preset format and output it to an external electronic device through a data output interface.
2. The live streaming acquisition system according to claim 1, characterized in that, The receiving end also includes: Wired video input interface, used to receive third-party video signals; A switching module, the input of which is connected to the output of the decoding module and the wired video input interface respectively, and the switching module is used to select one of the second video signal and the third video signal as the output signal; The acquisition and output module is connected to the output terminal of the switching module and is used to convert the output signal output by the switching module into data in a preset format and output it to an external electronic device through a data output interface.
3. The live capture system of claim 2, wherein, The switching module is specifically used to: when a signal input is detected at the wired video input interface, preferentially select the third video signal as the output signal.
4. The live capture system of claim 2, wherein, The acquisition and output module is also used to synchronously output the output signal from the switching module to an external display device through an independent video loop-out interface.
5. The live streaming acquisition system according to claim 1, characterized in that, The transmitter also includes a bidirectional power supply circuit, which is connected to the first power supply interface and the video input interface. The bidirectional power supply circuit is used to supply power to the transmitter itself through the first power supply interface, while simultaneously providing reverse power to an external device that provides the first video signal through the video input interface.
6. The live streaming acquisition system according to claim 1, characterized in that, The receiving end has a second power supply interface and a third power supply interface, as well as a power switching circuit; the third power supply interface is the data output interface connected to an external electronic device; the power switching circuit is used to preferentially select the power supply of the second power supply interface to power the receiving end when both the second power supply interface and the third power supply interface are connected to a power source.
7. The live capture system of claim 1, wherein, The audio acquisition unit includes a built-in microphone or an external audio input interface.
8. The live capture system of claim 2, wherein, The switching module includes a physical switching button for manually switching between the second video signal and the third video signal based on the user's operation of the physical switching button.
9. The live capture system of claim 6, wherein, The second power supply interface is a direct current power adapter interface, and the third power supply interface is a universal serial bus type-C interface.
10. The live streaming acquisition system according to claim 5, characterized in that, The bidirectional power supply circuit comprises a control circuit composed of two metal oxide semiconductor field effect transistors.