Audio and video signal extension device and method, storage medium and program product

Abstract

The invention discloses an audio and video signal extension device and method, a storage medium and a program product, and relates to the technical field of signal processing, and the method comprises the steps: connecting a transmitting end and a receiving end through a network cable; the transmitting end comprises a first audio and video signal interface, a first network cable interface and an audio return processing module; the receiving end comprises a second network cable interface, a second audio and video signal interface and an audio recovery module; when the audio signal is transmitted back to the signal source equipment from the target equipment, the audio signal transmitted back by the target equipment is received at the receiving end through a second audio and video signal interface, the audio signal is embedded into a video frame through an audio recovery module to obtain a composite signal, and the composite signal is transmitted back to the transmitting end through a second network cable interface; and receiving the composite signal through the first network cable interface at the transmitting end, extracting and reconstructing an audio signal from the composite signal through the audio return processing module, and outputting the audio signal to the signal source equipment through the first audio and video signal interface.

Description

Technical Field

[0001] The present application relates to the field of signal processing technology, and in particular to an audio and video signal extension device, an audio and video signal extension method, a storage medium, and a computer program product. Background Art

[0002] With the rapid development of digital multimedia technology, high-definition and even ultra-high-definition audio and video content is becoming increasingly popular, and users' demand for high-quality audio and video experience continues to grow. In scenarios such as home theaters, professional audio-visual rooms, digital signage systems, and conference rooms, it is often necessary to transmit audio and video signals from source devices (such as game consoles) to target devices (such as TVs) over long distances for playback.

[0003] However, modern audio and video systems not only need to transmit audio and video signals from a source device to a destination device, but also often need to "transmit" the audio signals back from the destination device to an audio processing or amplification device, known as an amplifier. Existing audio and video signal extenders generally use network cables as one-way audio and video channels (supporting only signal transmission from the source device to the destination device). However, reverse audio signal transmission requires a separate line, such as an additional optical fiber or coaxial cable, which complicates the wiring and prevents coordination with forward transmission. Summary of the Invention

[0004] The main purpose of this application is to provide an audio and video signal extension device, an audio and video signal extension method, a storage medium and a computer program product, aiming to solve the technical problems of the existing technology that reverse transmission requires complex wiring and is difficult to coordinate with forward transmission.

[0005] To achieve the above-mentioned objectives, the present application proposes an audio and video signal extension device, the audio and video signal extension device comprising: a transmitting end and a receiving end, the transmitting end and the receiving end being connected via a network cable; the transmitting end comprising: a first audio and video signal interface, a first network cable interface, and an audio return processing module; the receiving end comprising: a second network cable interface, a second audio and video signal interface, and an audio return module; when transmitting the audio signal from the target device back to the signal source device: At the receiving end, the audio signal transmitted back by the target device is received through the second audio and video signal interface, the audio signal is embedded into the video frame through the audio recovery module to obtain a composite signal, and the composite signal is transmitted back to the sending end through the second network cable interface; At the transmitting end, the composite signal is received through the first network cable interface, the audio signal is extracted and reconstructed from the composite signal through the audio return processing module, and the audio signal is output to the signal source device through the first audio and video signal interface.

[0006] In one embodiment, the audio recapture module includes a protocol identification unit and an audio processing unit. The protocol identification unit is used to: identify different audio signals and perform corresponding format conversion, wherein if the audio signal is an eARC signal, it is converted into a first format; if the return signal is an ARC signal or an SPDIF signal, it is converted into a second format; the audio processing unit is used to: embed the audio signal after format conversion into a video frame to obtain a composite signal.

[0007] In one embodiment, the protocol identification unit is further used to: when the returned audio signal is an ARC signal and an SPDIF signal, convert the ARC signal into a transcoded signal in SPDIF format; the audio processing unit is further used to: merge the transcoded signal with the SPDIF signal and embed them into a video frame to obtain a composite signal.

[0008] In one embodiment, the transmitting end includes: a first audio and video signal interface, a first processing module, and a first network cable interface; the receiving end includes: a second network cable interface, a second processing module, and a second audio and video signal interface; when transmitting the audio and video signal from the signal source device to the target device: At the transmitting end, the audio and video signals of the signal source device are received through the first audio and video signal interface, the audio and video signals are subjected to bandwidth compression and channel number conversion processing by the first processing module to obtain a compressed conversion signal, and the compressed conversion signal is sent to the receiving end through the first network cable interface; At the receiving end, the compressed conversion signal is received through the second network cable interface, the compressed conversion signal is decompressed and the channel number is restored through the second processing module to obtain an audio and video signal, and the audio and video signal is output to the target device through the second audio and video signal interface.

[0009] In one embodiment, the audio return processing module includes: an audio extraction unit and a signal reconstruction unit, the audio extraction unit is used to separate the decoupled signal from the composite signal, and the signal reconstruction unit is used to reconstruct the decoupled signal into an audio signal.

[0010] In one embodiment, the network cable also supports the transmission of control signals, wherein the control signal is used to establish a bidirectional control channel between the signal source device and the target device, so that the signal source device and the target device can transmit control instructions and status information between the signal source device and the target device through the bidirectional control channel.

[0011] In addition, to achieve the above-mentioned purpose, the present application also proposes a method for extending an audio and video signal, which is applied to an audio and video signal extension device, comprising: receiving, at a receiving end, an audio signal transmitted back by a target device, embedding the audio signal into a video frame to obtain a composite signal, and transmitting the composite signal back to a transmitting end; The composite signal is received at a transmitting end, an audio signal is extracted and reconstructed from the composite signal, and the audio signal is output to a signal source device.

[0012] In one embodiment, the audio and video signal extension method is applied to an audio and video signal extension device, further comprising: receiving, at a transmitting end, audio and video signals from the signal source device, performing bandwidth compression and channel number conversion processing on the audio and video signals to obtain a compressed conversion signal, and sending the compressed conversion signal to a receiving end; The compressed conversion signal is received at a receiving end, the compressed conversion signal is decompressed and the channel number is restored to obtain an audio and video signal, and the audio and video signal is output to the target device.

[0013] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium and stores a computer program. When the computer program is executed by a processor, the steps of the audio and video signal extension method described above are implemented.

[0014] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps of the audio and video signal extension method as described above are implemented.

[0015] One or more technical solutions proposed in this application have at least the following technical effects: To address the problems of wiring redundancy and lack of coordination between forward and reverse transmission caused by the existing audio and video signal extenders that only support one-way transmission through network cables, resulting in the reverse audio signal requiring an independent line such as an additional optical fiber or coaxial cable, this application sets up an audio return module at the receiving end to embed the audio signal returned by the target device into the video frame to generate a composite signal; the sending end uses the audio return processing module to extract the audio component from the composite signal and reconstruct it into a standard protocol signal that can be recognized by the signal source device.

[0016] This makes it possible to support both forward transmission of audio and video signals and reverse transmission of audio signals on a single network cable physical channel, eliminating the need for additional lines for audio return in traditional solutions. This avoids the complexity of laying multiple cables and ensures that forward audio and video signals and reverse audio signals can be transmitted in both directions, ultimately realizing a simplified audio and video extension architecture that achieves two-way signal transmission over a single network cable. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0019] Figure 1 This is a schematic diagram of the receiving end of the audio and video signal extension device of this application; Figure 2 This is a schematic diagram of the transmitting end of the audio and video signal extension device of this application; Figure 3 This is an overall schematic diagram of the audio and video signal extension device of this application.

[0020] The purpose, features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0021] It should be understood that the specific embodiments described herein are merely used to explain the technical solutions of the present application and are not intended to limit the present application.

[0022] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0023] With the rapid development of digital multimedia technology, high-definition and even ultra-high-definition audio and video content is becoming increasingly popular, and user demand for a high-quality audio and video experience continues to grow. In scenarios such as home theaters, professional audio-visual rooms, digital signage systems, and conference rooms, it is often necessary to transmit audio and video signals from source devices (such as Blu-ray players, game consoles, and computers) to target devices (such as TVs, projectors, and large-screen displays) over long distances for playback. Traditional point-to-point connections (such as direct HDMI connections) are limited by cable lengths (typically no more than 15-20 meters), making them inadequate for long-distance transmission.

[0024] To address long-distance transmission issues, audio and video signal extenders have emerged. These devices typically utilize a separate transmitter (TX) and receiver (RX) architecture, connected via inexpensive, easy-to-lay network cables (Cat5e / Cat6 and above). This effectively overcomes the transmission distance limitations of traditional interfaces, enabling lossless transmission of high-definition signals over distances of hundreds of meters. The transmitter connects to the signal source device, while the receiver connects to the target device.

[0025] However, modern audio and video systems not only need to transmit audio and video signals from the signal source to the target device, but also often need to transmit the audio signal back from the target device to the audio processing or amplification device (such as AV amplifier, soundbar). This is mainly due to the widespread use of HDMI Audio Return Channel (ARC) and its enhanced version Enhanced ARC (eARC) function. For example, the sound played by the built-in streaming application of the smart TV, or the broadcast audio signal received by the TV, needs to be returned to the amplifier for decoding and amplification output. Traditional audio and video extension devices mainly focus on the transmission of video and forward audio (from the signal source to the target device), and the support for reverse audio return (from the target device back to the signal source) is often incomplete or limited.

[0026] In the existing technology, existing audio and video signal extenders generally use the network cable as a one-way audio and video channel (only supporting signal transmission from the signal source device to the target device), but the reverse transmission of the audio signal requires an independent line, such as an additional optical fiber or coaxial cable, which makes the wiring complicated and cannot be coordinated with the forward transmission.

[0027] The technical solution of this application is to embed the audio signal returned by the target device into the video frame to generate a composite signal by setting an audio return module at the receiving end. The transmitting end then uses the audio return processing module to extract the audio components from the composite signal and reconstruct it into a standard protocol signal that can be recognized by the signal source device. This can support both forward transmission of audio and video signals and reverse transmission of audio signals on a single network cable, eliminating the need for additional lines for audio return in traditional solutions, avoiding the complexity of multiple cable layouts, and ensuring that forward audio and video signals and reverse audio signals can be transmitted in both directions, ultimately realizing a simplified audio and video extension architecture that can achieve two-way signal transmission on a single network cable.

[0028] It should be noted that the execution subject of this embodiment may be an audio and video signal extender (hereinafter referred to as an extender), or a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, mobile phone, etc., or an electronic device or processor capable of performing the aforementioned functions. This embodiment and the following embodiments will be described below using the extender as an example.

[0029] Based on this, an embodiment of the present application provides an audio and video signal extension device. In this embodiment, the audio and video signal extension device includes: a transmitting end and a receiving end, the transmitting end and the receiving end being connected via a network cable; the transmitting end includes: a first audio and video signal interface, a first network cable interface, and an audio return processing module; the receiving end includes: a second network cable interface, a second audio and video signal interface, and an audio return module; when the audio signal is transmitted from the target device back to the signal source device: At the receiving end, the audio signal transmitted back by the target device is received through the second audio and video signal interface, the audio signal is embedded into the video frame through the audio recovery module to obtain a composite signal, and the composite signal is transmitted back to the sending end through the second network cable interface; At the transmitting end, the composite signal is received through the first network cable interface, the audio signal is extracted and reconstructed from the composite signal through the audio return processing module, and the audio signal is output to the signal source device through the first audio and video signal interface.

[0030] It should be noted that the audio and video signal extension device connects the transmitting end and the receiving end via a network cable to realize the return transmission of the audio signal from the target device (such as a TV) to the signal source device (such as a player or amplifier). The specific process is as follows: at the receiving end, the audio signal generated by the target device (such as the sound played by the TV) is first transmitted to the receiving end through the second audio and video signal interface (such as a physical interface such as HDMI, DisplayPort, etc.); then, the audio recovery module inside the receiving end embeds the received audio signal into the video frame being transmitted, forming a composite signal containing video and audio information; this composite signal is then transmitted to the transmitting end via the second network cable interface (i.e., RJ45 Ethernet port) via the network cable. At the transmitting end, after its first network cable interface receives this composite signal, the internal audio return processing module will identify and extract the embedded audio data from the composite signal and reconstruct it into a standard audio signal; finally, the reconstructed audio signal is output through the first audio and video signal interface of the transmitting end and sent back to the signal source device, thus completing the entire audio return process. This application realizes efficient reverse transmission of audio signals by embedding audio data in video frames.

[0031] In one embodiment, the transmitting end includes: a first audio and video signal interface, a first processing module, and a first network cable interface; the receiving end includes: a second network cable interface, a second processing module, and a second audio and video signal interface; when transmitting the audio and video signal from the signal source device to the target device: At the transmitting end, the audio and video signals of the signal source device are received through the first audio and video signal interface, the audio and video signals are subjected to bandwidth compression and channel number conversion processing by the first processing module to obtain a compressed conversion signal, and the compressed conversion signal is sent to the receiving end through the first network cable interface; At the receiving end, the compressed conversion signal is received through the second network cable interface, and the compressed conversion signal is decompressed and the channel number is restored through the second processing module to obtain an audio and video signal, which is then output to the target device through the second audio and video signal interface.

[0032] It should be noted that this audio and video signal extension device connects a transmitter and a receiver via a network cable, enabling audio and video signal transmission from a source device (such as a Blu-ray player) to a target device (such as a TV or projector). The specific process is as follows: At the transmitter, the audio and video signal generated by the signal source (such as an uncompressed audio and video stream transmitted via an HDMI or DP interface) is first input into the transmitter via a first audio and video signal interface. Next, a first processing module within the transmitter processes the audio and video signal, using bandwidth compression techniques (such as encoding algorithms to reduce data volume) to reduce the required transmission bandwidth. It also performs channel conversion (for example, merging multiple audio channels or converting their formats to accommodate transmission channel limitations) to generate a compressed signal. This compressed signal is then transmitted to the receiver via a first network cable interface (exemplarily, an RJ45 interface, but other interfaces are also possible). At the receiving end, after its second network cable interface receives the compressed and converted signal, the internal second processing module will perform the reverse operation: first decompress the signal (restoring the original data volume), then restore the number of channels (such as splitting and merging audio channels or converting back to standard format), and finally reconstruct the audio and video signal consistent with the original signal generated by the signal source; the reconstructed audio and video signal is finally output to the target device through the second audio and video signal interface of the receiving end, completing the entire audio and video signal extended transmission process.

[0033] In this embodiment, compression is used to reduce bandwidth requirements and flexibly convert signal channel structures, thereby achieving long-distance and stable transmission of high-quality audio and video using low-cost network cables.

[0034] In this embodiment, an audio return module is installed at the receiving end to embed the audio signal returned by the target device into the video frame to generate a composite signal. The transmitting end, through an audio return processing module, extracts the audio components from the composite signal and reconstructs it into a standard protocol signal recognizable by the signal source device. This allows both forward and reverse transmission of audio and video signals over a single physical network cable channel, eliminating the need for additional lines for audio return in traditional solutions. This avoids the complexity of multiple cable layouts while ensuring bidirectional transmission of forward and reverse audio and video signals, ultimately achieving a simplified audio and video extension architecture that supports bidirectional signal transmission over a single network cable.

[0035] like Figure 1 The figure shows a schematic diagram of the receiving end of the audio and video signal extension device of the present application. Specifically, the receiving end is connected to the target device. The receiving end is the receiving end of the audio and video extension device. When transmitting the audio and video signals in the reverse direction, that is, when transmitting the audio and video signals from the signal source device to the target device, the receiving end can be considered as the "sending end." The target device can be a television, a projector, or other device, without limitation. The receiving end includes a second audio and video signal interface, a second processing module, an audio recovery module, and a second network cable interface.

[0036] The second audio and video signal interface can receive two parts of audio signals from the target device: the audio signal of the eARC (Enhanced Audio Return Channel) protocol from the target device and the SPDIF signal input from the OPTICAL (Optical Digital Audio Interface) of the target device. If the target device sends an ARC (Audio Return Channel) signal, it will be converted into an SPDIF signal for subsequent embedded transmission and other processing.

[0037] The second processing module is used to process the forward-transmitted audio and video signals. The second processing module can be composed of chips GSV2702 and GSV5100B (decompression and channel number restoration, restoration to the original bandwidth). Specifically, after receiving the compressed conversion signal from the transmitting end, GSV2702 restores the compressed conversion signal from 2lane (two channels) to 4lane (four channels) and outputs it to GSV5100B. GSV5100B restores the compressed conversion signal to the original bandwidth and then transmits it to the target device.

[0038] The audio recapture module is used to process the audio signal transmitted in reverse. Among them, the second processing module can be composed of chips SIL9437 and GSV2702 (for format conversion and embedding). Specifically, SIL9437, as the eARC interface chip, obtains the audio signal from the target device and performs format conversion, and then outputs it to GSV2702 through the I2S (Inter-IC Sound, digital audio interface standard) interface or SPDIF (Sony / Philips Digital Interface Format, audio transmission standard) interface. A low-resolution pattern (video sequence), such as a 480P picture, is generated inside the GSV2702 chip, and then the received audio signal is embedded into the video sequence, that is, the video frame, and then transmitted to the sender through the second network cable interface. It should also be noted that the returned eARC signal is backward compatible with the ARC signal. When the eARC signal is transmitted back, the SIL9437 chip will convert it into I2S and output it to GSV2702. When the ARC signal is transmitted back, the SIL9437 will convert it into an SPDIF signal and output it to GSV2702. The SPDIF signal output by the SIL9437 and the SPDIF signal input by the OPTICAL are the same type of signal, so adding a switching chip can realize the return of the SPDIF signal.

[0039] like Figure 2The figure shows a schematic diagram of the transmitting end of the audio and video signal extension device of the present application. Specifically, the transmitting end is connected to the signal source device, wherein the signal source device may include a power amplifier device. Optionally, the transmitting end can be connected to the signal source device and the power amplifier device, that is, the audio signal transmitted in reverse from the receiving end can be transmitted to the power amplifier device via the transmitting end. The transmitting end is the transmitting end of the audio and video extension device. The transmitting end can be regarded as a "receiving end" when transmitting in reverse, that is, when transmitting the audio and video signal from the signal source device to the target device; the signal source device can be a player, a game console and other devices, which are not limited to this. The transmitting end includes a first audio and video signal interface, a first processing module, an audio return processing module, and a first network cable interface.

[0040] The first processing module processes audio and video signals transmitted from the signal source device. This module can be composed of the GSV2702 and GSV5100B chips (for bandwidth compression and channel conversion). Specifically, the 4-lane differential audio and video signals output by the signal source device are fed to the GSV5100B, which compresses the bandwidth of the signals, for example, compressing an 18G signal to a 4-lane 2.25G signal. The signals are then transmitted to the GSV2702, which converts the 4-lane audio and video signals into 2-lane signals. The signals are then transmitted to the first network cable interface for output to the receiving end.

[0041] The audio return processing module is used to process the audio signal transmitted in the reverse direction. The audio return processing module can be composed of the IT6621 and GSV2702 chips (separation and reconstruction processing). Specifically, the composite signal is transmitted to the GSV2702 via the first network cable interface. The GSV2702 separates the composite signal to obtain a decoupled signal, that is, strips the audio data from the audio and video, and outputs it to the IT6621. The IT6621 reconstructs the signal into an audio signal corresponding to the audio protocol. For example, when the signal sent from the target device is an eARC signal, it undergoes format conversion and video frame embedding at the receiving end; after separation processing at the sending end, it is finally restored to an eARC signal and then sent to the signal source device through the first audio and video signal interface.

[0042] like Figure 3The figure shows an overall schematic diagram of the audio and video signal extension device of the present application. The transmitting end and the receiving end are connected by a network cable. The forward transmission path is: the signal source device outputs the audio and video signal, which is transmitted to the receiving end through the first audio and video signal interface of the transmitting end, the first processing module, and the first network cable interface; the signal is transmitted to the target device through the second network cable interface of the receiving end, the second processing module, and the second audio and video signal interface. The reverse transmission path is: the target device outputs the audio signal, which is transmitted to the audio return module through the second audio and video signal interface of the receiving end, and the second network cable interface to the transmitting end; the transmitting end is transmitted to the signal source device through the first network cable interface, the audio return processing module, and the first audio and video signal interface.

[0043] In another embodiment, the audio playback module includes a protocol identification unit and an audio processing unit. The protocol identification unit is used to: identify different audio signals and perform corresponding format conversions, wherein if the audio signal is an eARC signal, it is converted into a first format; if the return signal is an ARC signal or an SPDIF signal, it is converted into a second format; the audio processing unit is used to: embed the audio signal after format conversion into a video frame to obtain a composite signal.

[0044] It should be noted that the audio acquisition module achieves efficient audio return through the collaborative work of the protocol identification unit and the audio processing unit. The specific process is as follows: when the target device returns the audio signal, the protocol identification unit (the circuit responsible for parsing the audio protocol type) first identifies the signal protocol - if the input is an eARC signal (enhanced audio return channel, supporting high-bandwidth lossless audio), it is converted into a dedicated first format (such as a high-bitrate digital audio stream, eARC format); if the input is an ARC signal (basic audio return channel) or SPDIF signal (optical / coaxial digital audio interface), it is uniformly converted into a second format (such as a standard bitrate digital audio stream, SPDIF format) to achieve normalization processing of different protocols. Subsequently, the audio processing unit inserts the converted unified format audio stream into the video signal through an algorithm to generate a composite signal containing both video and audio data.

[0045] In this embodiment, through protocol identification, format conversion and signal embedding, it is compatible with the high-definition audio characteristics of eARC and uniformly processes traditional ARC / SPDIF signals, and ultimately utilizes the redundant bandwidth of the video channel to achieve the audio return function.

[0046] In one embodiment, the protocol identification unit is further used to: when the returned audio signal is an ARC signal and an SPDIF signal, convert the ARC signal into a transcoded signal in SPDIF format; the audio processing unit is further used to: merge the transcoded signal with the SPDIF signal and embed it into the video frame to obtain a composite signal.

[0047] It should be noted that this technical solution achieves unified processing of both ARC (audio return signal) and SPDIF (digital audio signal) signal formats during audio return transmission. The specific process is as follows: When the protocol identification unit on the receiving end detects that the audio signal transmitted by the target device contains both ARC (audio return signal from the HDMI interface) and SPDIF (digital audio from the optical fiber or coaxial interface), it first converts the ARC signal into a transcoded signal in SPDIF format. Subsequently, the audio processing unit merges the newly generated SPDIF transcoded signal with the original SPDIF signal to form a single digital audio stream. Finally, this merged unified digital audio stream is embedded in the video frame being transmitted, generating a composite signal that carries both video and audio data.

[0048] In this embodiment, the processing flow of multi-type audio return is simplified through format conversion and signal merging, ensuring that audio from different sources can be efficiently integrated and returned through the same video channel.

[0049] In another embodiment, the audio return processing module includes: an audio extraction unit and a signal reconstruction unit, the audio extraction unit is used to separate the decoupled signal from the composite signal, and the signal reconstruction unit is used to reconstruct the decoupled signal into an audio signal.

[0050] It should be noted that the audio return processing module restores the audio signal through the collaboration of the audio extraction unit and the signal reconstruction unit. The specific process is as follows: When the transmitting end receives the composite signal from the receiving end (i.e., a video signal stream transmitted via a network cable with embedded audio data), the audio extraction unit first locates and separates the embedded audio data from the composite signal, obtaining the original unreconstructed digital audio stream (i.e., the decoupled signal). The signal reconstruction unit then processes this decoupled signal, restoring its original timing structure through a decoding algorithm and repackaging the data format according to the target output requirements (such as eARC, HDMI-ARC, or SPDIF specifications), ultimately restoring it to a complete audio signal that meets the interface standards of the signal source device.

[0051] In this embodiment, by separating the audio and video components in the composite signal, and restoring the audio signal embedded in the video frame into an audio signal that can be recognized by the signal source device through decoding and signal reconstruction, the effect of high-quality reverse transmission of the audio signal is achieved.

[0052] In one embodiment, the network cable also supports the transmission of control signals, wherein the control signals are used to establish a bidirectional control channel between the signal source device and the target device, so that the signal source device and the target device can transmit control instructions and status information between the signal source device and the target device through the bidirectional control channel.

[0053] It should be noted that this technical solution utilizes network cables to transmit audio and video signals while also extending control functionality, enabling bidirectional interaction between a source device (e.g., a player) and a target device (e.g., a TV). Specifically, the network cable, in addition to carrying audio and video data streams, can also transmit control signals. This control signal establishes a bidirectional control channel (i.e., a data link capable of simultaneously sending and receiving commands) between the transmitter and receiver. The source device can send control commands to the target device (e.g., a TV remote controlling the TV volume via the player). Simultaneously, the target device can transmit its own status information (e.g., power on / off status, resolution parameters) back to the source device in real time. For example, this control signal can be a CEC (Consumer Electronics Control) signal, which serves as an auxiliary channel for eARC or ARC signal transmission. Communication between the source and target devices requires CEC control signals, and the P82B715 can be used as a driver chip to transmit CEC control signals.

[0054] In this embodiment, through this channel, the signal source device can send control instructions to the target device, and the target device can also transmit its own status information back to the signal source device in real time, thereby realizing collaborative control and status synchronization between devices. This reuse of existing physical lines to achieve two-way communication avoids the deployment of additional control cables and reduces hardware costs.

[0055] Based on the above embodiment of the present application, in another embodiment of the present application, the same or similar contents as the above embodiment can be referred to the above introduction and will not be repeated hereafter. On this basis, the present application proposes a method for extending an audio and video signal, which is applied to an audio and video signal extension device, comprising: The receiving end receives the audio signal transmitted back by the target device, embeds the audio signal into the video frame to obtain a composite signal, and transmits the composite signal back to the sending end; The composite signal is received at the transmitting end, an audio signal is extracted and reconstructed from the composite signal, and the audio signal is output to the signal source device.

[0056] It should be noted that when the target device transmits an audio signal back through the receiving end's audio and video interface (such as an HDMI-ARC / eARC port), the receiving end first embeds this audio signal into the video frame being transmitted, generating a composite signal that carries both audio and video data. This composite signal is then transmitted back to the transmitting end via the network cable. At the transmitting end, its internal audio processing module separates the embedded audio data from the composite signal (i.e., the decoupled signal), and then uses decoding and timing reconstruction techniques (such as clock synchronization and data encapsulation) to restore it to a complete audio signal that conforms to the signal source device interface standard (such as HDMI-ARC or SPDIF format). Finally, it is output to the signal source device (such as an amplifier or player) through the transmitting end's audio and video interface.

[0057] In this embodiment, the network cable multiplexing transmission channel is utilized to achieve reverse audio transmission by embedding audio signals in video frames while maintaining the original signal quality.

[0058] In one embodiment, the audio and video signal extension method is applied to an audio and video signal extension device, further comprising: The transmitting end receives the audio and video signals of the signal source device, performs bandwidth compression and channel number conversion processing on the audio and video signals to obtain a compressed converted signal, and sends the compressed converted signal to the receiving end; The compressed and converted signal is received at the receiving end, decompressed and the channel number of the compressed and converted signal is restored to obtain the audio and video signal, and the audio and video signal is output to the target device.

[0059] It should be noted that this audio and video signal extension method achieves forward extended transmission of audio and video signals through the collaboration of a transmitter and receiver. At the transmitter, the audio and video signals output by a signal source device (such as a Blu-ray player or game console) undergo bandwidth compression (reducing the amount of data required for transmission) and channel conversion to generate a compressed signal. This compressed signal is then transmitted via a network cable to the receiver. Upon receiving this compressed signal, the receiver simultaneously performs the reverse operation: first decompressing it to restore the original data volume, then restoring the channel count, and finally reconstructing an audio and video signal that is consistent with the original audio and video signal output by the signal source device. The reconstructed audio and video signal is then output to the target device via the receiver, achieving high-fidelity long-distance transmission of the audio and video signals.

[0060] In this embodiment, compression and channel conversion are used to adapt to the transmission limitations of the network cable, while decompression and restoration are used to ensure that the target device obtains lossless signal quality.

[0061] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the audio and video signal extension method of the present application. More forms of simple transformations based on this technical concept, such as the interaction and combination of various embodiments, are all within the scope of protection of the present application.

[0062] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, a computer program) stored thereon, wherein the computer-readable program instructions are used to execute the audio and video signal extension method in the above-mentioned embodiment.

[0063] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0064] Computer program code for performing the operations of the present application may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0065] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, program segment or a part of code, and the module, program segment or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a combination of dedicated hardware and computer instructions.

[0066] The modules described in the embodiments of the present application may be implemented in software or hardware, wherein the name of a module does not necessarily limit the unit itself.

[0067] The computer-readable storage medium provided in this application stores computer-readable program instructions (i.e., a computer program) for executing the aforementioned audio and video signal extension method. This computer-readable storage medium addresses the technical issues of prior art, such as the complex wiring required for reverse transmission and the difficulty in coordinating with forward transmission. Compared to prior art, the beneficial effects of the computer-readable storage medium provided in this application are similar to those of the audio and video signal extension method provided in the aforementioned embodiments, and are not further elaborated here.

[0068] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned audio and video signal extension method when executed by a processor.

[0069] The computer program product provided in this application can solve the technical problems of the prior art, which require complex wiring for reverse transmission and are difficult to coordinate with forward transmission. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as those of the audio and video signal extension method provided in the above embodiment, and will not be elaborated here.

[0070] The above description is only part of the embodiments of the present application and does not limit the patent scope of the present application. All equivalent structural transformations made by using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect application in other related technical fields are included in the patent protection scope of the present application.

Claims

1. An audio and video signal extension device, characterized in that: include: A sending end and a receiving end, wherein the sending end and the receiving end are connected via a network cable; The transmitting end includes: a first audio and video signal interface, a first network cable interface and an audio return processing module; the receiving end includes: a second network cable interface, a second audio and video signal interface and an audio return module; when the audio signal is returned from the target device to the signal source device: At the receiving end, the audio signal transmitted back by the target device is received through the second audio and video signal interface, the audio signal is embedded into the video frame through the audio recovery module to obtain a composite signal, and the composite signal is transmitted back to the sending end through the second network cable interface; At the transmitting end, the composite signal is received through the first network cable interface, the audio signal is extracted and reconstructed from the composite signal through the audio return processing module, and the audio signal is output to the signal source device through the first audio and video signal interface.

2. The audio and video signal extension device according to claim 1, wherein: The audio recollection module includes a protocol identification unit and an audio processing unit. The protocol identification unit is used to: identify different audio signals and perform corresponding format conversion. If the audio signal is an eARC signal, it is converted to a first format; if the return signal is an ARC signal or an SPDIF signal, it is converted to a second format; the audio processing unit is used to: embed the audio signal after format conversion into a video frame to obtain a composite signal.

3. The audio and video signal extension device according to claim 2, wherein: The protocol identification unit is further used to: when the returned audio signal is an ARC signal and an SPDIF signal, convert the ARC signal into a transcoded signal in SPDIF format; the audio processing unit is further used to: merge the transcoded signal with the SPDIF signal and embed them into a video frame to obtain a composite signal.

4. The audio and video signal extension device according to claim 1, wherein: The transmitting end includes: a first audio and video signal interface, a first processing module and a first network cable interface; the receiving end includes: a second network cable interface, a second processing module and a second audio and video signal interface; when transmitting the audio and video signal from the signal source device to the target device: At the transmitting end, the audio and video signals of the signal source device are received through the first audio and video signal interface, the audio and video signals are subjected to bandwidth compression and channel number conversion processing by the first processing module to obtain a compressed conversion signal, and the compressed conversion signal is sent to the receiving end through the first network cable interface; At the receiving end, the compressed conversion signal is received through the second network cable interface, the compressed conversion signal is decompressed and the channel number is restored through the second processing module to obtain an audio and video signal, and the audio and video signal is output to the target device through the second audio and video signal interface.

5. The audio and video signal extension device according to claim 1, wherein: The audio return processing module includes an audio extraction unit and a signal reconstruction unit. The audio extraction unit is used to separate a decoupled signal from a composite signal, and the signal reconstruction unit is used to reconstruct the decoupled signal into an audio signal.

6. The device according to claim 1, wherein The network cable also supports the transmission of control signals, wherein the control signals are used to establish a bidirectional control channel between the signal source device and the target device, so that the signal source device and the target device can transmit control instructions and status information between the signal source device and the target device through the bidirectional control channel.

7. A method for extending audio and video signals, characterized in that: The audio and video signal extension method is applied to an audio and video signal extension device, comprising: receiving, at a receiving end, an audio signal transmitted back by a target device, embedding the audio signal into a video frame to obtain a composite signal, and transmitting the composite signal back to a transmitting end; The composite signal is received at a transmitting end, an audio signal is extracted and reconstructed from the composite signal, and the audio signal is output to a signal source device.

8. The method for extending audio and video signals according to claim 7, wherein: The audio and video signal extension method is applied to an audio and video signal extension device, and further comprises: receiving, at a transmitting end, audio and video signals from the signal source device, performing bandwidth compression and channel number conversion processing on the audio and video signals to obtain a compressed conversion signal, and sending the compressed conversion signal to a receiving end; The compressed conversion signal is received at a receiving end, the compressed conversion signal is decompressed and the channel number is restored to obtain an audio and video signal, and the audio and video signal is output to the target device.

9. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the audio and video signal extension method according to any one of claims 7 to 8 are implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the audio and video signal extension method according to any one of claims 7 to 8 are implemented.

Images