Audio-video signal extension device, method, storage medium and program product

Abstract

The application discloses an audio and video signal extension device and method, a storage medium and a program product, and relates to the technical field of signal processing. The device comprises the following steps: connecting a sending end and a receiving end through a network cable; the sending end comprises a first audio and video signal interface, a first network cable interface and an audio feedback processing module; the receiving end comprises a second network cable interface, a second audio and video signal interface and an audio feedback module; when audio signals are fed back from a target device to a signal source device: the receiving end receives the audio signals fed back by the target device through the second audio and video signal interface, embeds the audio signals in a video frame through the audio feedback module to obtain a composite signal, and feeds back the composite signal to the sending end through the second network cable interface; the sending end receives the composite signal through the first network cable interface, extracts the audio signals from the composite signal through the audio feedback processing module, and outputs the audio signals to the signal source device through the first audio and video signal interface.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of signal processing, in particular to an audio and video signal extension device, an audio and video signal extension method, a storage medium and a computer program product. BACKGROUND

[0002] With the rapid development of digital multimedia technology, high-definition and even ultra-high-definition audio and video content is increasingly popular, and users' demand for high-quality audio and video experience continues to grow. In home theaters, professional audio-visual rooms, digital signage systems and conference rooms, etc., it is often necessary to transmit the audio and video signals output by the signal source device (such as a game console) to the target device (such as a television) at a long distance for playing.

[0003] However, modern audio and video systems not only need to transmit audio and video signals from the signal source device to the target device, but often also need to "return" the audio signals from the target device to the audio processing or amplification device, i.e., the power amplifier device. In the prior art, existing audio and video signal extenders generally use network cables as one-way audio and video channels (only supporting signal transmission from the signal source device to the target device), but independent lines such as additional optical fibers or coaxial cables are needed for reverse transmission of audio signals, resulting in complex wiring and inability to coordinate with forward transmission. SUMMARY

[0004] The main purpose of the present application is to provide an audio and video signal extension device, an audio and video signal extension method, a storage medium and a computer program product, aiming to solve the technical problem that the prior art requires complex wiring for reverse transmission and is difficult to coordinate with forward transmission.

[0005] To achieve the above-mentioned purpose, the present application provides an audio and video signal extension device, which comprises: a sending end and a receiving end, the sending end and the receiving end being connected through a network cable; the sending end comprises: a first audio and video signal interface, a first network cable interface and an audio return processing module; the receiving end comprises: a second network cable interface, a second audio and video signal interface and an audio backhaul module; when audio signals are returned from the target device to the signal source device:

[0006] In the receiving end, the audio signals returned by the target device are received through the second audio and video signal interface, the audio signals are embedded in a video frame through the audio backhaul module to obtain a composite signal, and the composite signal is returned to the sending end through the second network cable interface;

[0007] In the sending end, the composite signal is received through the first network cable interface, the audio signals are extracted and reconstructed from the composite signal through the audio return processing module, and the audio signals are output to the signal source device through the first audio and video signal interface.

[0008] In an embodiment, the audio backhaul module comprises a protocol identification unit and an audio processing unit, the protocol identification unit is configured to identify different audio signals and perform corresponding format conversion, wherein if the audio signal is an eARC signal, the audio signal is converted into a first format; if the backhaul signal is an ARC signal or an SPDIF signal, the audio signal is converted into a second format; the audio processing unit is configured to embed the converted audio signal into a video frame to obtain a composite signal.

[0009] In an embodiment, the protocol identification unit is further configured to convert the ARC signal into an SPDIF format transcoded signal when the backhaul audio signal is an ARC signal and an SPDIF signal, and the audio processing unit is further configured to merge and embed the transcoded signal and the SPDIF signal into a video frame to obtain a composite signal.

[0010] In an embodiment, the sending end comprises a first audio-video signal interface, a first processing module and a first network interface; the receiving end comprises a second network interface, a second processing module and a second audio-video signal interface; when transmitting an audio-video signal from a signal source device to a target device:

[0011] In the sending end, the audio-video signal of the signal source device is received through the first audio-video signal interface, the audio-video signal is subjected to bandwidth compression and channel number conversion processing through the first processing module to obtain a compressed and converted signal, and the compressed and converted signal is sent to the receiving end through the first network interface;

[0012] In the receiving end, the compressed and converted signal is received through the second network interface, the compressed and converted signal is subjected to decompression and channel number restoration through the second processing module to obtain an audio-video signal, and the audio-video signal is output to the target device through the second audio-video signal interface.

[0013] In an embodiment, the audio backhaul processing module comprises an audio extraction unit and a signal reconstruction unit, the audio extraction unit is configured to separate a decoupled signal from a composite signal, and the signal reconstruction unit is configured to reconstruct the decoupled signal into an audio signal.

[0014] In an embodiment, the network cable also supports transmission of a control signal, wherein the control signal is configured to establish a bidirectional control channel between the signal source device and the target device, so that the signal source device and the target device transmit control instructions and state information through the bidirectional control channel.

[0015] In addition, to achieve the above object, the present application further provides an audio-video signal extension method applied to an audio-video signal extension device, comprising:

[0016] receiving the audio signal returned by the target device at the receiving end, embedding the audio signal into a video frame to obtain a composite signal, and returning the composite signal to the sending end;

[0017] receiving the composite signal at the sending end, extracting and reconstructing the audio signal from the composite signal, and outputting the audio signal to the signal source device.

[0018] In an embodiment, the audio / video signal extension method is applied to an audio / video signal extension device, and further comprises:

[0019] receiving the audio / video signal of the signal source device at the sending end, performing bandwidth compression and channel number conversion on the audio / video signal to obtain a compressed and converted signal, and sending the compressed and converted signal to the receiving end;

[0020] receiving the compressed and converted signal at the receiving end, decompressing and restoring the channel number of the compressed and converted signal to obtain an audio / video signal, and outputting the audio / video signal to the target device.

[0021] In addition, to achieve the above object, the present application further provides a storage medium, which is a computer readable storage medium, and a computer program is stored on the storage medium, and the computer program is executed by a processor to implement the steps of the audio / video signal extension method described above.

[0022] In addition, to achieve the above object, the present application further provides a computer program product, which comprises a computer program, and the computer program is executed by a processor to implement the steps of the audio / video signal extension method described above.

[0023] The one or more technical solutions provided by the present application have at least the following technical effects:

[0024] In view of the problem that the existing audio / video signal extender only supports one-way transmission through a network cable, resulting in the need for an independent line such as an additional optical fiber or coaxial cable for the reverse audio signal, and causing wiring redundancy and the lack of coordination between forward and reverse transmission, the present application sets an audio back sampling module at the receiving end to embed the audio signal returned by the target device into a video frame to generate a composite signal. The sending end extracts the audio component from the composite signal through an audio return processing module and reconstructs it into a standard protocol signal recognizable by the signal source device.

[0025] Thus, both forward transmission of audio and video signals and reverse transmission of audio signals can be supported on a single network cable physical channel, the need for additional lines for audio return in the traditional scheme can be eliminated, complexity of multi-cable layout can be avoided, bidirectional transmission of forward audio and video signals and reverse audio signals can be ensured, and finally, a simplified audio and video extension architecture for bidirectional signal transmission by a single network cable is realized. BRIEF DESCRIPTION OF DRAWINGS

[0026] The accompanying drawings, which are incorporated herein and form a part of the specification, illustrate embodiments consistent with the present application and, together with the description, further serve to explain the principles of the application.

[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

[0028] Figure 1 a schematic diagram of a receiving end of an audio and video signal extension device of the present application;

[0029] Figure 2 a schematic diagram of a sending end of an audio and video signal extension device of the present application;

[0030] Figure 3 a schematic diagram of an audio and video signal extension device of the present application.

[0031] The object implementation, functional features and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0032] It should be understood that the specific embodiments described herein are merely intended to explain the technical solutions of the present application, and are not intended to limit the present application.

[0033] In order to better understand the technical solutions of the present application, the following will be described in detail with reference to the accompanying drawings and specific embodiments.

[0034] With the rapid development of digital multimedia technology, high-definition and even ultra-high-definition audio and video content is increasingly popular, and users' demand for high-quality audio and video experience continues to grow. In home theaters, professional audio-visual rooms, digital signage systems and conference rooms, etc., the audio and video signals output by the signal source device (such as a Blu-ray player, a game console, a computer) often need to be transmitted to a target device (such as a television, a projector, a large screen display) at a long distance for playing. The traditional point-to-point connection method (such as HDMI direct connection) is limited by the cable length (usually no more than 15-20 meters), and it is difficult to meet the demand for long-distance transmission.

[0035] To solve the problem of long-distance transmission, audio and video signal extenders (Extender) emerged as the times require. This kind of device usually adopts the design architecture of separating the transmitter (TX) and receiver (RX), and the two are connected through the low-cost and easy-to-wire network cable (Cat5e / Cat6 and above), which effectively breaks through the transmission distance limit of the traditional interface, and can realize the lossless transmission of hundreds of meters of high-definition signal. The transmitter is connected to the signal source device, and the receiver is connected to the target device.

[0036] However, modern audio-visual systems not only need to transmit audio and video signals from the signal source to the target device, but also often need to transmit audio signals from the target device back to the audio processing or amplification device (such as AV amplifier, soundbar). This is mainly due to the widespread application of HDMI Audio Return Channel (ARC) and its enhanced version Enhanced ARC (eARC) functions. For example, the sound played by the built-in streaming application of a smart TV, or the broadcast audio signal received by the TV, needs to be transmitted back to the amplifier for decoding and amplification output. The traditional audio and video extension device mainly focuses on the transmission of video and forward audio (from the signal source to the target device), and the support for reverse audio transmission (from the target device back to the signal source) is often not perfect or limited.

[0037] In the prior art, existing audio and video signal extenders generally use network cables as one-way audio and video channels (only supporting signal transmission from the signal source device to the target device), but reverse transmission of audio signals requires independent lines, such as additional optical fiber or coaxial cable, resulting in complex wiring and inability to coordinate with forward transmission.

[0038] The technical solution of the present application sets up an audio back sampling module in the receiver to embed the audio signal transmitted back by the target device into a video frame to generate a composite signal; the transmitter then extracts the audio component from the composite signal through an audio transmission processing module and reconstructs it into a standard protocol signal recognizable by the signal source device. In this way, both forward transmission of audio and video signals and reverse transmission of audio signals can be supported on a single network cable, eliminating the need for additional lines for audio transmission in traditional solutions, avoiding the complexity of multiple cable installation, and ensuring that forward audio and video signals and reverse audio signals can be transmitted bidirectionally, ultimately realizing a simplified audio and video extension architecture that supports bidirectional signal transmission on a single network cable.

[0039] It should be noted that the execution subject of the present embodiment can be an audio and video signal extension device (referred to as an extender), or a computing service device with data processing, network communication, and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device, a processor, etc. that can realize the above functions. The following will take the extender as an example to explain the present embodiment and the following embodiments.

[0040] Based on this, the embodiment of the application provides an audio and video signal extension device. In the embodiment, the audio and video signal extension device comprises a sending end and a receiving end, the sending end is connected with the receiving end through a network cable; the sending end comprises a first audio and video signal interface, a first network cable interface and an audio feedback processing module; the receiving end comprises a second network cable interface, a second audio and video signal interface and an audio feedback module; when audio signals are fed back from a target device to a signal source device:

[0041] In the receiving end, the audio signals fed back by the target device are received through the second audio and video signal interface, the audio signals are embedded in a video frame through the audio feedback module to obtain a composite signal, and the composite signal is fed back to the sending end through the second network cable interface;

[0042] In the sending end, the composite signal is received through the first network cable interface, the audio signals are extracted from the composite signal and reconstructed through the audio feedback processing module, and the audio signals are output to the signal source device through the first audio and video signal interface.

[0043] It should be noted that the audio and video signal extension device connects the sending end and the receiving end through a network cable, realizes the feedback of the audio signals from the target device (such as a television) to the signal source device (such as a player or a power amplifier), and the specific process is as follows: in the receiving end, the audio signals (such as the sound played by the television) generated by the target device are first transmitted into the receiving end through the second audio and video signal interface (such as an HDMI, a DisplayPort or the like); then, the audio feedback module in the receiving end embeds the received audio signals into the video frame being transmitted to form a composite signal containing video and audio information; the composite signal is immediately transmitted to the sending end through the second network cable interface (namely, an RJ45 Ethernet port) through the network cable. After the first network cable interface of the sending end receives the composite signal, the audio feedback processing module in the sending end identifies and extracts the embedded audio data from the composite signal, reconstructs the audio data into standard audio signals, and finally outputs the reconstructed audio signals through the first audio and video signal interface of the sending end to the signal source device, so that the whole audio feedback process is completed. The application realizes the efficient reverse transmission of the audio signals by embedding the audio data in the video frame.

[0044] In one embodiment, the sending end comprises a first audio and video signal interface, a first processing module and a first network cable interface; the receiving end comprises a second network cable interface, a second processing module and a second audio and video signal interface; when the audio and video signals are transmitted from the signal source device to the target device:

[0045] At the sending end, the audio and video signals of the signal source device are received through the first audio and video signal interface, the audio and video signals are subjected to bandwidth compression and channel number conversion processing through the first processing module to obtain compressed and converted signals, and the compressed and converted signals are sent to the receiving end through the first network interface.

[0046] At the receiving end, the compressed and converted signals are received through the second network interface, the compressed and converted signals are subjected to decompression and channel number restoration through the second processing module to obtain audio and video signals, and the audio and video signals are output to the target device through the second audio and video signal interface.

[0047] It should be noted that the audio and video signal extension device connects the sending end and the receiving end through a network cable to realize the transmission of audio and video signals from a signal source device (such as a Blu-ray player) to a target device (such as a television or a projector). The specific process is as follows: at the sending end, the audio and video signals generated by the signal source (such as uncompressed audio and video streams transmitted through HDMI or DP interfaces) are first input into the sending end through the first audio and video signal interface; then, the first processing module inside the sending end processes the audio and video signals - reduces the bandwidth required for transmission through bandwidth compression technology (such as encoding algorithm to reduce data volume), and performs channel number conversion (such as merging or converting the format of multiple audio channels to adapt to the transmission channel limit) to generate compressed and converted signals; the compressed and converted signals are then sent to the receiving end through the first network interface (exemplarily, which can be an RJ45 interface or other interfaces) via a network cable. At the receiving end, after the second network interface receives the compressed and converted signals, the second processing module inside the receiving end performs reverse operations: first decompresses the signals (restores the original data volume), and then restores the channel number (such as splitting the merged audio channels or converting back to the standard format), and finally reconstructs the audio and video signals consistent with the original signals generated by the signal source; the reconstructed audio and video signals are finally output to the target device through the second audio and video signal interface of the receiving end, completing the entire audio and video signal extension transmission process.

[0048] In this embodiment, the bandwidth requirement is reduced by compression and the signal channel structure is flexibly converted, thereby realizing long-distance stable transmission of high-quality audio and video using low-cost network cables.

[0049] In this embodiment, an audio back sampling module is provided at the receiving end to embed the audio signals returned by the target device into video frames to generate composite signals; the sending end extracts the audio components from the composite signals through an audio back transmission processing module and reconstructs them into standard protocol signals recognizable by the signal source device. In this way, both forward transmission of audio and video signals and reverse transmission of audio signals can be supported on a single network cable physical channel, eliminating the need for additional lines for audio back transmission in traditional solutions, avoiding the complexity of multiple cable layout, and ensuring that forward audio and video signals and reverse audio signals can be bidirectionally transmitted, ultimately realizing a simplified audio and video extension architecture that enables bidirectional signal transmission through a single network cable.

[0050] As Figure 1 shown is a schematic diagram of the receiving end of the audio and video signal extension device of the present application, specifically, the receiving end is connected with the target device, wherein the receiving end is the receiving end of the audio and video extension device, and when the receiving end transmits the audio and video signals from the signal source device to the target device, it can be regarded as a “sending end”; the target device can be a television, a projector or other devices, and is not limited. The receiving end includes a second audio and video signal interface, a second processing module, an audio back sampling module and a second network interface.

[0051] The second audio and video signal interface can receive two parts of audio signals from the target device: the eARC (Enhanced Audio Return Channel) protocol audio signal obtained from the target device, and the SPDIF signal input by the target device from the OPTICAL (optical digital audio interface). If the target device sends an ARC (Audio Return Channel) signal, it will be converted into an SPDIF signal for subsequent embedded transmission and other processing.

[0052] The second processing module is used for processing the forward transmission of the audio and video signals, wherein the second processing module can be composed of chips GSV2702 and GSV5100B (decompression and channel number restoration, restoring the original bandwidth), specifically, after receiving the compressed conversion signal from the sending end, the GSV2702 restores the compressed conversion signal from 2lane (two channels) to 4lane (four channels) and outputs it to the GSV5100B, and the GSV5100B restores the compressed conversion signal to the original bandwidth, and then transmits it to the target device.

[0053] The audio backhaul module is used for processing the audio signal of the reverse transmission, wherein the second processing module can be composed of a chip SIL9437 and a GSV2702 (for format conversion and embedding), specifically, the SIL9437 is used as an eARC interface chip to obtain the audio signal from the target device, then performs format conversion, and outputs to the GSV2702 through an I2S (Inter-IC Sound, digital audio interface standard) interface or an SPDIF (Sony / Philips Digital Interface Format, audio transmission standard) interface, the GSV2702 chip internally generates a low-resolution pattern (video sequence), such as a 480P picture, then embeds the received audio signal into the video sequence, i.e., the video frame, and transmits to the sending end through the second network interface. It should be noted that the eARC signal of the backhaul is downward compatible with the ARC signal, when the eARC signal is backhauled, the SIL9437 chip will be converted to I2S output to the GSV2702, when the ARC signal is backhauled, the SIL9437 will be converted to SPDIF signal output to the GSV2702; the SPDIF output by the SIL9437 and the SPDIF signal input by the OPTICAL are the same type of signal, so a switching chip can be added to realize the backhaul of the SPDIF signal.

[0054] As Figure 2 shown is a sending end schematic diagram of the audio and video signal extension device of the present application, which is a sending end schematic diagram of the audio and video signal extension device of the present application, specifically, the sending end is connected with a signal source device, wherein the signal source device can include a power amplifier device, optionally, the sending end can be connected with the signal source device and the power amplifier device, i.e., the audio signal of the reverse transmission from the receiving end can be transmitted to the power amplifier device through the sending end. The sending end is the sending end of the audio and video extension device, which can be regarded as a "receiving end" when reverse transmission, i.e., when transmitting the audio and video signal from the signal source device to the target device; the signal source device can be a player, a game console or the like, which is not limited. The sending end includes a first audio and video signal interface, a first processing module, an audio backhaul processing module, and a first network interface.

[0055] The first processing module processes the audio and video signals transmitted from the signal source device. This module can be composed of chips GSV2702 and GSV5100B (for bandwidth compression and channel conversion). Specifically, the 4-lane differential audio and video signals output from the signal source device are given to the GSV5100B, which performs bandwidth compression (e.g., compressing an 18G signal to 2.25G for 4 lanes). The signals are then transmitted to the GSV2702, which performs channel conversion (e.g., converting the 4-lane audio and video signals to 2 lanes). Finally, the signals are transmitted to the first network cable interface for output to the receiving end.

[0056] The audio return processing module is used to process the audio signal transmitted from the reverse direction. The audio return processing module can be composed of the IT6621 and GSV2702 chips (separation and reconstruction processing). Specifically, the composite signal is transmitted to the GSV2702 through the first network cable interface. The GSV2702 separates the composite signal to obtain the decoupled signal, that is, it extracts the audio data from the audio and video, and outputs it to the IT6621. The IT6621 performs reconstruction processing, that is, it reconstructs the audio signal into the corresponding audio protocol. For example, when the eARC signal is sent from the target device, it undergoes format conversion and video frame embedding processing at the receiving end; after separation processing at the sending end, it is finally restored to the eARC signal, and then sent to the signal source device through the first audio and video signal interface.

[0057] like Figure 3 The diagram shows the overall schematic of the audio / video signal extension device of this application. The transmitting end and the receiving end are connected via a network cable. The forward transmission path is as follows: the audio / video signal is output from the signal source device, passes through the first audio / video signal interface of the transmitting end, then to the first processing module, and then to the first network cable interface to be transmitted to the receiving end; it then passes through the second network cable interface of the receiving end, then to the second processing module, and finally to the target device via the second audio / video signal interface. The reverse transmission path is as follows: the audio signal is output from the target device, passes through the second audio / video signal interface of the receiving end, then to the audio feedback module, and then to the transmitting end via the second network cable interface; the transmitting end transmits the signal through the first network cable interface, then to the audio feedback processing module, and finally to the signal source device via the first audio / video signal interface.

[0058] In another embodiment, the audio re-acquisition module includes a protocol identification unit and an audio processing unit. The protocol identification unit is used to: identify different audio signals and perform corresponding format conversions, wherein if the audio signal is an eARC signal, it is converted to a first format; if the returned signal is an ARC signal or an SPDIF signal, it is converted to a second format; the audio processing unit is used to: embed the converted audio signal into a video frame to obtain a composite signal.

[0059] It should be noted that the audio backhaul module realizes efficient audio backhaul through the cooperative work of the protocol identification unit and the audio processing unit. The specific process is as follows: when the target device backhauls the audio signal, the protocol identification unit (the circuit responsible for analyzing the audio protocol type) first identifies the protocol of the signal - if the input is an eARC signal (enhanced audio return channel, supporting high-bandwidth lossless audio), it is converted into a dedicated first format (such as a high-bit-rate digital audio stream, eARC format); if the input is an ARC signal (basic audio return channel) or an SPDIF signal (fiber / coaxial digital audio interface), it is uniformly converted into a second format (such as a standard-bit-rate digital audio stream, SPDIF format), realizing the normalization processing of different protocols. Subsequently, the audio processing unit inserts the converted uniform format audio stream into the video signal through an algorithm to generate a composite signal containing both video and audio data.

[0060] In this embodiment, through protocol identification, format conversion and signal embedding, both the high-definition audio characteristics of eARC and the unified processing of traditional ARC / SPDIF signals are compatible, and finally the audio backhaul function is realized by utilizing the redundant bandwidth of the video channel.

[0061] In one embodiment, the protocol identification unit is further configured to: when the backhauling audio signal is an ARC signal and an SPDIF signal, convert the ARC signal into an SPDIF format transcoding signal, and the audio processing unit is further configured to: merge and embed the transcoding signal and the SPDIF signal into a video frame to obtain a composite signal.

[0062] It should be noted that this technical solution realizes the unified processing of ARC (audio return signal) and SPDIF (digital audio signal) two signal formats in the audio backhaul process. The specific process is as follows: when the protocol identification unit of the receiving end detects that the audio signal backhauled by the target device contains both ARC signal (audio backhaul signal from HDMI interface) and SPDIF signal (digital audio from fiber or coaxial interface), the ARC signal is first converted into an SPDIF format transcoding signal; then, the audio processing unit merges and processes the newly generated SPDIF format transcoding signal and the original SPDIF signal to form a single digital audio stream; finally, the merged unified digital audio stream is embedded into the video frame being transmitted to generate a composite signal carrying both video and audio data.

[0063] In this embodiment, the processing flow of multiple types of audio backhaul is simplified through format conversion and signal merging, ensuring that audio from different sources can be efficiently integrated and backhauled through the same video channel.

[0064] In another embodiment, the audio return processing module comprises an audio extraction unit and a signal reconstruction unit, the audio extraction unit is configured to separate the decoupled signal from the composite signal, and the signal reconstruction unit is configured to reconstruct the audio signal from the decoupled signal.

[0065] It should be noted that the audio return processing module restores the audio signal through the cooperation of the audio extraction unit and the signal reconstruction unit. The specific process is as follows: when the sending end receives the composite signal (i.e., the video signal stream embedded with audio data transmitted through the network cable) from the receiving end, the audio extraction unit first locates and separates the embedded audio data from the composite signal to obtain the original digital audio stream (i.e., the decoupled signal) that has not been reconstructed; then, the signal reconstruction unit processes the decoupled signal - recovers its original timing structure through a decoding algorithm, and re-encapsulates the data format according to the target output requirements (such as eARC, HDMI-ARC or SPDIF specifications), and finally restores the complete audio signal that meets the interface standards of the signal source device.

[0066] In this embodiment, by separating the audio and video components in the composite signal and restoring the audio signal embedded in the video frame to an audio signal recognizable by the signal source device through decoding and signal reconstruction, the effect of high-quality reverse transmission of the audio signal is achieved.

[0067] In an embodiment, the network cable also supports transmission of control signals, wherein the control signals are used to establish a bidirectional control channel between the signal source device and the target device, so that the signal source device and the target device transmit control instructions and state information of the signal source device and the target device through the bidirectional control channel.

[0068] It should be noted that this technical solution uses the network cable to expand the control function while transmitting audio and video signals, realizing the bidirectional interaction between the signal source device (such as a player) and the target device (such as a television). Specifically, the network cable can transmit control signals on the basis of carrying audio and video data streams, and the control signals establish a bidirectional control channel (i.e., a data link that can simultaneously receive and transmit instructions) between the sending end and the receiving end. The signal source device can send control instructions to the target device (for example, a television remote control controls the volume of the television through the player), and at the same time, the target device can also return the state information (such as the on-off state, resolution parameter) of itself to the signal source device in real time. Exemplarily, the control signal can be a CEC (Consumer Electronics Control, Consumer Electronics Control) control signal, which is an auxiliary channel for eARC signal or ARC signal transmission. The signal source device and the target device need to communicate through the CEC control signal, and P82B715 can be used as a driving chip to transmit the CEC control signal.

[0069] In the embodiment, through the channel, the signal source device can send control instructions to the target device, and the target device can also return the state information to the signal source device in real time, so as to realize the cooperative control and state synchronization between the devices. The existing physical line is multiplexed to realize the bidirectional communication, the deployment of the additional control cable is avoided, and the hardware cost is reduced.

[0070] Based on the above-mentioned embodiments of the present application, in another embodiment of the present application, the same or similar contents as the above-mentioned embodiments can be referred to the above introduction, and the following will not be described in detail. On this basis, the present application proposes an audio and video signal extension method, which is applied to an audio and video signal extension device, comprising:

[0071] Receiving the audio signal returned by the target device at the receiving end, embedding the audio signal in the video frame to obtain a composite signal, and returning the composite signal to the sending end;

[0072] Receiving the composite signal at the sending end, extracting and reconstructing the audio signal from the composite signal, and outputting the audio signal to the signal source device.

[0073] It should be noted that when the target device returns the audio signal through the audio and video interface (such as the HDMI-ARC / eARC port) of the receiving end, the receiving end first embeds the audio signal in the video frame being transmitted to generate a composite signal carrying audio and video data at the same time; the composite signal is then returned to the sending end through the network cable. In the sending end, the audio processing module inside the sending end separates the embedded audio data (i.e. decouples the signal) from the composite signal, and then restores it to a complete audio signal conforming to the interface standard (such as HDMI-ARC or SPDIF format) of the signal source device through decoding and timing reconstruction technology (such as clock synchronization and data packaging), and finally outputs it to the signal source device (such as power amplifier or player) through the audio and video interface of the sending end.

[0074] In the embodiment, the network cable transmission channel is used to realize the reverse transmission of the audio signal by embedding the audio signal in the video frame, while maintaining the original signal quality.

[0075] In one embodiment, the audio and video signal extension method is applied to an audio and video signal extension device, further comprising:

[0076] Receiving the audio and video signal of the signal source device at the sending end, performing bandwidth compression and channel number conversion processing on the audio and video signal to obtain a compressed and converted signal, and sending the compressed and converted signal to the receiving end;

[0077] Receiving the compressed and converted signal at the receiving end, decompressing and restoring the channel number of the compressed and converted signal to obtain the audio and video signal, and outputting the audio and video signal to the target device.

[0078] It should be noted that the audio and video signal extension method realizes the forward extension transmission of the audio and video signal through the cooperation of the sending end and the receiving end: at the sending end, the audio and video signal output by the signal source device (such as a Blu-ray player or a game console) is compressed in bandwidth (reducing the amount of data required for transmission), and at the same time, the number of channels is converted to generate a compressed and converted signal; the compressed and converted signal is then transmitted to the receiving end through the network cable. At the receiving end, after receiving the compressed and converted signal, the reverse operation is performed synchronously: first, the original data amount is recovered by decompression, and then the number of channels is restored, and finally the audio and video signal consistent with the original audio and video signal output by the signal source device is reconstructed; the reconstructed audio and video signal is output to the target device through the receiving end, realizing the high-fidelity long-distance transmission of the audio and video signal.

[0079] In the present embodiment, the transmission limit of the compression and channel conversion is adapted to the network cable, and at the same time, the decompression and restoration ensure that the target device obtains the signal quality without loss.

[0080] It should be noted that the above examples are only used for understanding the present application and do not constitute a limitation on the audio and video signal extension method of the present application, and more forms of simple transformation based on this technical concept, such as interactive and combination of various embodiments, are within the protection scope of the present application.

[0081] The present application provides a computer readable storage medium having computer readable program instructions (i.e. computer programs) stored thereon, the computer readable program instructions being used to execute the audio and video signal extension method in the above-mentioned embodiments.

[0082] The computer readable storage medium provided by the present application may, for example, be a U disk, but is not limited to an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system or device, or any combination thereof. More specific examples of the computer readable storage medium can include, but are not limited to, an electric connection with one or more conductive wires, a portable computer disk, a hard disk, a random access memory (RAM), a read only memory (ROM), an erasable programmable read only memory (EPROM or flash memory), an optical fiber, a portable compact disk read only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present embodiment, the computer readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system or device. The program code contained on the computer readable storage medium can be transmitted in any suitable medium, including but not limited to an electric wire, an optical cable, an RF (Radio Frequency), and the like, or any suitable combination thereof.

[0083] Computer program code for carrying out operations of the present application can be written in one or more programming languages or combinations of languages including object oriented programming languages such as Java, Smalltalk, C++ or conventional procedural programming languages such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0084] The flow and block diagrams in the drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flow and block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustrations, and combinations thereof, can be implemented by special purpose hardware-based systems that perform the specified functions or operations, or combinations of special purpose hardware and computer instructions.

[0085] The modules involved in the embodiments of the present application can be implemented in the form of software or in the form of hardware. In some cases, the name of the module does not constitute a limitation on the unit itself.

[0086] The readable storage medium provided by the present application is a computer readable storage medium, which stores computer readable program instructions (i.e. computer program) for executing the above-mentioned audio / video signal extension method, and can solve the technical problems of reverse transmission, complex wiring, and difficulty in cooperating with forward transmission in the prior art. Compared with the prior art, the computer readable storage medium provided by the present application has the same beneficial effects as the audio / video signal extension method provided by the above-mentioned embodiments, which will not be repeated here.

[0087] The present application also provides a computer program product comprising a computer program, which, when executed by a processor, implements the steps of the above-mentioned audio / video signal extension method.

[0088] The computer program product provided by the present application can solve the technical problems of reverse transmission, complex wiring, and difficulty in cooperating with forward transmission in the prior art. Compared with the prior art, the computer program product provided by the present application has the same beneficial effects as the audio / video signal extension method provided by the above-mentioned embodiments, which will not be repeated here.

[0089] The above only describes some embodiments of the present application, and does not limit the patent scope of the present application, and any equivalent structural transformation made by using the content of the present application specification and drawings, or direct / indirect application in other related technical fields is included in the patent protection scope of the present application.

Claims

1. An audio / video signal extension device, characterized in that, include: The transmitter and receiver are connected via a network cable. The transmitting end includes: a first audio / video signal interface, a first network cable interface, and an audio return processing module; the receiving end includes: a second network cable interface, a second audio / video signal interface, and an audio acquisition module; when transmitting audio signals from the target device back to the signal source device: At the receiving end, the audio signal returned by the target device is received through the second audio and video signal interface. The audio signal is embedded into a low-resolution video frame through the audio acquisition module to obtain a composite signal. The audio acquisition module generates the low-resolution video frame and the composite signal is returned to the sending end through the second network cable interface. At the transmitting end, the composite signal is received through the first network cable interface, the audio signal is extracted and reconstructed from the composite signal through the audio return processing module, and the audio signal is output to the signal source device through the first audio and video signal interface.

2. The audio / video signal extension device as described in claim 1, characterized in that, The audio retransmission module includes a protocol identification unit and an audio processing unit. The protocol identification unit is used to: identify different audio signals and perform corresponding format conversions. If the audio signal is an eARC signal, it is converted to a first format; if the returned signal is an ARC signal or an SPDIF signal, it is converted to a second format. The audio processing unit is used to: embed the converted audio signal into a video frame to obtain a composite signal.

3. The audio / video signal extension device as described in claim 2, characterized in that, The protocol identification unit is further configured to: convert the ARC signal into a transcoded SPDIF signal when the returned audio signal is an ARC signal and an SPDIF signal; the audio processing unit is further configured to: merge the transcoded signal and the SPDIF signal and embed them into a video frame to obtain a composite signal.

4. The audio / video signal extension device as described in claim 1, characterized in that, The transmitting end further includes: a first processing module; the receiving end further includes: a second processing module; when transmitting audio and video signals from the signal source device to the target device: At the transmitting end, the audio and video signals of the signal source device are received through the first audio and video signal interface, and the first processing module performs bandwidth compression and channel number conversion processing on the audio and video signals to obtain a compressed and converted signal. The compressed and converted signal is then sent to the receiving end through the first network cable interface. At the receiving end, the compressed and converted signal is received through the second network cable interface, and the compressed and converted signal is decompressed and the number of channels is restored through the second processing module to obtain audio and video signals. The audio and video signals are then output to the target device through the second audio and video signal interface.

5. The audio / video signal extension device as described in claim 1, characterized in that, The audio return processing module includes an audio extraction unit and a signal reconstruction unit. The audio extraction unit is used to separate a decoupled signal from a composite signal, and the signal reconstruction unit is used to reconstruct the decoupled signal into an audio signal.

6. The apparatus as claimed in claim 1, characterized in that, The network cable also supports the transmission of control signals, wherein the control signals are used to establish a bidirectional control channel between the signal source device and the target device, so that the signal source device and the target device can transmit control commands and status information through the bidirectional control channel.

7. A method for extending audio and video signals, characterized in that, The audio / video signal extension method is applied to the audio / video signal extension device as described in claim 1, comprising: The receiving end receives the audio signal returned by the target device, embeds the audio signal into a low-resolution video frame to obtain a composite signal, wherein the receiving end generates the low-resolution video frame and returns the composite signal to the sending end. The transmitting end receives the composite signal, extracts and reconstructs the audio signal from the composite signal, and outputs the audio signal to the signal source device.

8. The audio / video signal extension method as described in claim 7, characterized in that, The audio / video signal extension method, when applied to the audio / video signal extension device as described in claim 1, further includes: The transmitting end receives the audio and video signals from the signal source device, performs bandwidth compression and channel number conversion on the audio and video signals to obtain a compressed and converted signal, and sends the compressed and converted signal to the receiving end. The receiving end receives the compressed conversion signal, decompresses and restores the number of channels of the compressed conversion signal to obtain audio and video signals, and outputs the audio and video signals to the target device.

9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the audio and video signal extension method as described in any one of claims 7 to 8.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the audio / video signal amplification method as described in any one of claims 7 to 8.

Images