Multimedia video system and protocol converter therefor

Abstract

The present application discloses a multimedia video system and a protocol converter thereof. The multimedia video system comprises a storage device, such as a TV set, and various video devices connected to the back of the storage device. The protocol converter is connected to the storage device. The protocol converter not only processes the audio and video signals from the specific video source and outputs the signals to the storage device for playing, but also converts the audio signals and outputs the converted audio signals to the audio output device connected to the protocol converter. Furthermore, the protocol converter can process the audio signals received from the storage device through the audio acquisition processing device, and output the processed audio signals to the audio acquisition processing device through the audio feedback channel or the enhanced audio feedback channel, and finally convert the audio signals into various audio output interfaces supported by the protocol converter.

Description

Technical Field

[0001] The specification proposes an audio-visual system, particularly a multimedia audio-visual system employing a protocol converter that supports an audio return channel. Background Technology

[0002] With the booming development of the multimedia industry, people's demands for audio-visual quality are increasing. Most audio-visual devices support multiple transmission interfaces for transmitting audio and video signals, such as DisplayPort (DP), HDMI, and WiFi, and support various high-quality image specifications, such as the increasingly widely adopted 4K, 5K, and 8K resolutions, allowing users to experience higher levels of viewing quality. As for audio, the widespread adoption of more audio formats and audio encoding technologies also provides users with a better listening experience.

[0003] Taking the High-Definition Multimedia Interface (HDMI) protocol as an example, a schematic diagram of the HDMI audio-visual system architecture can be found here. Figure 1 The diagram shows a block diagram of the HDMI protocol functions. The HDMI protocol defines a source device (11) and a sink device (13), which respectively implement the HDMI source device and the HDMI sink device in an audio-visual device. The source device is the device in the audio-visual system that receives external audio-visual signals, such as a set-top box, DVD player, or game console. The sink device is the device in the audio-visual system that receives and plays the audio-visual signals, such as a television and audio equipment.

[0004] At the source end 11, the transmitter (TX) 103 receives video 101 and audio 102 signals from the audio-visual source, converts them into audio-visual signals under the HDMI protocol, and then transmits them to the receiver (RX) 107 of the storage end 13 via multiple channels through wired or wireless communication. It also implements display data channel (DDC) and consumer electronics control (CEC) signals used to transmit various information under the HDMI protocol. After conversion and decoding of the audio-visual signals, the digital content to be broadcast is formed, such as video 105 and audio 106 as shown in the figure.

[0005] However, increasingly complex multimedia applications will mix various audio and video transmission protocols. Therefore, known technologies have proposed a product called a protocol converter (PCON), which can be easily used in audio and video environments with various audio and video interfaces. The purpose of the protocol converter is to convert the input audio and video transmission format before output, thus making the source and storage of different transmission interfaces compatible. It also allows users to flexibly connect transmitters with various transmission interfaces to terminal storage devices (such as TVs), successfully extending the scope and function of multimedia applications.

[0006] In addition, regarding the enhancement and improvement of audio application scenarios, under the High Definition Multimedia Interface (HDMI) protocol, HDMI-supported devices can also transmit audio signals from the storage end to the source end through its defined audio return channel (ARC) or enhanced audio return channel (eARC) technology, making audio transmission on multimedia audio-visual platforms more flexible.

[0007] The purpose of current protocol converters is to enable the transmission of audio and video signals between the source and storage terminals with different audio and video signal transmission interfaces, and to allow them to communicate with each other. For example, a DP-to-HDMI protocol converter receives the DP signal from the DP / Type-C source terminal, converts the signal to the HDMI transmission format, and then transmits the audio and video signal to the storage terminal through the HDMI transmitter (TX).

[0008] However, besides the conversion of audio and video transmission formats, the communication concepts between DP and HDMI devices are also different. The HDMI multimedia platform architecture is rooted at the receiver, and various HDMI devices can be connected as branches. Through the CEC mechanism in the HDMI protocol, it uses the CEC pin of the HDMI port to transmit single-wire bidirectional control signals. Users can control all connected HDMI devices with a single remote control, allowing each HDMI device to interact and achieve a linked control effect. However, the DP transmission interface does not have a similar concept. Therefore, the protocol converter also needs to use a technology called CEC over aux. The principle is to transfer the CEC control information received by the HDMI receiver (RX) into the DPCD (DisplayPort configuration data) under the DP protocol, and then transmit it to the DP / Type-C power source through the DP auxiliary line (aux) signal, so that the DP / Type-C power source device can be integrated into the entire HDMI multimedia platform architecture.

[0009] Known architectural examples can be referenced. Figure 2 The diagram illustrates a DP / Type-C power supply device 21 connected to an HDMI multimedia platform 25 via a protocol converter 23. The HDMI multimedia platform 25 is shown as the storage terminal in the system architecture. Solid lines represent video signals, and dashed lines represent audio signals. The HDMI multimedia platform 25 includes a storage device 251 (such as a television), which receives video and audio signals converted to the HDMI protocol from the protocol converter 23. It can also receive audio and video content from other devices within the platform, such as audio signals from HDMI source 1 255 received through an audio acquisition and processing device 253, which can then transmit the audio back to the audio acquisition and processing device 253 via an Audio Return Channel (ARC / eARC). Alternatively, it can directly receive audio and video content from HDMI source 2 259. The storage device 251 can also output audio signals to an external audio device 257 for playback.

[0010] However, based on the functions of the known protocol converters (PCONs) mentioned above, there are still some limitations. For example, the HDMI transmitter (TX) of the known protocol converter can only output audio and video signals and does not support the Audio Return Channel / Enhanced Audio Return Channel (ARC / eARC) function of the HDMI protocol. Its HDMI storage end can transmit audio signals back to the HDMI transmitter through the utility pin and hot-plug detect (HPD) pin of the HDMI port. Therefore, it cannot receive audio signal input from the HDMI storage end, which is equivalent to sacrificing the audio signal input signal source of the protocol converter itself.

[0011] Furthermore, because protocol converters focus on converting different audio and video transmission interfaces, such as... Figure 2 As shown in the example, the protocol converter 23 first parses the audio signal within the DP signal and converts it into audio data packets under the HDMI transmission protocol before passing it down to the HDMI storage device (storage device 251). Therefore, no additional encoding format conversion or processing is performed on the audio within the audio data packets. Furthermore, the audio data parsed from the DP signal can only be transmitted unidirectionally to the HDMI storage device, with no other audio output options. Consequently, if users require a higher quality listening experience, unless the connected HDMI storage device supports it, they will need to connect additional audio processing devices.

[0012] Based on the above two reasons, although... Figure 2 The DP / Type-C power supply device 21 can integrate the video portion into the HDMI multimedia platform architecture, but it cannot effectively integrate the audio transmission, increasing the burden on users in setting up the multimedia audio-visual platform and reducing the ease of use. Summary of the Invention

[0013] In view of the shortcomings of known protocol converters (PCONs) in being unable to handle audio inputs returned from HDMI storage terminals and being limited to unidirectional transmission to HDMI storage terminals without other audio output options, this disclosure proposes a multimedia audio-visual system and its protocol converter, wherein the protocol converter can not only handle audio signals input from specific audio-visual sources, but also handle audio signals returned from storage terminals in the multimedia audio-visual system, and then convert them into various audio transmission interface outputs.

[0014] According to one embodiment, the main components of the proposed multimedia audio-visual system are a storage device and a protocol converter. The protocol converter is connected to the storage device and includes an audio-visual receiver that receives audio-visual data. The video portion is transmitted to a video processor for encoding and decoding processing according to the video format. The processed video and audio are output to the storage device via an audio-visual transmitter. The system also includes an audio protocol processing unit that receives the audio portion of the audio-visual data from the audio-visual receiver, processes it, converts it to an audio format, and outputs it to a corresponding playback device, or to an audio output device connected to the protocol converter. Furthermore, this audio protocol processing unit also receives audio signals returned from the storage device via an audio transceiver circuit, processes them, and outputs them to the audio output device.

[0015] The protocol converter receives audio signals from the storage device via the Audio Return Channel (ARC) or Enhanced Audio Return Channel (eARC). Furthermore, in a multimedia audio-visual system, the storage device is connected to one or more audio-visual devices, which can serve as the audio-visual data source for the storage device and also form the audio signal output by the storage device to the protocol converter.

[0016] Preferably, the audio portion of the audio-visual data received by the protocol converter through the audio-visual receiver is in a first format audio, which is converted to a second format audio and then output to the storage device. Also, the audio signal received by the protocol converter from the storage device is in the second format audio.

[0017] Furthermore, the protocol converter is provided with at least one audio output interface. The output line is switched by an audio output multiplexing circuit to determine one of the audio output interfaces. The audio output interface can be one or more of an analog interface, a digital interface, and a wireless radio frequency interface.

[0018] To further understand the features and technical content of the present invention, please refer to the following detailed description and drawings of the present invention. However, the drawings provided are for reference and illustration only and are not intended to limit the present invention. Attached Figure Description

[0019] Figure 1Display HDMI protocol function block diagram;

[0020] Figure 2 This diagram illustrates a known architecture that integrates a DP / Type-C power supply device into an HDMI multimedia platform.

[0021] Figure 3 A schematic diagram showing a scenario of a multimedia audio-visual system using the protocol converter proposed in this disclosure;

[0022] Figure 4 This display shows a schematic diagram of an embodiment of a multimedia audio-visual system architecture proposed in this disclosure;

[0023] Figure 5 Block diagrams showing embodiments of the protocol converter; and

[0024] Figure 6 A block diagram illustrating an embodiment of the audio protocol conversion circuit in the display protocol converter. Detailed Implementation

[0025] The following specific embodiments illustrate the implementation of the present invention. Those skilled in the art can understand the advantages and effects of the present invention from the content disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and various details in this specification can also be modified and changed based on different viewpoints and applications without departing from the concept of the present invention. Furthermore, the accompanying drawings of the present invention are for simple illustrative purposes only and are not depictions of actual dimensions; this is stated beforehand. The following embodiments will further describe the relevant technical content of the present invention in detail, but the disclosed content is not intended to limit the scope of protection of the present invention.

[0026] It should be understood that while terms such as "first," "second," and "third" may be used in this document to describe various components or signals, these components or signals should not be limited by these terms. These terms are primarily used to distinguish one component from another, or one signal from another. Furthermore, the term "or" as used herein should, as appropriate, include any combination of one or more of the associated listed items.

[0027] To address the shortcomings and inconveniences of known protocol converters (PCONs) that only output audio and video signals and do not support HDMI protocol's Audio Return Channel / Enhanced Audio Return Channel (ARC / eARC) functions, and cannot handle audio input from HDMI storage devices (such as televisions) and can only transmit in one direction to the HDMI storage device, this disclosure proposes a multimedia audio and video system and its protocol converter. One of its main technical objectives is to enable the proposed protocol converter to have audio signal processing capabilities. Through technical improvements to the transmission interface, the originally simpler protocol converter can fully cooperate with the storage devices in the audio and video system in terms of both video and audio signals, without the need for additional external audio processing devices to process this part of the audio. This novel protocol converter can be integrated into multimedia audio and video systems that are mainly based on storage devices (such as televisions and audio and video playback devices), such as multimedia audio and video systems based on High Definition Multimedia Interface (HDMI).

[0028] Figure 3 This diagram illustrates a scenario in which a multimedia audio-visual system using the protocol converter proposed in this disclosure is applied.

[0029] The multimedia audio-visual system shown in the illustration includes an audio-visual playback device 32, such as a television set, which serves as the storage end device in the multimedia audio-visual system. This device receives audio-visual data transmitted from an audio-visual source 31 via a protocol converter 30. The audio-visual source 31 can be from a specific format transmission interface (such as DP / Type-C). The audio-visual data transmitted through this transmission interface can be converted by the protocol converter 30 into a transmission format supported by the storage end (such as HDMI). The audio-visual playback device 32 at the storage end can simultaneously connect to one or more audio-visual devices. The illustration shows a first audio-visual device 301 and a second audio-visual device 302. The illustration uses home audio-visual equipment as an example, such as a video game console or DVD player. The first audio-visual device 301 and the second audio-visual device 302 are various audio-visual sources in this multimedia audio-visual system, and also the audio-visual data sources for the storage device.

[0030] According to one embodiment, the audio / video playback device 32 at the storage terminal, as well as the first audio / video device 301 and the second audio / video device 302, can support a Consumer Electronics Control (CEC) function added to the High Definition Multimedia Interface (HDMI) standard. An HDMI-CEC compliant audio / video system can connect various HDMI-enabled audio / video devices via a specific type of connection cable (such as a cable with bidirectional communication). Thus, in this audio / video system, various HDMI-CEC compliant devices in the storage terminal can be controlled by a single remote control 305.

[0031] by Figure 3For example, under the HDMI-CEC specification, the user can operate the remote control 305 to operate the audio-visual playback device 32, and the generated control signal can be transmitted (such as a remote control pass-through command) to all devices connected to this audio-visual playback device 32, such as the first audio-visual device 301 and the second audio-visual device 302 shown in the figure, and can also be transmitted to the protocol converter 30 under the multimedia audio-visual system proposed in this disclosure.

[0032] According to the embodiment shown in the figure, in addition to converting the audio and video data input from the audio and video source 31 and transmitting it to the audio and video playback device 32, the protocol converter 30 can also process the audio signal returned to the protocol converter 30 by the audio playback device 32 through the audio return channel / enhanced audio return channel (ARC / eARC). Furthermore, the audio and video device connected to the storage device (i.e., the audio and video playback device 32) also forms the audio signal output from the storage device to the protocol converter 30. The audio signal input to the protocol converter 30 is converted and then output to the audio system 33 for playback through a specific output interface.

[0033] Figure 4 This diagram illustrates an embodiment of a multimedia audio-visual system architecture proposed in this disclosure. The main components of the multimedia audio-visual system include a protocol converter 403, a storage device 405, and various audio-visual devices connected to the storage device 405 within the system. Examples of such devices include a second-format audio-visual source 409, an audio output device (such as an external speaker and related equipment, headphones, etc.) 411, and a second-format audio-visual source 413. Furthermore, based on the proposed improved protocol converter 403's support for HDMI protocol Audio Return Channel / Enhanced Audio Return Channel (ARC / eARC) functionality, the protocol converter 403 can process audio signals returned from the storage device 405. Therefore, in this multimedia audio-visual system, the protocol converter 403 can directly output audio to various audio output devices. Unlike the audio output device 411 connected to the storage device 405, the audio output devices connected to the protocol converter 403 include, as shown, an audio / video receiver (AVR) 431, a wireless receiver 433, headphones 435, and a speaker system 437.

[0034] According to the embodiment shown, the multimedia audio-visual system receives audio-visual content in a first format from the first format audio-visual source 401, such as data in the DP / Type-C transmission format described in the above example, including audio and video in a specific format. The protocol converter 403 performs audio-visual format conversion on the received audio-visual data, such as converting it to HDMI format audio-visual data, and then transmits it to the storage device 405 for playback of the audio-visual content through the relevant audio-visual equipment.

[0035] On the other hand, in a multimedia audio-visual system, different audio-visual sources can be internally configured. For example, the second format audio-visual source 409 in the diagram can be connected to the storage device 405 via an HDMI cable (or wirelessly). Related audio signals can be input to the storage device 405 via the audio acquisition and processing device 407, or the storage device 405 itself can act as an audio signal source, inputting to the audio acquisition and processing device 407 via the audio return channel 415. On the other hand, the second format audio-visual source 413 in the diagram can be directly connected to the storage device 405 via an HDMI cable (or wirelessly), directly inputting audio-visual content to the storage device 405. The storage device 405 can output audio to an additional audio output device 411 for playback.

[0036] Specifically, the protocol converter 403 disclosed herein utilizes circuitry to support Audio Return Channel / Enhanced Audio Return Channel (ARC / eARC) functionality to process audio signals returned from the storage device 405. That is, in addition to receiving audio and video signals of the first format from the first format audio / video source 401 and converting them to the second format supported by the multimedia audio / video system primarily supported by the storage device 405, the protocol converter 403 can also receive audio signals returned from the storage device 405 via the audio return channel 417. Thus, the protocol converter 403 can perform encoding and decoding on the audio signals transmitted from the first format audio / video source 401 or the audio signals returned from the storage device 405, converting them into formats supported by various audio transmission interfaces, and then outputting them through one or more audio playback devices connected to the protocol converter 403. As shown in the illustration, the wired or wireless output devices supported by the protocol converter 403, such as the audio / video receiver 431 and the wireless receiver 433, may also include outputs from headphones 435 and speaker system 437 after digital-to-analog signal conversion.

[0037] According to the implementation example, the protocol converter 403 supports wired output formats such as I in audio playback devices. 2 Outputs include S (Inter-IC Sound), S / PDIF (Sony / Philips Digital Interface), and Line-Out analog audio signals; wireless output formats include Bluetooth. With wireless network Therefore, users will be able to more freely transmit various received audio formats to the corresponding audio playback device for playback through the protocol converter 403 in this multimedia audio-visual system.

[0038] Furthermore, the protocol converter 403 can also perform various post-processing on the audio signal, such as volume adjustment, noise reduction, and equalization, or encode and decode the received audio data. For example, if the received audio signal is a compressed audio format, such as AC3 (Audio Coding version 3), DTS (Digital Theater Systems), and MPEG (Moving Pictures Experts Group) audio encoding formats, and multi-channel or multi-stream types are also included, all of which can be directly decoded and restored or converted into any audio format for subsequent applications by the protocol converter 403 proposed in this disclosure.

[0039] Therefore, the proposed protocol converter 403 can directly process the received audio signal without the need for external audio processing devices or processing through specific devices in the system. It can also directly transmit the signal to various audio playback devices that interface with the protocol converter 403 for playback. This method can minimize sound delay and provide users with the most direct listening experience.

[0040] For the circuit system of implementing the aforementioned protocol converter, please refer to [reference needed]. Figure 5 The block diagram of the embodiment is shown.

[0041] The diagram shows a protocol converter 50 connected to the storage device 53 in the multimedia audio-visual system. After receiving audio-visual data from the first format audio-visual signal 51, it converts the format and outputs it to the storage device 53. The protocol converter 50 includes an audio-visual receiver 501, which separates the audio-visual data. The video portion is sent to a video processor 503 for encoding and decoding processing according to the video format, such as converting the input first format audio-visual data to the HDMI format supported by the multimedia audio-visual system, and then outputting it to the storage device 53 via an audio-visual transmitter 505. An audio protocol processing unit 500 is also provided. The audio portion received from the audio-visual receiver 501 is sent to the audio protocol processing unit 500 for audio signal encoding and decoding. After conversion to a specific audio format, it can be directly output from the protocol converter 50 to an audio output device connected to this protocol converter 50, such as the audio system 55 shown in the diagram, or output to the storage device 53 via the audio-visual transmitter 505. This audio-visual transmitter 505 is the connection interface between the protocol converter 50 and the storage device 53, and can be, for example, an HDMI transmission interface.

[0042] However, in particular, the protocol converter 50 can receive audio signals from the storage device 53 through the supported audio return channel 511 (which can be an audio return channel (ARC) or an enhanced audio return channel (eARC)), transmit them to the audio protocol processing unit 500 via the audio return receiving circuit 507, and then directly output them to the sound system 55 after being converted to a specific audio format. It can also transmit multiple channels to different speakers to achieve depth of field and surround sound effects.

[0043] The protocol converter 50 processes the audio signals to and from the protocol converter 500 through the audio protocol processing unit 500, as can be found in [reference]. Figure 6 A block diagram illustrating an embodiment of the audio protocol processing unit 500 is shown. The audio protocol processing unit 500 may be firmware or software executed within the circuitry of the protocol converter 50, or it may be an audio protocol conversion circuit. The embodiment shows that the audio protocol processing unit 500 includes an audio processing circuit 61 for processing audio signals input to the protocol converter and generating output audio. Specifically, it processes first-format audio 601 input from a first-format audio / video source, or second-format audio 602 transmitted back from a storage device in a multimedia audio / video system. In terms of the circuitry and its functions, it mainly consists of four parts, as described in the embodiment below.

[0044] The first part is the audio receiving and transmitting module, as shown in the figure, the audio receiving module 63 and the audio transmitting module 69. The audio receiving module 63 in the audio protocol processing unit 500 processes the two audio formats respectively. The figure shows the first audio receiver 631 and the second audio receiver 632 that receive audio signals of different formats. The main function is to receive the first format audio 601 (such as audio in DP / Type-C transmission format) and the second format audio 602 (such as audio data packets of HDMI eARC / ARC returned by the storage device). The audio receiving module 63 can decode the audio data packets of the first format audio 601 received by the first audio receiver 631 and the second format audio 602 received by the second audio receiver 632 to obtain the audio sampling data and audio information, such as sampling rate, number of sound channels and encoding format, and then perform audio transmission interface conversion and output audio signals through the audio transmitting module 69.

[0045] On the other hand, the second audio receiver 632 in the audio receiving module 63 receives second-format audio 602 transmitted from the storage device in the multimedia audio-visual system via the Audio Return Channel (eARC) or Enhanced Audio Return Channel (eARC). When processing this audio signal, a discovery and disconnection process is initially executed. According to one embodiment, if the audio receiving module 63 discovers that the connected storage device (HDMI Sink) supports eARC, the circuitry will switch to eARC reception mode. In eARC mode, the second audio receiver 632 can receive uncompressed audio data with a bandwidth of up to 36.864 Mbps (e.g., 8-channel 24-bit L-PCM with a 192 kHz sampling rate). If the audio receiving module 63 detects that it does not support Enhanced Audio Return Channel (eARC), it automatically downgrades to the normal audio return channel mode and simultaneously switches the circuit to the audio return channel mode. In this mode, the second audio receiver 632 can only receive uncompressed audio data with a bandwidth of up to 9.216 Mbps (e.g., a 2-channel 24-bit L-PCM audio signal with a sampling rate of 192 kHz). Regardless of whether it is the normal audio return channel or the enhanced audio return channel mode, just like processing the first format audio 601, the audio receiving module 63 also acquires the sound sampling data and related audio information for use by the subsequent audio transmission module 69.

[0046] According to the illustrated embodiment, the audio transmission module 69 includes an I2S signal generator 691 for outputting I2S signals 603, an SPDIF signal generator 692 for outputting SPDIF signals 604, a digital-to-analog converter 693 for converting digital signals into analog signals to output analog signals 605, and a wireless transmitter 694 for outputting radio frequency signals 606. Each of the different output signals corresponds to a different audio output device.

[0047] The second part is an audio input and output multiplexing module, such as the audio input multiplexing circuit 65 and the audio output multiplexing circuit 67 shown in the figure. Through the operation of multiplexers 651 and 671, the protocol converter can freely switch between different audio signal input sources and output various different audio transmission interfaces. In addition to switching audio signal transmission routes, the embodiment may include power switch, clock frequency switching and other functions of the protocol converter.

[0048] According to this embodiment, the audio input multiplexing circuit 65 can automatically or manually switch the input lines according to the source of the audio signal, including automatically judging the generated control signal or the signal generated by the manual switching switch, and deciding to switch to receive the first format audio 601 or the second format audio 602 output by the first audio receiver 631 or the second audio receiver 632, so that audio of different formats is input to the audio processing circuit 61 through the multiplexer 651 in the audio input multiplexing circuit 65. The protocol converter has at least one audio output interface. When the audio processing circuit 61 encodes or decodes the first or second format audio according to the output requirements, the output line can be switched by the multiplexer 671 according to the control signal received by the audio output multiplexing circuit 67 to determine one of the audio output interfaces. In this example, the audio output multiplexing circuit 67 is electrically connected to various signal generators in the audio transmission module 69, corresponding to various audio output interfaces. The audio output interface shown in this example is a digital interface of various audio formats (such as I2S, SPDIF, etc.), or an analog interface after digital-to-analog conversion, such as the output interface of a headphone or speaker system, or it can be converted into a wireless radio frequency interface such as Bluetooth communication and wireless network. It should be noted that the input and output audio transmission interfaces supported by the protocol converter proposed in this disclosure are not limited to the specifications listed in the above embodiments, and audio signals can be arbitrarily switched or simultaneously output to signal generators of various audio formats to achieve the purpose of flexibly converting audio transmission interfaces.

[0049] The third part is the audio processing circuit 61, which can be implemented in software, firmware, or hardware. It is the core of the audio protocol processing unit 500 and its purpose is to encode, decode, or perform various post-processing on the audio signal. According to the embodiment, the audio processing circuit 61 can compress L-PCM encoded audio signals into formats such as AC3, MPEG, DTS, or Dolby, or decompress them back to L-PCM format. The audio processing circuit 61 can also perform various digital audio signal processing, such as noise reduction, volume control, pop suppression, or equalizer adjustment of timbre. Afterward, it resamples and packages the audio signal into the target transmission interface format and sends the audio signal out through the transmission circuits of each transmission interface, or transmits it through the audio-visual transmitter 505. Figure 5 The storage device 53 is displayed. Furthermore, in a multimedia audio-visual system that supports HDMI CEC and DP Aux-to-CEC technologies, the audio processing circuit 61 also processes control signals under Consumer Electronics Control Protocol (CEC), such as control signals under HDMI CEC and DP Aux-to-CEC technologies.

[0050] The fourth part is the system behavior integration software and firmware, which can control the circuits and modules in the audio protocol processing unit 500 according to various multimedia application scenarios (such as theater, sports or human voice modes) to integrate and manage the software, firmware and circuit operation of the protocol converter, including decision-making, arbitration, interrupt handling and other behaviors, so that the protocol converter can realize a complete and comprehensive video and audio multimedia interface conversion device.

[0051] According to one embodiment, the firmware of the protocol converter is implemented by a memory and processor (such as audio processing circuit 61) block. The program is stored in the memory and executed by the processor to drive the protocol converter system. The control logic, parameter setting, arbitration judgment, power management, interrupt handling, time scheduling, etc. are implemented by the unit modules in the protocol converter described in the above embodiment.

[0052] In summary, the multimedia audio-visual system described in the above embodiments enhances the freedom of audio conversion and achieves better audio processing capabilities through its protocol converter. The protocol converter can be integrated into the HDMI-CEC function and DP AUX-to-CEC technology of the multimedia audio-visual system, enabling the protocol converter to connect all devices through the CEC function of the HDMI multimedia audio-visual platform. It is also compatible with the original protocol conversion system behavior, so that the multimedia audio-visual system can maintain compatibility while increasing the multimedia processing capabilities and application flexibility of the protocol converter, and ultimately integrate the entire protocol converter into a complete multimedia solution.

[0053] The content disclosed above is only a preferred and feasible embodiment of the present invention, and is not intended to limit the scope of the patent application of the present invention. Therefore, all equivalent technical changes made using the contents of the present invention specification and drawings are included in the scope of the patent application of the present invention.

[0054] Explanation of reference numerals in the attached figures

[0055] 11: Supply end

[0056] 101: Video

[0057] 102: Audio

[0058] 103: Teleporter

[0059] 13: Accumulation End

[0060] 105: Video

[0061] 106: Audio

[0062] 107: Receiver

[0063] 21:DP / Type-C power supply device

[0064] 23: Protocol Converter

[0065] 25: HDMI Multimedia Platform

[0066] 251: Accumulation device

[0067] 253: Audio Acquisition and Processing Device

[0068] 255: HDMI Source 1

[0069] 259: HDMI Source 2

[0070] 257: Audio devices

[0071] 31: Audio / Video Source

[0072] 30: Protocol Converter

[0073] 32: Audio-visual playback device

[0074] 33: Audio System

[0075] 301: First Audiovisual Unit

[0076] 302: Second Audio-Visual Device

[0077] 305: Remote Control

[0078] 401: First Format Audio / Video Source

[0079] 403: Protocol Converter

[0080] 405: Storage device

[0081] 407: Audio Acquisition and Processing Device

[0082] 409: Second format audio / video source 1

[0083] 411: Audio output device

[0084] 413: Second format audio and video source two

[0085] 431: Audio / Video Receiver

[0086] 433: Wireless Receiver

[0087] 435: Headphones

[0088] 437: Speaker System

[0089] 415, 417: Audio return channels

[0090] 50: Protocol Converter

[0091] 51: First format audio / video signal

[0092] 53: Storage device

[0093] 501: Audio / Video Receiver

[0094] 503: Video Processor

[0095] 505: Audio / Video Transmitter

[0096] 507: Audio Return Receiver Circuit

[0097] 500: Audio Protocol Processing Unit

[0098] 55: Audio System

[0099] 511: Audio Return Channel

[0100] 61: Audio processing circuit

[0101] 63: Audio receiving module

[0102] 601: First format audio

[0103] 602: Second Format Audio

[0104] 631: First Audio Receiver

[0105] 632: Second Audio Receiver

[0106] 65: Audio input multiplexing circuit

[0107] 651: Multiplexer

[0108] 67: Audio output multiplexing circuit

[0109] 671: Multiplexer

[0110] 69: Audio transmission module

[0111] 691: I2S signal generator

[0112] 692: SPDIF signal generator

[0113] 693: Digital-to-Analog Converter

[0114] 694: Wireless Transmitter

[0115] 603: I2S signal

[0116] 604: SPDIF signal

[0117] 605: Analog signal

[0118] 606: Radio Frequency Signal

Claims

1. A protocol converter, comprising: The audio / video receiver receives audio and video data, and the video portion is transmitted to the video processor for encoding and decoding processing according to the video format. The audio return receiving circuit is directly connected to the storage device; An audio protocol processing unit, connected to the audio receiver and the audio return transmission circuit, performs audio processing on the audio portion of the audio data received from the audio receiver, converting it into an audio format; and processes the audio signal received from the storage device via the audio return transmission circuit, outputting the processed audio signal to an audio output device connected to the protocol converter, wherein the audio portion is a first format audio and the audio signal is a second format audio; and The audio-visual transmitter outputs the encoded and decoded video portion and the processed audio portion to the storage device. The audio protocol processing unit includes: An audio receiving module includes a first audio receiver and a second audio receiver, which respectively process the first format audio and the second format audio; An audio input multiplexing circuit switches the input lines to determine whether to receive audio in the first or second format. An audio processing circuit is used to perform audio signal encoding and decoding, and to process control signals under a consumer electronics control protocol, wherein the audio input multiplexing circuit inputs the received first format audio or the second format audio to the audio processing circuit. An audio output multiplexing circuit, when the audio processing circuit encodes or decodes the first format audio or the second format audio, switches the output line to determine one of the audio output interfaces; and An audio transmission module is provided with multiple signal generators electrically connected to the audio output multiplexing circuit, wherein the multiple signal generators correspond to at least one audio output interface.

2. The protocol converter of claim 1, wherein the protocol converter receives the audio signal from the storage device via an audio return channel or an enhanced audio return channel.

3. The protocol converter as described in claim 1, wherein the audio receiving module decodes audio data packets of the first format audio received by the first audio receiver and the second format audio received by the second audio receiver to obtain audio sampling data, wherein the audio sampling data includes sampling rate, number of sound channels and encoding format, and after conversion by the audio transmission interface, the audio signal is output through the audio transmission module.

4. The protocol converter of claim 1, wherein the second audio receiver receives the second format audio transmitted back by the storage device via an audio return channel or an enhanced audio return channel, and performs a discovery and disconnection process to discover whether the storage device supports the enhanced audio return channel or does not support the enhanced audio return channel.

5. A multimedia audio-visual system, comprising: Storage device; as well as Protocol converter, connected to the storage device, wherein the protocol converter includes: The audio / video receiver receives audio and video data, and the video portion is transmitted to the video processor for encoding and decoding processing according to the video format. The audio return receiving circuit is directly connected to the storage device; An audio protocol processing unit, connected to the audio receiver and the audio return transmission circuit, performs audio processing on the audio portion of the audio data received from the audio receiver, converting it into an audio format; and processes the audio signal received from the storage device via the audio return transmission circuit, outputting the processed audio signal to an audio output device connected to the protocol converter, wherein the audio portion is a first format audio and the audio signal is a second format audio; and The audio-visual transmitter outputs the encoded and decoded video portion and the processed audio portion to the storage device. The audio protocol processing unit includes: An audio receiving module includes a first audio receiver and a second audio receiver, which respectively process the first format audio and the second format audio; An audio input multiplexing circuit switches the input lines to determine whether to receive audio in the first or second format. An audio processing circuit is used to perform audio signal encoding and decoding, and to process control signals under a consumer electronics control protocol, wherein the audio input multiplexing circuit inputs the received first format audio or the second format audio to the audio processing circuit. An audio output multiplexing circuit, when the audio processing circuit encodes or decodes the first format audio or the second format audio, switches the output line to determine one of the audio output interfaces; and An audio transmission module is provided with multiple signal generators electrically connected to the audio output multiplexing circuit, wherein the multiple signal generators correspond to at least one audio output interface.

Images