A system and method for synchronous transmission of audio and video via HDMI interface

Abstract

The present invention discloses a system and method for synchronous audio and video transmission of an HDMI interface, and specifically relates to the field of transmission technology. The system and method include an interface device configuration and identification module, an audio and video data acquisition module, an audio quality evaluation module, a video quality evaluation module, an audio and video optimization processing module, and an audio and video synchronization accuracy analysis module. The system acquires audio and video signals of ultra-high-definition video through an audio acquisition circuit and a video acquisition chip, and comprehensively evaluates the audio and video quality based on frequency response deviation, dynamic range, clarity, dynamic contrast, and color reproduction indicators. The system optimizes audio or video frames of poor quality through an audio optimization unit and an ultra-high-definition video rendering unit, thereby improving audio and video quality, enhancing the expression of video picture details, and enhancing user experience. Based on the optimized ultra-high-definition video, the system evaluates the audio and video transmission synchronization accuracy through inter-frame delay and audio delay, thereby achieving audio and video synchronous transmission.

Description

Technical Field

[0001] The present invention relates to the field of transmission technology, and more particularly to a system and method for synchronously transmitting audio and video via an HDMI interface. Background Art

[0002] Audio and video signals must maintain precise time synchronization. The human auditory and visual synchronization threshold is limited to a specific time difference range. Beyond this range, viewers may notice a noticeable delay or misalignment. Therefore, using a single HDMI cable can simultaneously transmit video, audio, and control signals, thus standardizing and ensuring audio and video synchronization.

[0003] With the development of technologies such as ultra-high-definition display and immersive audio, HDMI technology has become a standard interface in the field of audio and video transmission. It can simultaneously transmit uncompressed video data and compressed or uncompressed audio data, and realize the transmission of high-definition multimedia content through a single cable. It is widely used in TVs, computers, projectors, game consoles and other devices.

[0004] However, it still has some shortcomings in actual use. For example, when the playback device receives video and audio signals through HDMI, the synchronous transmission may cause high latency due to long cables, insufficient device decoding performance, or format mismatch, affecting the user's audio-visual experience.

[0005] Existing audio and video synchronization transmission technology faces challenges in maintaining synchronization when processing audio and video signals, especially in complex multi-device connection environments and specific application scenarios, such as high-definition game live streaming and professional film and television production, which have higher requirements for the accuracy and stability of audio and video synchronization. Existing HDMI interface audio and video synchronization transmission systems often cannot meet these requirements. Summary of the Invention

[0006] In order to overcome the above-mentioned defects of the prior art, the embodiments of the present invention provide a system and method for synchronous transmission of audio and video via an HDMI interface, which are used to solve the problems raised in the above-mentioned background technology.

[0007] To achieve the above object, the present invention provides the following technical solution: an audio and video synchronous transmission system of an HDMI interface, comprising:

[0008] Interface device configuration and identification module: used to automatically identify the various parameters of the connected device when the audio and video signal source is connected to the playback device through the HDMI interface, and complete the optimal audio and video synchronous transmission configuration.

[0009] Audio and video data acquisition module: used to collect the audio signal of ultra-high-definition video through the audio acquisition circuit, and to collect the video signal of ultra-high-definition video from the Blu-ray player through the video acquisition chip.

[0010] Audio quality assessment module: used to comprehensively evaluate the frequency response deviation and dynamic range of video frame images, evaluate the audio quality of each video frame image in ultra-high-definition video, and send audio signals with poor audio quality in video frame images in ultra-high-definition video to the audio and video optimization processing module for optimization.

[0011] Video quality assessment module: used to combine the clarity, dynamic contrast and color reproduction of video frame images to evaluate the video quality of each video frame image of ultra-high-definition video, and send video frames with low video quality in ultra-high-definition video to the audio and video optimization processing module for optimization.

[0012] Audio and video optimization processing module: includes an audio optimization unit and an ultra-high-definition video rendering unit. The audio optimization unit decodes multi-channel audio and optimizes and enhances the decoded audio signal. The ultra-high-definition video rendering unit renders video frames with low video quality in ultra-high-definition video with high quality and intelligently adapts the video frame rate according to the frame rate supported by the connected device.

[0013] Audio and video synchronization accuracy analysis module: Based on the optimized ultra-high-definition video, the audio and video transmission synchronization accuracy of the optimized ultra-high-definition video is evaluated through the inter-frame delay and audio delay of the optimized video frame images.

[0014] Preferably, the specific analysis process of the audio and video data acquisition module is:

[0015] The audio signal of the ultra-high-definition video is collected through the audio acquisition circuit. After the audio signal is collected, the difference between the transmitted audio signal and the original audio signal in each frequency band response is quantified by traversing each element of the time-frequency matrix of the original audio signal and the transmitted audio signal to obtain the frequency response deviation of the audio signal. ;

[0016] By setting a suitable test signal in the audio acquisition circuit, gradually increase the signal amplitude until the audio output is distorted, record the signal voltage at this time as the maximum undistorted signal voltage, measure the noise voltage of the audio output in the absence of an input signal, quantify the intensity difference between the maximum undistorted signal voltage and the noise voltage, and obtain the dynamic range of the audio signal. ;

[0017] The video signal of ultra-high-definition video is collected from the Blu-ray player through the video capture chip. The video signal is the clarity, dynamic contrast and color reproduction of the video frame image.

[0018] Preferably, the specific analysis process of the audio quality evaluation module is:

[0019] Extract the frequency response deviation and dynamic range of the audio signal of the video frame image, and comprehensively integrate the frequency response deviation and dynamic range to construct the audio sound quality evaluation index of each video frame image of the ultra-high-definition video;

[0020] The audio quality evaluation index of each video frame image of the ultra-high-definition video is obtained and compared with the preset audio quality evaluation index. If the audio quality evaluation index of a video frame image of the ultra-high-definition video is less than the preset audio quality evaluation index, it indicates that the audio quality of the video frame image is poor. The audio signals in the video frame images with poor audio quality are counted, and the audio signals with poor audio quality of the video frame images in the ultra-high-definition video are sent to the audio and video optimization processing module for optimization. Otherwise, it indicates that the audio quality of the video frame image is pure.

[0021] Preferably, the specific analysis process of the video quality assessment module is:

[0022] S41: extracting the clarity, dynamic contrast, and color reproduction of each video frame image, using the clarity of each video frame image as the first indicator for image quality evaluation, obtaining the clarity of each video frame image and comparing it with the standard clarity. If the clarity of the video frame image is lower than the standard clarity, it indicates that the video quality of the video frame image is low, and the video frame image with low video quality in the ultra-high-definition video is sent to the audio and video optimization processing module for optimization. Otherwise, it indicates that the video quality of the video frame image is good.

[0023] S42: constructing a video quality evaluation index for each frame image of the ultra-high-definition video by comprehensively analyzing the dynamic contrast and color reproduction of the video frame image;

[0024] S43: Obtain a video quality evaluation index for each video frame image of the ultra-high-definition video, and compare the index with a preset video quality evaluation index. If the video quality evaluation index of a video frame image of the ultra-high-definition video is less than the preset video quality evaluation index, it indicates that the video quality of the video frame image is low, and the video frame with low video quality in the ultra-high-definition video is sent to the audio and video optimization processing module for optimization. Otherwise, it indicates that the video quality of the video frame image is good.

[0025] Preferably, the specific analysis process of the audio optimization unit is:

[0026] receiving an audio signal with poor audio quality sent by the audio quality evaluation module, decoding the audio signal into audio data of multiple channels, and eliminating noise and distortion in the decoding process;

[0027] Optimize and enhance the decoded audio data of multiple channels separately, obtain the dynamic range of each channel, amplify weak signals in the audio within the dynamic range, and control strong signals at the same time;

[0028] The optimized audio data of multiple channels is re-encoded into an audio signal and output to an HDMI interface for connection to a playback device.

[0029] Preferably, the specific analysis process of the ultra-high-definition video rendering unit is:

[0030] receiving a video frame with low video quality sent by the video quality assessment module, decoding the video frame, and obtaining original image data of the video frame;

[0031] Performing image enhancement processing on the image data of the decoded video frame, the image enhancement processing including but not limited to sharpening processing, color enhancement processing, and contrast enhancement processing;

[0032] Adapt the image data of the decoded video frames according to the resolution and frame rate supported by the connected device, and adjust the resolution and frame rate of the video frames to match the display capabilities of the playback device.

[0033] Preferably, the specific analysis process of the audio and video synchronization accuracy analysis module is:

[0034] S71: Obtain the optimized ultra-high-definition video, transmit it to a playback device through an HDMI interface, and obtain an inter-frame delay of the video frame images based on the difference between the sending and receiving times of the video frame images of the optimized ultra-high-definition video;

[0035] S72: Obtain the optimized ultra-high-definition video, transmit it to the playback device through the HDMI interface, and obtain the audio delay of the audio signal in the video frame image based on the difference between the sending and receiving times of the audio signal in the video frame image of the optimized ultra-high-definition video;

[0036] S73: Sum the inter-frame delay and audio delay of each optimized video frame image respectively to obtain the total inter-frame delay and total audio delay of the optimized ultra-high-definition video, and set the audio and video transmission synchronization accuracy threshold. If the optimized ultra-high-definition video has |total audio delay - total inter-frame delay| Setting the audio and video transmission synchronization accuracy threshold indicates that the audio and video transmission synchronization accuracy error of the optimized ultra-high-definition video is small. Conversely, it indicates that the audio and video transmission synchronization accuracy error of the optimized ultra-high-definition video is large, and the audio and video playback progress is adjusted according to the error.

[0037] Preferably, a method for synchronously transmitting audio and video via an HDMI interface comprises the following steps:

[0038] Step S01: Interface device configuration and identification: when the audio and video signal source is connected to the playback device via the HDMI interface, the device parameters are automatically identified and the optimal audio and video synchronous transmission configuration is completed;

[0039] Step S02: Audio and video data acquisition: used to acquire the audio signal of the ultra-high-definition video through the audio acquisition circuit, and acquire the video signal of the ultra-high-definition video from the Blu-ray player through the video acquisition chip;

[0040] Step S03: Audio quality assessment: Comprehensively assess the frequency response deviation and dynamic range of the video frame image, evaluate the audio quality of each video frame image of the ultra-high-definition video, and send the audio signals of the video frame images in the ultra-high-definition video with poor audio quality to the audio and video optimization processing step for optimization;

[0041] Step S04: Video quality evaluation: The clarity, dynamic contrast, and color reproduction of the video frame images are combined to evaluate the video quality of each video frame image of the ultra-high-definition video, and the video frames with low video quality in the ultra-high-definition video are sent to the audio and video optimization processing step for optimization;

[0042] Step S05: Audio and video optimization processing: including an audio optimization sub-step and an ultra-high-definition video rendering sub-step. The audio optimization sub-step decodes the multi-channel audio and optimizes and enhances the decoded audio signal. The ultra-high-definition video rendering sub-step renders low-quality video frames in the ultra-high-definition video with high quality and intelligently adapts the video frame rate according to the frame rate supported by the connected device.

[0043] Step S06: Audio and video synchronization accuracy analysis: Based on the optimized ultra-high-definition video, the audio and video transmission synchronization accuracy of the optimized ultra-high-definition video is evaluated through the optimized inter-frame delay and audio delay of the video frame image.

[0044] Technical effects and advantages of the present invention:

[0045] The present invention provides an audio and video synchronous transmission system and method for an HDMI interface, which collects audio signals of ultra-high-definition video through an audio acquisition circuit, comprehensively evaluates the frequency response deviation and dynamic range of video frame images, evaluates the audio quality of each video frame image of the ultra-high-definition video, decodes multi-channel audio through an audio optimization unit for audio signals with poor audio quality of video frame images in the ultra-high-definition video, and optimizes and enhances the decoded audio signals; collects video signals of ultra-high-definition video from a Blu-ray player through a video acquisition chip, combines the clarity, dynamic contrast, and color reproduction of the video frame images, evaluates the video quality of each video frame image of the ultra-high-definition video, and optimizes and enhances the audio signals after decoding; The low-quality video frames of the image are sent to the ultra-high-definition video rendering unit, which performs high-quality rendering on the low-quality video frames in the ultra-high-definition video. The video frame rate is intelligently adapted according to the frame rate supported by the connected device. The video acquisition chip helps to ensure that every frame of the video image can be completely and accurately acquired. The audio acquisition circuit helps to accurately capture audio details and ensure audio quality. Through multi-dimensional precise evaluation, problems are located and processed in a timely manner according to the evaluation results, thereby improving the audio quality of ultra-high-definition video. By optimizing and enhancing the audio signal and rendering the video image with high quality, it is beneficial to improve the audio and video quality, enhance the performance of video image details, and enhance the user experience.

[0046] The present invention provides an audio and video synchronous transmission system and method for an HDMI interface. Based on optimized ultra-high-definition video, the system compares the total inter-frame delay and total audio delay of the optimized ultra-high-definition video with a set audio and video transmission synchronization accuracy threshold through the optimized inter-frame delay and audio delay of video frame images, evaluates the audio and video transmission synchronization accuracy of the optimized ultra-high-definition video, and demonstrates the audio and video synchronization accuracy of the optimized ultra-high-definition video through the evaluation of image quality and audio quality delay, thereby providing users with a stable and synchronized audio and video experience and achieving more efficient, stable and accurate audio and video synchronous transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 The present invention is a structural diagram of an audio and video synchronous transmission system of an HDMI interface.

[0048] Figure 2 The present invention is a flowchart of a method for synchronously transmitting audio and video via an HDMI interface. DETAILED DESCRIPTION

[0049] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0050] See also Figure 1 As shown, the present invention provides an audio and video synchronous transmission system of an HDMI interface, including an interface device configuration and identification module, an audio and video data acquisition module, an audio quality evaluation module, a video quality evaluation module, an audio and video optimization processing module, and an audio and video synchronization accuracy analysis module.

[0051] The interface device configuration and identification module is connected to the audio and video data acquisition module, the audio and video data acquisition module is connected to the audio quality assessment module and the video quality assessment module, the audio quality assessment module and the video quality assessment module are connected to the audio and video optimization processing module, and the audio and video optimization processing module is connected to the audio and video synchronization accuracy analysis module.

[0052] The interface device configuration and identification module is used to automatically identify various parameters of the connected device when the audio and video signal source is connected to the playback device through the HDMI interface, and complete the optimal audio and video synchronous transmission configuration; thereby improving the convenience of user operation.

[0053] In this embodiment, it should be specifically explained that the interface device configuration and identification module is as follows:

[0054] Taking the connection between a TV and a Blu-ray player as an example, after automatically identifying the parameters of the TV and Blu-ray player, the transmission mode is adjusted to the highest resolution supported by the TV and the optimal audio and video format output by the Blu-ray player, achieving seamless docking without the user having to manually perform tedious settings in the device menu. The parameters include but are not limited to supported audio and video formats, resolution, refresh rate, and number of audio channels.

[0055] The audio and video data acquisition module is used to collect the audio signal of the ultra-high-definition video through the audio acquisition circuit, and to collect the video signal of the ultra-high-definition video from the Blu-ray player through the video acquisition chip. The video acquisition chip is conducive to ensuring that every frame of the video image can be obtained completely and accurately, and the audio acquisition circuit is conducive to accurately capturing audio details and ensuring audio quality.

[0056] In one possible design, the specific analysis process of the audio and video data acquisition module is as follows:

[0057] The audio signal of the ultra-high-definition video is collected through the audio acquisition circuit. After the audio signal is collected, the difference between the transmitted audio signal and the original audio signal in each frequency band response is quantified by traversing each element of the time-frequency matrix of the original audio signal and the transmitted audio signal to obtain the frequency response deviation of the audio signal. ;

[0058] By setting a suitable test signal in the audio acquisition circuit, gradually increase the signal amplitude until the audio output is distorted, record the signal voltage at this time as the maximum undistorted signal voltage, measure the noise voltage of the audio output in the absence of an input signal, quantify the intensity difference between the maximum undistorted signal voltage and the noise voltage, and obtain the dynamic range of the audio signal. ;

[0059] The video capture chip is used to capture the video signal of ultra-high-definition video from the Blu-ray player. The video signal is the clarity, dynamic contrast, and color reproduction of the video frame image, which are marked as 、 、 , where i=1,2,...n, i represents the number of the i-th video frame image.

[0060] In this embodiment, it should be specifically explained that the specific analysis method of the video signal is:

[0061] Construct a clarity evaluation model based on perceptual quantization and define the clarity quantization value of each video frame image in ultra-high-definition video:

[0062] in, Represented as the clarity of the i-th video frame image, Represented as the grayscale value of the jth pixel in the i-th video frame image, Represented as the average grayscale value of the i-th video frame image, It is a very small positive number to avoid the denominator being zero, m is the number of pixels in the video frame image, Expressed as the weight coefficient of the j-th pixel, The value is a weight coefficient determined according to the characteristics of the human visual system, reflecting the sensitivity of the human eye to pixels at different positions;

[0063] The difference in pixel grayscale values ​​of each frame of ultra-high-definition video is combined with the sensitivity of the human eye to evaluate the difference in the human eye's perception of image details;

[0064] Construct an evaluation model that reflects the brightness and darkness changes of video frame images and define the dynamic contrast quantization value of each video frame image of ultra-high-definition video:

[0065]

[0066] in, Expressed as the dynamic contrast of the i-th video frame image, Represented as the maximum brightness value of the i-th video frame image, Represented as the minimum brightness value of the i-th video frame image;

[0067] Dynamic contrast can directly reflect the changes in brightness and darkness of the frame image. The larger the value, the richer the transition levels from darkest to brightest, and the better the details of the video image.

[0068] Construct a color reproduction evaluation model based on color difference and define the color reproduction quantification value of each video frame image of ultra-high-definition video:

[0069] in, It is expressed as the color restoration degree of the i-th video frame image, Represented as the brightness value of the jth pixel in the i-th video frame image, Represented as the red and green axis channels of the jth pixel of the i-th video frame image, Represented as the yellow-blue axis channel of the j-th pixel of the i-th video frame image, Represented as the brightness value of the jth pixel in the original image, Represented as the red and green axis channels of the j-th pixel of the original image, Represented as the yellow-blue axis channel of the j-th pixel of the original image;

[0070] Color reproduction reflects the human eye's perception of color differences. The smaller the value, the smaller the color difference between the transmitted video image and the original video image, and the more accurate the color reproduction.

[0071] The audio quality assessment module is used to receive the audio signal transmitted by the video data acquisition module, comprehensively evaluate the frequency response deviation and dynamic range of the video frame image, evaluate the audio quality of each video frame image of the ultra-high-definition video, and send the audio signal of the video frame image in the ultra-high-definition video with poor audio quality to the audio and video optimization processing module for optimization; through multi-dimensional precise evaluation, the problem is located and processed in a timely manner according to the evaluation results, thereby improving the audio quality of the ultra-high-definition video.

[0072] In one possible design, the specific analysis process of the audio quality assessment module is as follows:

[0073] Extract the frequency response deviation and dynamic range of the audio signal of the video frame image, and comprehensively integrate the frequency response deviation and dynamic range to construct the audio sound quality evaluation index of each video frame image of the ultra-high-definition video;

[0074] The audio quality evaluation index of each video frame image of the ultra-high-definition video is obtained and compared with the preset audio quality evaluation index. If the audio quality evaluation index of a video frame image of the ultra-high-definition video is less than the preset audio quality evaluation index, it indicates that the audio quality of the video frame image is poor. The audio signals in the video frame images with poor audio quality are counted, and the audio signals with poor audio quality of the video frame images in the ultra-high-definition video are sent to the audio and video optimization processing module for optimization. Otherwise, it indicates that the audio quality of the video frame image is pure.

[0075] In this embodiment, it should be specifically explained that the calculation formula for the audio quality evaluation index of each video frame image is:

[0076]

[0077] in, It is represented as the audio quality evaluation index of the i-th video frame image, Expressed as the frequency response deviation of the i-th video frame image, Represented as the dynamic range of the i-th video frame image;

[0078] Specifically, the larger the frequency response deviation, the greater the difference between the transmitted audio signal and the original audio signal in the frequency band response, and the more obvious the sound quality degradation. Conversely, the closer the value is to zero;

[0079] The larger the dynamic range, the wider the range of volume changes that the audio signal can carry, and the clearer the sound quality.

[0080] The video quality assessment module is used to receive the video signal transmitted by the video data acquisition module, combine the clarity, dynamic contrast and color reproduction of the video frame image, evaluate the video quality of each video frame image of the ultra-high-definition video, and send the video frames with low video quality in the ultra-high-definition video to the audio and video optimization processing module for optimization; through comprehensive and accurate evaluation, the video quality is comprehensively considered to quickly locate image quality problems and perform targeted optimization, effectively improve the overall image quality of the ultra-high-definition video, and enhance the user viewing experience.

[0081] In one possible design, the specific analysis process of the video quality assessment module is as follows:

[0082] S01: extracting the clarity, dynamic contrast, and color reproduction of each video frame image, using the clarity of each video frame image as the first indicator for image quality evaluation, obtaining the clarity of each video frame image and comparing it with the standard clarity. If the clarity of the video frame image is lower than the standard clarity, it indicates that the video quality of the video frame image is low, and the video frame image with low video quality in the ultra-high-definition video is sent to the audio and video optimization processing module for optimization. Otherwise, it indicates that the video quality of the video frame image is good.

[0083] S02: Build a video quality evaluation index for each frame of the ultra-high-definition video by comprehensively analyzing the dynamic contrast and color reproduction of the video frame image;

[0084] S03: Obtain the video quality evaluation index of each video frame image of the ultra-high-definition video, and compare it with the preset video quality evaluation index. If the video quality evaluation index of a video frame image of the ultra-high-definition video is less than the preset video quality evaluation index, it indicates that the video quality of the video frame image is low, and the video frame with low video quality in the ultra-high-definition video is sent to the audio and video optimization processing module for optimization. Otherwise, it indicates that the video quality of the video frame image is good.

[0085] In this embodiment, it should be specifically explained that the calculation formula for the video quality evaluation index of each video frame image is:

[0086] in, It is represented as the video quality evaluation index of the i-th video frame image, It is expressed as the color restoration degree of the i-th video frame image, It is represented as the dynamic contrast of the i-th video frame image.

[0087] The audio and video optimization processing module includes an audio optimization unit and an ultra-high-definition video rendering unit. The audio optimization unit decodes multi-channel audio and optimizes and enhances the decoded audio signal. The ultra-high-definition video rendering unit renders video frames with low video quality in ultra-high-definition video with high quality and intelligently adapts the video frame rate according to the frame rate supported by the connected device. By optimizing and enhancing the audio signal and rendering the video picture with high quality, it is beneficial to improve the audio and video quality, enhance the video picture detail performance, and improve the user experience.

[0088] In one possible design, the specific analysis process of the audio and video optimization processing module is as follows:

[0089] Audio Optimization Unit:

[0090] receiving an audio signal with poor audio quality sent by the audio quality evaluation module, decoding the audio signal into audio data of multiple channels, and eliminating noise and distortion in the decoding process;

[0091] Optimize and enhance the decoded audio data of multiple channels separately, obtain the dynamic range of each channel, amplify weak signals in the audio within the dynamic range, and control strong signals at the same time;

[0092] Re-encode the optimized audio data of multiple channels into audio signals and output them to the HDMI interface for connection to playback devices;

[0093] Ultra-high-definition video rendering unit:

[0094] receiving a video frame with low video quality sent by the video quality assessment module, decoding the video frame, and obtaining original image data of the video frame;

[0095] Performing image enhancement processing on the image data of the decoded video frame, the image enhancement processing including but not limited to sharpening processing, color enhancement processing, and contrast enhancement processing;

[0096] Adapt the image data of the decoded video frames according to the resolution and frame rate supported by the connected device, and adjust the resolution and frame rate of the video frames to match the display capabilities of the playback device.

[0097] The audio and video synchronization accuracy analysis module: based on the optimized ultra-high-definition video, evaluates the audio and video transmission synchronization accuracy of the optimized ultra-high-definition video through the inter-frame delay and audio delay of the optimized video frame image; through the evaluation of image quality and sound quality delay, it can demonstrate the synchronization accuracy of the audio and video of the optimized ultra-high-definition video, thereby providing users with a stable and synchronized audio and video experience.

[0098] In one possible design, the specific analysis process of the audio and video synchronization accuracy analysis module is as follows:

[0099] S01: Obtain an optimized ultra-high-definition video, transmit it to a playback device through an HDMI interface, and obtain an inter-frame delay of the video frame image based on the difference between the sending and receiving times of the video frame image of the optimized ultra-high-definition video;

[0100] S02: Obtaining the optimized ultra-high-definition video, transmitting it to a playback device through an HDMI interface, and obtaining an audio delay of the audio signal in the video frame image based on the difference between the sending and receiving times of the audio signal in the video frame image of the optimized ultra-high-definition video;

[0101] S03: Sum the inter-frame delay and audio delay of each optimized video frame image respectively to obtain the total inter-frame delay and total audio delay of the optimized ultra-high-definition video, and set the audio and video transmission synchronization accuracy threshold. If the optimized ultra-high-definition video |total audio delay - total inter-frame delay| Setting the audio and video transmission synchronization accuracy threshold indicates that the audio and video transmission synchronization accuracy error of the optimized ultra-high-definition video is small. Conversely, it indicates that the audio and video transmission synchronization accuracy error of the optimized ultra-high-definition video is large, and the audio and video playback progress is adjusted according to the error.

[0102] See also Figure 2As shown, the present invention provides an audio and video synchronous transmission method of an HDMI interface, comprising the following steps:

[0103] Step S01: Interface device configuration and identification: when the audio and video signal source is connected to the playback device via the HDMI interface, the device parameters are automatically identified and the optimal audio and video synchronous transmission configuration is completed;

[0104] Step S02: Audio and video data acquisition: used to acquire the audio signal of the ultra-high-definition video through the audio acquisition circuit, and acquire the video signal of the ultra-high-definition video from the Blu-ray player through the video acquisition chip;

[0105] Step S03: Audio quality assessment: Comprehensively assess the frequency response deviation and dynamic range of the video frame image, evaluate the audio quality of each video frame image of the ultra-high-definition video, and send the audio signals of the video frame images in the ultra-high-definition video with poor audio quality to the audio and video optimization processing step for optimization;

[0106] Step S04: Video quality evaluation: The clarity, dynamic contrast, and color reproduction of the video frame images are combined to evaluate the video quality of each video frame image of the ultra-high-definition video, and the video frames with low video quality in the ultra-high-definition video are sent to the audio and video optimization processing step for optimization;

[0107] Step S05: Audio and video optimization processing: including an audio optimization sub-step and an ultra-high-definition video rendering sub-step. The audio optimization sub-step decodes the multi-channel audio and optimizes and enhances the decoded audio signal. The ultra-high-definition video rendering sub-step renders low-quality video frames in the ultra-high-definition video with high quality and intelligently adapts the video frame rate according to the frame rate supported by the connected device.

[0108] Step S06: Audio and video synchronization accuracy analysis: Based on the optimized ultra-high-definition video, the audio and video transmission synchronization accuracy of the optimized ultra-high-definition video is evaluated through the optimized inter-frame delay and audio delay of the video frame image.

[0109] In this embodiment, it should be specifically explained that the present invention collects the audio signal of the ultra-high-definition video through the audio acquisition circuit, comprehensively evaluates the frequency response deviation and dynamic range of the video frame image, evaluates the audio quality of each video frame image of the ultra-high-definition video, decodes the multi-channel audio of the audio signal with poor audio quality of the video frame image in the ultra-high-definition video through the audio optimization unit, and optimizes and enhances the decoded audio signal; collects the video signal of the ultra-high-definition video from the Blu-ray player through the video acquisition chip, combines the clarity, dynamic contrast and color reproduction of the video frame image, evaluates the video quality of each video frame image of the ultra-high-definition video, and optimizes and enhances the audio signal after decoding. The video frames with low video quality are sent to the ultra-high-definition video rendering unit, and the video frames with low video quality in the ultra-high-definition video are rendered with high quality. The video frame rate is intelligently adapted according to the frame rate supported by the connected device. The video acquisition chip is conducive to ensuring that every frame of the video picture can be completely and accurately acquired. The audio acquisition circuit is conducive to accurately capturing audio details and ensuring audio quality. Through multi-dimensional precise evaluation, the problem is located and processed in time according to the evaluation results, thereby improving the audio quality of ultra-high-definition video. By optimizing and enhancing the audio signal and rendering the video picture with high quality, it is conducive to improving the audio and video quality, enhancing the performance of video picture details, and improving the user experience.

[0110] The present invention is based on the optimized ultra-high-definition video. Through the inter-frame delay and audio delay of the optimized video frame image, the total inter-frame delay and total audio delay of the optimized ultra-high-definition video are compared with the set audio and video transmission synchronization accuracy threshold, and the audio and video transmission synchronization accuracy of the optimized ultra-high-definition video is evaluated. Through the evaluation of image quality and sound quality delay, the audio and video synchronization accuracy of the optimized ultra-high-definition video can be demonstrated, thereby providing users with a stable and synchronized audio and video experience, and realizing more efficient, stable and accurate audio and video synchronous transmission.

[0111] Finally: The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. An audio and video synchronous transmission system of an HDMI interface, characterized in that: include: Interface device configuration and identification module: used to automatically identify the parameters of the connected device and complete the optimal audio and video synchronous transmission configuration when the audio and video signal source is connected to the playback device through the HDMI interface; Audio and video data acquisition module: used to collect the audio signal of ultra-high-definition video through the audio acquisition circuit, and collect the video signal of ultra-high-definition video from the Blu-ray player through the video acquisition chip; Audio quality assessment module: used to comprehensively evaluate the frequency response deviation and dynamic range of video frames, evaluate the audio quality of each video frame in ultra-high-definition video, and send audio signals with poor audio quality in video frames in ultra-high-definition video to the audio and video optimization processing module for optimization; Video quality assessment module: used to evaluate the video quality of each frame of ultra-high-definition video by combining the clarity, dynamic contrast, and color reproduction of the video frame image, and send the video frames with low video quality in the ultra-high-definition video to the audio and video optimization processing module for optimization; Audio and video optimization processing module: includes an audio optimization unit and an ultra-high-definition video rendering unit. The audio optimization unit decodes multi-channel audio and optimizes and enhances the decoded audio signal. The ultra-high-definition video rendering unit renders low-quality video frames in ultra-high-definition video with high quality and intelligently adapts the video frame rate according to the frame rate supported by the connected device. Audio and video synchronization accuracy analysis module: Based on the optimized ultra-high-definition video, the audio and video transmission synchronization accuracy of the optimized ultra-high-definition video is evaluated through the inter-frame delay and audio delay of the optimized video frame images.

2. The HDMI interface audio and video synchronous transmission system according to claim 1, wherein: The specific analysis process of the audio and video data acquisition module is as follows: The audio signal of the ultra-high-definition video is collected through the audio acquisition circuit. After the audio signal is collected, the difference between the transmitted audio signal and the original audio signal in each frequency band response is quantified by traversing each element of the time-frequency matrix of the original audio signal and the transmitted audio signal to obtain the frequency response deviation of the audio signal. ; By setting a suitable test signal in the audio acquisition circuit, gradually increase the signal amplitude until the audio output is distorted, record the signal voltage at this time as the maximum undistorted signal voltage, measure the noise voltage of the audio output in the absence of an input signal, quantify the intensity difference between the maximum undistorted signal voltage and the noise voltage, and obtain the dynamic range of the audio signal. ; The video signal of ultra-high-definition video is collected from the Blu-ray player through the video capture chip. The video signal is the clarity, dynamic contrast and color reproduction of the video frame image.

3. The HDMI interface audio and video synchronous transmission system according to claim 1, wherein: The specific analysis process of the audio quality evaluation module is as follows: Extract the frequency response deviation and dynamic range of the audio signal of the video frame image, and comprehensively integrate the frequency response deviation and dynamic range to construct the audio sound quality evaluation index of each video frame image of the ultra-high-definition video; The audio quality evaluation index of each video frame image of the ultra-high-definition video is obtained and compared with the preset audio quality evaluation index. If the audio quality evaluation index of a video frame image of the ultra-high-definition video is less than the preset audio quality evaluation index, it indicates that the audio quality of the video frame image is poor. The audio signals in the video frame images with poor audio quality are counted, and the audio signals with poor audio quality of the video frame images in the ultra-high-definition video are sent to the audio and video optimization processing module for optimization. Otherwise, it indicates that the audio quality of the video frame image is pure.

4. The HDMI interface audio and video synchronous transmission system according to claim 1, wherein: The specific analysis process of the video quality assessment module is as follows: S41: extracting the clarity, dynamic contrast, and color reproduction of each video frame image, using the clarity of each video frame image as the first indicator for image quality evaluation, obtaining the clarity of each video frame image and comparing it with the standard clarity. If the clarity of the video frame image is lower than the standard clarity, it indicates that the video quality of the video frame image is low, and the video frame image with low video quality in the ultra-high-definition video is sent to the audio and video optimization processing module for optimization. Otherwise, it indicates that the video quality of the video frame image is good. S42: constructing a video quality evaluation index for each frame image of the ultra-high-definition video by comprehensively analyzing the dynamic contrast and color reproduction of the video frame image; S43: Obtain a video quality evaluation index for each video frame image of the ultra-high-definition video, and compare the index with a preset video quality evaluation index. If the video quality evaluation index of a video frame image of the ultra-high-definition video is less than the preset video quality evaluation index, it indicates that the video quality of the video frame image is low, and the video frame with low video quality in the ultra-high-definition video is sent to the audio and video optimization processing module for optimization. Otherwise, it indicates that the video quality of the video frame image is good.

5. The HDMI interface audio and video synchronous transmission system according to claim 1, wherein: The specific analysis process of the audio optimization unit is as follows: receiving an audio signal with poor audio quality sent by the audio quality evaluation module, decoding the audio signal into audio data of multiple channels, and eliminating noise and distortion in the decoding process; Optimize and enhance the decoded audio data of multiple channels separately, obtain the dynamic range of each channel, amplify weak signals in the audio within the dynamic range, and control strong signals at the same time; The optimized audio data of multiple channels is re-encoded into an audio signal and output to an HDMI interface for connection to a playback device.

6. The HDMI interface audio and video synchronous transmission system according to claim 1, wherein: The specific analysis process of the ultra-high-definition video rendering unit is as follows: receiving a video frame with low video quality sent by the video quality assessment module, decoding the video frame, and obtaining original image data of the video frame; Performing image enhancement processing on the image data of the decoded video frame, the image enhancement processing including but not limited to sharpening processing, color enhancement processing, and contrast enhancement processing; Adapt the image data of the decoded video frames according to the resolution and frame rate supported by the connected device, and adjust the resolution and frame rate of the video frames to match the display capabilities of the playback device.

7. The HDMI interface audio and video synchronous transmission system according to claim 1, characterized in that: The specific analysis process of the audio and video synchronization accuracy analysis module is as follows: S71: Obtain the optimized ultra-high-definition video, transmit it to a playback device through an HDMI interface, and obtain an inter-frame delay of the video frame images based on the difference between the sending and receiving times of the video frame images of the optimized ultra-high-definition video; S72: Obtain the optimized ultra-high-definition video, transmit it to the playback device through the HDMI interface, and obtain the audio delay of the audio signal in the video frame image based on the difference between the sending and receiving times of the audio signal in the video frame image of the optimized ultra-high-definition video; S73: Sum the inter-frame delay and audio delay of each optimized video frame image respectively to obtain the total inter-frame delay and total audio delay of the optimized ultra-high-definition video, and set the audio and video transmission synchronization accuracy threshold. If the optimized ultra-high-definition video has |total audio delay - total inter-frame delay| Setting the audio and video transmission synchronization accuracy threshold indicates that the audio and video transmission synchronization accuracy error of the optimized ultra-high-definition video is small. Conversely, it indicates that the audio and video transmission synchronization accuracy error of the optimized ultra-high-definition video is large, and the audio and video playback progress is adjusted according to the error.

8. A method for synchronously transmitting audio and video via an HDMI interface, using the system for synchronously transmitting audio and video via an HDMI interface as claimed in any one of claims 1 to 7, characterized in that: The following steps are involved: Step S01: Interface device configuration and identification: when the audio and video signal source is connected to the playback device via the HDMI interface, the device parameters are automatically identified and the optimal audio and video synchronous transmission configuration is completed; Step S02: Audio and video data acquisition: used to acquire the audio signal of the ultra-high-definition video through the audio acquisition circuit, and acquire the video signal of the ultra-high-definition video from the Blu-ray player through the video acquisition chip; Step S03: Audio quality assessment: Comprehensively assess the frequency response deviation and dynamic range of the video frame image, evaluate the audio quality of each video frame image of the ultra-high-definition video, and send the audio signals of the video frame images in the ultra-high-definition video with poor audio quality to the audio and video optimization processing step for optimization; Step S04: Video quality evaluation: The clarity, dynamic contrast, and color reproduction of the video frame images are combined to evaluate the video quality of each video frame image of the ultra-high-definition video, and the video frames with low video quality in the ultra-high-definition video are sent to the audio and video optimization processing step for optimization; Step S05: Audio and video optimization processing: including an audio optimization sub-step and an ultra-high-definition video rendering sub-step. The audio optimization sub-step decodes the multi-channel audio and optimizes and enhances the decoded audio signal. The ultra-high-definition video rendering sub-step renders low-quality video frames in the ultra-high-definition video with high quality and intelligently adapts the video frame rate according to the frame rate supported by the connected device. Step S06: Audio and video synchronization accuracy analysis: Based on the optimized ultra-high-definition video, the audio and video transmission synchronization accuracy of the optimized ultra-high-definition video is evaluated through the optimized inter-frame delay and audio delay of the video frame image.

Images