A display device and a method for audio-visual synchronization

Abstract

This application discloses a display device and an audio-visual synchronization method. The method includes: acquiring audio-visual data of media assets; determining the output delay of the image data; determining the total output delay of the audio data based on the output delay of the image data, wherein the total output delay of the audio data is consistent with the output delay of the image data; determining the external audio output delay of an external audio output device based on the total output delay of the audio data and the internal audio output delay generated by the display device; or, determining the internal audio output delay of the display device based on the total output delay of the audio data and the external audio output delay generated by the external audio output device; and controlling audio output based on the external audio output delay and the internal audio output delay. This application enables interaction between the display device and the external audio output device to achieve audio-visual synchronization between the display device and the external audio output device.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, in particular to a display device and a sound-picture synchronization method. BACKGROUND

[0002] The display device supports media content playback. During media content playback, the display device parses sound-picture data of the media content into image data and audio data. The display device displays the image data after processing and plays the audio data after processing through an audio output device. Meanwhile, the display device also supports playback of the media content under multiple image setting parameters, such as different image resolution setting parameters and different image mode setting parameters (such as standard mode, sports mode, and game mode). Under different image setting parameters, the display device takes different time to parse the image data. In addition, the display device also supports playback of the media content under multiple audio setting parameters, such as Dolby Digital (DD) and Atmos. Under different audio setting parameters, the external audio output device takes different time to parse the audio data.

[0003] Since the image data and the audio data are processed through different data processing paths, and the display device takes a longer time to process the image data than to process the audio data, the display device is prone to sound-picture asynchronization when playing the media content under different image mode setting parameters or different audio setting parameters, because the display device takes different time to process the image data and the audio data. SUMMARY

[0004] The present application provides a display device and a sound-picture synchronization method, which can realize interaction between the display device and an external audio output device to achieve sound-picture synchronization between the display device and the external audio output device.

[0005] In some embodiments of the present application, a display device is provided, comprising: a display; an external device interface for connecting an external audio output device; a controller configured to: acquire audio-visual data of a media asset, the audio-visual data comprising image data and audio data; determine an output delay of the image data; determine a total output delay of the audio data according to the output delay of the image data, the total output delay of the audio data being consistent with the output delay of the image data; determine an external audio output delay of the external audio output device according to the total output delay of the audio data and an internal audio output delay generated by the display device, or determine an internal audio output delay of the display device according to the total output delay of the audio data and an external audio output delay generated by the external audio output device; wherein the output delay of the audio data is equal to the sum of the internal audio output delay and the external audio output delay; and control audio output according to the external audio output delay and the internal audio output delay. With this implementation, interaction between the display device and the external audio output device can be achieved to realize audio-visual synchronization between the display device and the external audio output device.

[0006] In some embodiments of the present application, the controller performs the determination of the output delay of the image data, and is further configured to: acquire current image setting parameters of the display device; and determine the output delay of the image data in combination with the image setting parameters, wherein the output delay of the image data determined in combination with different image setting parameters is different. With this implementation, the output delay of the image data can be determined according to different image setting parameters to realize audio-visual synchronization between the display device and the external audio output device.

[0007] In some embodiments of the present application, the controller is further configured to: when a change in the image setting parameters of the display device is monitored, redetermine the output delay of the image data in combination with new image setting parameters; and redetermine the total output delay of the audio data according to the output delay of the image data. With this implementation, the output delay of the image data can be redetermined in combination with new image setting parameters when the image setting parameters change, to realize real-time audio-visual synchronization between the display device and the external audio output device.

[0008] In some embodiments of the present application, the controller determines the external audio output delay of the external audio output device according to the total output delay of the audio data and the internal audio output delay generated by the display device, and is further configured to: determine the internal audio output delay of the audio data; and obtain the external audio output delay by subtracting the internal audio output delay from the total output delay. The controller controls the audio output according to the external audio output delay and the internal audio output delay, and is further configured to: output the audio data to the external audio output device according to the internal audio output delay; and generate a delay control instruction according to the external audio output delay, and send the delay control instruction to the external audio output device, so that the external audio output device outputs the audio data according to the external audio output delay. With this implementation, the external audio output device can be notified by the delay control instruction to adjust the time of its own delay compensation, so that the display device and the external audio output device are synchronized in audio and video.

[0009] In some embodiments of the present application, the controller generates the delay control instruction according to the external audio output delay, and is further configured to: generate the delay control instruction containing the external audio output delay, so that the external audio output device determines the external audio delay compensation according to the external audio output delay and the external audio processing time consumption, and outputs the audio data according to the external audio delay compensation. With this implementation, the external audio output device can be notified by the delay control instruction to adjust the time of its own delay compensation, so that the display device and the external audio output device are synchronized in audio and video.

[0010] In some embodiments of the present application, the controller generates the delay control instruction according to the external audio output delay, and is further configured to: determine the external processing time consumption of the audio data by the external audio output device; obtain the external audio delay compensation by subtracting the external processing time consumption from the external audio output delay; and generate the delay control instruction containing the external audio delay compensation. With this implementation, the external audio delay compensation can be obtained, and the delay control instruction containing the external audio delay compensation can be generated according to the external audio delay compensation, so that the external audio output device can more flexibly adjust the external audio delay compensation.

[0011] In some embodiments of the present application, the controller determines the internal audio output delay of the display device according to the total output delay of the audio data and the external audio output delay generated by the external audio output device, and is further configured to: receive the external audio output delay sent by the external audio output device; obtain the internal audio output delay by subtracting the external audio output delay from the total output delay; and control the audio output according to the external audio output delay and the internal audio output delay, including: outputting the audio data to the external audio device according to the internal output delay. With this implementation, the interaction between the display device and the external audio output device can be realized to achieve the audio-visual synchronization between the display device and the external audio output device.

[0012] In some embodiments of the present application, the external audio output delay includes an external processing time consumption, and the controller is further configured to: obtain the current audio setting parameter of the display device; determine the external processing time consumption of the audio data in combination with the audio setting parameter, and determine the external processing time consumption of the audio data to be different according to different audio setting parameters. With this implementation, the external processing time consumption of the audio data can be determined according to different audio setting parameters to achieve the audio-visual synchronization between the display device and the external audio output device.

[0013] In some embodiments of the present application, the external audio output delay further includes an external audio delay compensation, and the internal output delay further includes an internal audio delay compensation, and the controller is further configured to: when it is monitored that the audio setting parameter of the display device changes, re-determine the external processing time consumption of the audio data in combination with the new audio setting parameter; and re-determine the external audio delay compensation or the internal audio delay compensation according to the external processing time consumption of the audio data. With this implementation, the external processing time consumption of the audio data can be determined according to the current audio setting parameter of the display device to achieve the audio-visual synchronization between the display device and the external audio output device.

[0014] In some embodiments of the present application, a method for synchronizing audio and video is also provided. The method comprises: obtaining audio and video data of a media asset, the audio and video data comprising image data and audio data; determining an output delay of the image data; determining a total output delay of the audio data according to the output delay of the image data, the total output delay of the audio data being consistent with the output delay of the image data; determining an external audio output delay of an external audio output device according to the total output delay of the audio data and an internal audio output delay of a display device; or determining the internal audio output delay of the display device according to the total output delay of the audio data and the external audio output delay of the external audio output device; wherein the output delay of the audio data is equal to the sum of the internal audio output delay and the external audio output delay; and controlling audio output according to the external audio output delay and the internal audio output delay. With this implementation, interaction between the display device and the external audio output device can be realized to achieve synchronization of audio and video between the display device and the external audio output device.

[0015] Thus, in the present application, interaction between the display device and the external audio output device can be realized to achieve synchronization of audio and video between the display device and the external audio output device. BRIEF DESCRIPTION OF DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the embodiments will be briefly introduced as follows. Obviously, for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0017] Figure 1 A schematic diagram of an operating scenario between a display device and a control device according to some embodiments is shown;

[0018] Figure 2 A configuration block diagram of the control device 100 according to some embodiments is shown;

[0019] Figure 3 A hardware configuration block diagram of the display device 200 according to some embodiments is shown;

[0020] Figure 4 A software configuration block diagram of the display device 200 according to some embodiments is shown;

[0021] Figure 5 A schematic diagram of an application icon control interface display in the display device 200 according to some embodiments is shown;

[0022] Figure 6 A schematic diagram of a media asset playing scenario according to some embodiments is shown;

[0023] Figure 7Fig. 1 shows a schematic diagram of a media playback principle according to some embodiments;

[0024] Figure 8 Fig. 4 shows a schematic diagram of a picture processing procedure according to some embodiments;

[0025] Figure 9 Fig. 5 shows a schematic diagram of a display device configuration procedure according to some embodiments;

[0026] Figure 10 Fig. 6 shows a schematic diagram of image resolution setting parameter setting according to some embodiments;

[0027] Figure 11 Fig. 7 shows a schematic diagram of image mode setting parameter setting according to some embodiments;

[0028] Figure 12 Fig. 8 shows a schematic diagram of audio setting parameter setting according to some embodiments;

[0029] Figure 13 Fig. 9 shows a schematic diagram of a display device configuration procedure according to some embodiments. DETAILED DESCRIPTION

[0030] In order to make the purposes, embodiments and advantages of the present application clearer, the following will combine the drawings of the exemplary embodiments of the present application to make a clear and complete description of the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments of the present application.

[0031] Based on the exemplary embodiments described in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts belong to the scope of protection of the appended claims of the present application. In addition, although the disclosure in the present application is introduced according to one or more examples, it should be understood that each aspect of the disclosure can also constitute a complete embodiment independently. It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0032] Figure 1 Fig. 10 shows a schematic diagram of an operation scenario between a display device and a control device according to one or more embodiments of the present application, such as Figure 1As shown, a user can operate the display device 200 via a mobile terminal 300 and a control device 100. The control device 100 can be a remote control, and communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, wireless or other wired methods to control the display device 200. The user can input user commands through buttons on the remote control, voice input, control panel input, etc., to control the display device 200. In some embodiments, a mobile terminal, tablet computer, computer, laptop computer, and other smart devices can also be used to control the display device 200.

[0033] In some embodiments, the mobile terminal 300 can install software applications with the display device 200 to achieve connection and communication via network communication protocols, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronous display. The display device 200 also communicates with the server 400 via various communication methods. The display device 200 can communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 can provide various content and interactive features to the display device 200. The display device 200 can be a liquid crystal display, an OLED display, or a projection display device. In addition to providing broadcast television reception functions, the display device 200 can also be equipped with a smart network television function that provides computer support.

[0034] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input commands and convert them into commands that the display device 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display device 200. The communication interface 130 is used for external communication and includes at least one of a Wi-Fi chip, a Bluetooth module, NFC, or a replacement module. The user input / output interface 140 includes at least one of a microphone, a touchpad, a sensor, buttons, or a replacement module.

[0035] Figure 3 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown. For example... Figure 3The display device 200 shown includes at least one of the following: a tuner / demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. The controller includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to nth interface for input / output. The display 260 can be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and can also be a projection device and a projection screen. The tuner / demodulator 210 receives broadcast television signals via wired or wireless reception and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. The detector 230 is used to collect signals from the external environment or signals interacting with the external environment. The controller 250 and the tuner / demodulator 210 can be located in different separate devices; that is, the tuner / demodulator 210 can also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0036] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200. The user can input user commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0037] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user, enabling the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0038] Figure 4 This is a schematic diagram of the software configuration in a display device 200 according to one or more embodiments of this application, such as... Figure 4As shown, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer. The kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, Wi-Fi driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0039] Figure 5 This is a schematic diagram showing the icon control interface of an application in a display device 200 according to one or more embodiments of this application, such as... Figure 5 As shown, the application layer contains at least one application whose corresponding icon control can be displayed on the screen, such as: live TV application icon control, video-on-demand application icon control, media center application icon control, application center icon control, game application icon control, etc. Live TV applications can provide live television from different signal sources. Video-on-demand applications can provide video from different storage sources. Unlike live TV applications, video-on-demand provides video display from certain storage sources. Media center applications can provide applications for playing various multimedia content. The application center can provide storage for various applications.

[0040] Figure 6 An exemplary illustration shows a media asset playback scenario according to an exemplary embodiment, such as... Figure 6 As shown, the media asset playback scenario may involve one or more devices, such as a control device 100, a display device 200, a smart device 300, a server 400, and an external audio output device 500. The display device 200 includes: a monitor; an external device interface for connecting to the external audio output device 500; and a controller. The control device 100 or the smart device 300 can control the media asset playback by inputting user commands. The audio-visual data of the media asset includes image data and audio data. The display device 200 plays the image data through the monitor and plays the audio data through its built-in audio output module or the external audio output device 500. This application only addresses the audio-visual asynchrony problem that exists when the display device is connected to the external audio output device 500; therefore, the case where the display device outputs audio data through its built-in audio output module is not described in detail.

[0041] Figure 7 An exemplary illustration shows a schematic diagram of the media asset playback principle according to an exemplary embodiment, such as... Figure 7As shown, when a display device plays media data, it parses the audio and video data of the media into image data and audio data, and processes the image data and audio data separately through different data processing paths. Specifically, the image data is output to the monitor after passing through the image processing path, so that the monitor can play the image data; the audio data is output to an external audio output device after passing through the audio processing path, so that the external audio output device can play the audio data.

[0042] It should be noted that the image quality processing path is used to process image data. The processing steps of the image quality processing path may include: noise reduction, deinterlacing, scaling, and dynamic compensation. Noise reduction is used to reduce noise in the image data. Deinterlacing converts interlaced images into progressive scan images to eliminate or reduce the drawbacks of interlacing. Scaling makes the image fit the size of the display area, generating a thumbnail of the corresponding image. Dynamic compensation uses a dynamic imaging system, inserting a motion compensation frame between two traditional image frames, so that even fast-moving scenes can be clear and natural. In the embodiments shown in this application, the processing steps of the image quality processing path can be specifically implemented in the video processor of the display device.

[0043] It should be added that, in practical applications, the image quality processing path may include other processing processes in addition to the above-mentioned processes, such as brightness processing, contrast processing, chroma processing, hue processing, sharpness processing, dynamic contrast processing, gamma correction processing, color temperature processing, white balance processing, color correction processing, dynamic brightness processing, etc. This embodiment will not describe these in detail.

[0044] It should be noted that the audio processing path is used to process audio data, and it includes audio processing modules. These modules perform decoding, sound effects processing, and transmission processing. Sound effects processing mainly includes: Digital Theater System (DTS) sound effects processing, Dolby Atmos (ATMOS) sound effects processing, Graphic Equalizer (GEQ) processing, and Parametric Equalizer (PEQ) processing.

[0045] DTS and ATMOS audio processing both enhance the sound quality to improve playback. GEQ employs constant Q-factor technology, with a push-pull potentiometer at each frequency point. Regardless of boosting or attenuating a frequency, the filter's bandwidth remains constant. The distribution of push-pull buttons on the panel visually reflects the equalization compensation of the current audio data and the boosting and attenuation of each frequency. PEQ allows for fine-tuning of various equalization parameters and is often attached to a mixing console, but independent parametric equalizers are also available. Adjustable parameters include frequency bands, frequency points, gain, and Q-factor, enhancing and refining the sound to create a more distinctive and artistic effect.

[0046] It should be added that both display devices and external audio output devices contain audio processors, and the specific processing procedures of the audio processing path can be implemented in the audio processors of the display device and the external audio output device.

[0047] It is worth noting that, compared to the audio processing of audio data, the image processing of image data takes longer. This means that the time it takes for image data to reach the display is longer than the time it takes for audio data to reach the external audio output device, which can easily lead to audio-visual desynchronization.

[0048] The following analysis explains the time-consuming nature of image quality processing. When processing a single frame of image data, the image quality processing path needs to read not only the current frame's image data but also the image data from several subsequent frames. Then, based on this combined data, the current frame is processed, and the processed data is written back to the current frame. Because processing the current frame requires reading image data from several subsequent frames, this process is time-consuming.

[0049] Figure 8 An exemplary illustration shows a schematic diagram of the image data quality processing procedure according to an exemplary embodiment, such as... Figure 8 As shown, in some embodiments, the threshold for the number of image data frames read is 4. This means that each time the display device reads a frame of image data, it needs to read the current frame and the next 3 frames. For example, if the current frame to be processed is frame n, then the image data of frames n, n+1, n+2, and n+3 need to be read. After processing these 4 frames, the processing result is written into frame n. The processing of frames n+1, n+2, and subsequent frames is similar and will not be elaborated here. Assuming a refresh rate of 60Hz, when the threshold for the number of frames read is 4, 4 frames of image data need to be read, which is equivalent to the image quality processing time for each frame being 1 / 60 * 4 = 66ms.

[0050] To address the audio-visual asynchrony issue caused by the time-consuming image processing of image data, the audio processing pathway includes an audio delay processing module. After the audio processing module performs sound effects processing on the audio data, it still needs to pass through the audio delay processing module for audio delay processing. The audio delay processing module is used to buffer the audio data. After buffering the audio data for a certain period of time, the audio data is then output from the external audio output device, ensuring that the time it takes for the audio data to be output from the external audio output device is the same as the time it takes for the image data to be output from the display, thereby eliminating the audio-visual asynchrony.

[0051] For ease of description, in this application, the processing time of the image data by the image quality processing path is defined as the output delay of the image data. Figure 8 As described above, the output latency of image data is related to the threshold number of frames read by the video processor. Once the threshold number of frames read by the video processor is determined, the output latency of the image data corresponding to the video processor can be determined. The processing time of audio data by the audio processing module in the audio processing path of the display device is determined as the internal audio processing time. The buffering time of audio data by the audio delay processing module in the audio processing path of the display device is determined as the internal latency compensation of the audio data. The sum of the internal audio processing time and the internal latency compensation is determined as the internal output latency of the audio data.

[0052] It should be noted that when an external audio output device receives audio data from a display device, it cannot directly play the audio data. Instead, it needs to process the audio data before playback. For ease of description, the processing time of the audio data by the audio processing module in the external audio output device's audio processing path is defined as the external processing time. The buffering time of the audio data by the audio delay processing module in the external audio output device's audio processing path is defined as the external delay compensation. The sum of the external processing time and the external delay compensation is defined as the external audio output delay. Since the display device and the external audio output device belong to different hardware control systems, they are unaware of each other's audio processing time. Therefore, the display device cannot maintain consistent output duration of its image data with that of the external audio output device, thus preventing real-time audio-visual synchronization.

[0053] The following describes the scenarios to which the embodiments of this application are applicable.

[0054] Scenario 1: The display device plays audio data through an external audio output module.

[0055] When a display device receives audio and video data from media resources, it parses this data into image data and audio data, and processes the image and audio data separately through image processing and sound processing pathways. After image data is processed through the image processing pathway, it is displayed on the monitor. Audio data is first processed through the display device's audio processing pathway, and then through the audio processing pathway of an external audio output device; it is then output by the external audio output device. The external audio output device may include speaker components. These components may include power amplifiers (AMPs) and speakers. Typically, speaker components can output at least two channels of sound; to achieve a panoramic surround sound effect, multiple speaker components are needed to output multiple channels of sound.

[0056] In practice, when a display device plays audio by connecting to an external audio output device, the display device first needs to establish a connection with the external audio output device.

[0057] In some embodiments, display devices supporting the HDMI 2.1 protocol can establish a connection with external output devices via the Enhanced Audio Return Channel (eARC). When the display device is successfully connected to an external audio output device, the devices involved in the media asset playback scenario can be divided into transmitting devices and receiving devices based on the output direction of the audio data. The transmitting device, also known as the source, refers to the party that sends audio data in the media asset playback scenario, such as... Figure 6 The display device shown; the receiving device, also known as the sink, refers to the party that receives audio data in a media playback scenario, such as... Figure 6 The external audio output device is shown. Therefore, in a media asset playback scenario, the transmitting device can transmit the audio data it is playing to the receiving device via a wireless or wired connection, enabling the receiving device to play the received audio data in real time. In a media asset playback scenario, the transmitting and receiving devices are logically determined based on the audio output direction; therefore, depending on the audio output direction, the display device can function as either a transmitting or receiving device.

[0058] For example, regarding a display device and an external audio output device, when the display device outputs audio data to the external audio output device, the audio data is played through the external audio output device, with the display device being the transmitting device and the external audio output device being the receiving device. Conversely, when the external audio output device outputs audio data to the display device, the audio data is played through the display device's audio processor, with the external audio output device being the transmitting device and the display device being the receiving device.

[0059] It is important to note that, such as Figure 6 In the media playback scenario shown, a receiving device can only establish a connection with one transmitting device at a time. For example, when a display device establishes a connection with an external audio output device, and the external audio output device outputs the audio data of the media being played by the display device, the smart device cannot simultaneously establish a connection with the external audio output device, and the external audio output device cannot simultaneously output the audio data of the media being played by the smart device; conversely, when a smart device establishes a connection with an external audio output device, and the external audio output device outputs the audio data of the media being played by the smart device, the external audio output device cannot simultaneously output the audio data of the media being played by the display device.

[0060] It should be noted that when the display device is successfully connected to the external audio output device, the display device transmits audio data to the external audio output device through two channels. The first channel is the differential mode audio channel, which uses the hot-plug detection (HPD) line as the eARC- signal transmission channel to transmit audio data and clock signals to the external audio output device in differential signal form. The second channel is the normal mode data channel, which uses the power (utility) line as the eARC+ signal transmission channel to exchange control information during the eARC transmission process in normal mode.

[0061] Therefore, this application provides a display device that enables interaction between the display device and an external audio output device, thereby achieving audio-visual synchronization between the display device and the external audio output device, and avoiding the problem that the display device and the external audio output device cannot achieve real-time audio-visual synchronization.

[0062] In its specific implementation, this application provides a display device to avoid the audio-visual desynchronization problem that may occur in scenario 1 above. The display device shown in this application includes a monitor; an external device interface for connecting an external audio output device; and a controller for executing... Figure 9 The following steps S901-S905 are shown:

[0063] Step S901: Obtain the audio-visual data of the media assets, which includes image data and audio data;

[0064] In some embodiments, when a user inputs user commands to a display device via a control device or smart device, the display device can communicate with a server to obtain audio and video data of media assets. The display device can communicate with the server via various communication methods. In various embodiments of this application, the display device may be allowed to establish a wired or wireless communication connection with the server via a local area network, wireless local area network, or other networks. The server can provide the display device with various content and interactive features.

[0065] For example, the display device interacts by sending and receiving information, as well as with the Electronic Program Guide (EPG), receiving software updates, or accessing a remotely stored digital media library. Servers can be a group or multiple groups, and can be one or more types of servers. Servers can provide the display device with other network services such as video-on-demand and advertising services.

[0066] Display devices include, but are not limited to, acquiring audio and video data of media assets through data communication with a server. Display devices can also acquire audio and video data of media assets from smart devices through wired or wireless connections, or acquire audio and video data of media assets from local storage locations.

[0067] For example, smart devices can connect to display devices via screen mirroring, allowing them to project games (such as traditional arcade games) onto the display device to enhance the user's gaming experience.

[0068] For example, the display device may have local games stored on it, such as motion-sensing games (e.g., ball games, boxing games, running games, dancing games, etc.). The control device or smart device can open and run the local games from the local storage location by inputting user commands.

[0069] Step S902: Determine the output delay of the image data;

[0070] In some embodiments, the display device can obtain the output delay of image data through a video processor. Specifically, after the display device obtains the audio and video data of the media asset, it decodes the audio and video data into image data and audio data, processes the image data through an image quality processing path, which is implemented at the software level by the video processor. After processing, the video processor can record the output delay of the image data.

[0071] In some embodiments, the controller performs an output delay to determine the image data, which is further configured to:

[0072] Get the current image settings parameters of the display device;

[0073] The output delay of image data is determined by combining image setting parameters, and the output delay varies depending on the different image setting parameters. These image setting parameters may include: image resolution setting parameters, image mode setting parameters, and image resource setting parameters.

[0074] Figure 10 An exemplary illustration shows a schematic diagram of setting image resolution parameters according to an exemplary embodiment, such as... Figure 10 As shown, the user's overall settings interface 1000 includes: a boot scene control 1001, a screen adjustment control 1002, a resolution adjustment control 1003, a multi-screen interaction control 1004, and a device name control 1005. Clicking the corresponding control allows the user to enter its settings interface. For example, when the user clicks the resolution adjustment control 1003, the resolution of the image data can be set in the resolution adjustment interface. For instance, the resolution adjustment interface includes various resolutions such as 4K (2160×4096), 2K (1152×2048), 1080p (1080×1920), 720p (720×1280), and DV (480×720).

[0075] Figure 11 An exemplary illustration shows a schematic diagram of image mode setting parameters according to an exemplary embodiment, such as... Figure 11 As shown, the user's image mode settings interface 1100 includes: a standard mode control 1101, a sports mode control 1102, a game mode control 1103, a cinema mode control 1104, a concert mode control 1105, a studio mode control 1106, and a custom mode control 1107. Among these, clicking the game mode control 1103 sets the display device to game mode.

[0076] It should be noted that the output latency of image data varies under different image mode settings. Taking game mode as an example, when the display device is in game mode, the display device is allowed to optimize the screen response speed.

[0077] In practice, the image data latency is caused by the following: Image data output from the HDMI interface to the display device via the video cable has a latency of 5-10ms; image data is transmitted from the display device's HDMI interface to the controller, and the controller converts it into a data format that the video processor can process, which takes another 5-10ms; the video processor then processes the image data, taking 20-100ms. Therefore, the total latency from image data transmission to display on the monitor is 30-120ms, significantly impacting the user experience. Since the longest latency is generated by the video processor, the image quality processing path in the video processor includes various video processing effects to improve image quality. When the display device is in game mode, it disables these various video processing effects to improve image quality, allowing the image data to be displayed on the monitor more quickly.

[0078] It is worth noting that game mode does not completely eliminate the output latency of image data, but it will significantly reduce the latency by 2-3 times. For example, when the image mode setting is set to standard mode, the output latency of image data is 80ms, while when it is changed to game mode, the output latency of image data is 25ms.

[0079] Since game mode can reduce the output latency of image data, game mode is essentially a low-latency mode. Low-latency modes in display devices include, but are not limited to, game mode, as well as other low-latency modes such as automatic low-latency mode. The low-latency modes of display devices can be manually switched by user input operation commands. In automatic low-latency mode, the switching can also be automatic based on the media content played by the display device.

[0080] When a user connects to a PC device, the PC device sends the audio and video data of the media assets to the display device. When the audio and video data of the media assets is an image resource package, the image resource setting parameter is: image resource format.

[0081] It should be noted that the image resource setting parameter is the content type of the media asset's audio and video data. The image resource setting parameter is used to determine which content type to read the audio and video data of the media asset. When the audio and video data of the media asset is a game resource package, the image resource setting parameter is: game resource format.

[0082] In some embodiments, when a change in the image setting parameters of the display device is detected, the output delay of the image data is re-determined in conjunction with the new image setting parameters;

[0083] The total output delay of the audio data is re-determined based on the output delay of the image data.

[0084] In practice, when any image setting parameter of the display device is detected to have changed, the output delay of the image data is re-determined based on the new image setting parameter.

[0085] Changes in the image settings parameters of the display device include the following scenarios:

[0086] Scenario 2: The image resolution setting of the display device is switched from 2k to 4k.

[0087] When the image resolution setting parameter of the display device is switched from 2k to 4k, the processing time of the image data changes. Therefore, it is necessary to redetermine the output delay of the image data. In practice, the HDMI video monitor will continuously monitor the HDMI signal. When the image resolution setting parameter is switched from 2k to 4k, the HDMI signal fluctuates. When the HDMI signal stabilizes, the output delay of the image data is redetermined.

[0088] In specific implementation, taking the normal image data output delay of 80ms as an example, when the image resolution of the display device is switched from 2k to 4k, the image data processing time becomes 100ms. When the user switches the resolution by inputting user commands in the image resolution setting interface through the control device or smart device, the video processor needs to redetermine the image data output delay.

[0089] Scenario 3: The display device's image mode settings are switched from standard mode to game mode.

[0090] When the display device switches its image mode settings from standard mode to game mode, the processing time of image data changes. Therefore, it is necessary to redetermine the output delay of image data and the output delay of audio data. In practice, the user enters a user command in the image mode settings interface through a control device or smart device to change the image mode settings parameters. At this time, since the image mode settings parameters have changed, it is necessary to redetermine the output delay of image data.

[0091] In specific implementation, taking the image data output latency of 80ms under normal circumstances as an example, when the image mode setting parameter of the display device is switched from standard mode to game mode, the image output latency is 80ms in standard mode. Since game mode is actually a low latency mode, the image data processing time becomes 60ms. When the user switches the image mode by inputting user commands in the image resolution setting interface through the control device or smart device, the video processor needs to redetermine the image data output latency.

[0092] Scenario 4: The image resource settings of the display device are switched from image resource format to game resource format.

[0093] When the display device is connected to the PC, the PC sends audio and video data of the media assets to the display device. When the audio and video data of the media assets is an image resource package, the image resource setting parameters are: image resource format; when the audio and video data of the media assets is a game resource package, the image resource setting parameters are: game resource format; when the audio and video data of the media assets is switched from an image resource package to a game resource package, the image resource setting parameters are switched from image resource format to game resource format. At this time, because the image resource setting parameters have changed, it is necessary to redetermine the output delay of the image data.

[0094] In specific implementation, taking an image data output latency of 80ms under normal circumstances as an example, when a user switches the image resource format on a smart device connected to the display device, such as switching from browsing image data to sending image resource packets to playing games to sending game resource packets to the display device, the image resource format in the display device changes from image resource format to game resource format. Since the game resource format is a low-latency mode, when the user switches the image resources on the smart device, the image data output latency becomes 60ms, and the video processor needs to redetermine the image data output latency.

[0095] Therefore, in scenarios two through four above, taking an image data output delay of 80ms under normal circumstances as an example, in low-latency mode, the image data output delay is less than 80ms. When any image setting parameter of the display device is detected to change, the image data output delay will change, and the image data output delay needs to be re-determined. At this time, determining the image data output delay in real time and adjusting the total audio data output delay in real time according to the image data output delay enables the display device to achieve real-time audio-visual synchronization with the external audio output device.

[0096] Step S903: Determine the total output delay of the audio data based on the output delay of the image data. The total output delay of the audio data is consistent with the output delay of the image data.

[0097] In some embodiments, taking an image data output delay of 80ms under normal circumstances as an example, the total output delay of audio data also needs to be 80ms to ensure audio-visual synchronization.

[0098] Step S904: Determine the external audio output delay of the external audio output device based on the total output delay of the audio data and the internal audio output delay generated by the display device.

[0099] In some embodiments, the controller performs the function of determining the external audio output delay of the external audio output device based on the total output delay of the audio data and the internal audio output delay generated by the display device, and is further configured to:

[0100] Determine the internal audio output delay of the audio data;

[0101] The external audio output delay is obtained by subtracting the internal audio output delay from the total output delay.

[0102] The controller performs audio output control based on the external audio output delay and the internal audio output delay, and is further configured as follows:

[0103] Audio data is output to an external audio output device based on the internal audio output delay;

[0104] Additionally, a delay control command is generated based on the external audio output delay, and the delay control command is sent to the external audio output device so that the external audio output device outputs audio data according to the external audio output delay.

[0105] In practice, when the display device processes audio data through its audio processing path, since the display device is already set to output audio data via an external audio output device, the audio processing module in the display device only performs decoding and transmission processing on the audio data and does not perform sound effect processing. The actual delay time of the internal output is very small and can even be ignored.

[0106] Taking a normal image output delay of 80ms as an example, the audio processor of the display device determines that the internal audio output delay of the audio data is 2ms. Meanwhile, since the output delay of the image data is consistent with the total output delay of the audio data, the total output delay is 80ms. By subtracting the internal audio output delay of 2ms from the total output delay of 80ms, the external audio output delay can be obtained as 78ms.

[0107] In some embodiments, the controller executes delay control instructions generated based on the external audio output delay, and is further configured to:

[0108] Generate a delay control command that includes the external audio output delay, so that the external audio output device determines the external audio delay compensation based on the external audio output delay and the external audio processing time, and outputs audio data based on the external audio delay compensation.

[0109] In its implementation, the controller generates a delay control command (ERX_LATENCY) in the normal mode data channel based on the external audio output delay. The display device can transmit audio data to the external audio output device via the differential mode audio channel and output the delay control command to the external audio output device via the normal mode audio channel. This command informs the external audio output device that the external audio output delay is 78ms, enabling the external audio output device to determine the external audio delay compensation based on the external audio output delay and the external audio processing time, and then output audio data based on the external audio delay compensation.

[0110] It should be noted that the display device sends the delay control command to the audio processor of the external audio output device. The audio processor of the external audio output device includes the audio processing module and the audio compensation module of the external audio output device. Taking the processing time of the audio processing module of the external audio output device as 30ms as an example, when the delay control command is received and the external audio output delay is determined to be 78ms, the audio compensation module of the external audio output device will perform a 48ms delay compensation on the audio data.

[0111] In some embodiments, the controller executes delay control instructions generated based on the external audio output delay, and is further configured to:

[0112] Determine the time consumed by the external audio output device to process audio data externally;

[0113] External audio delay compensation is obtained by subtracting the external processing time from the external audio output delay.

[0114] Generate the delay control command that includes external audio delay compensation.

[0115] In the specific implementation, the display device also includes: a register for storing data during interaction between the display device and the external audio output device; the audio processing module of the audio processing path of the external audio output device can determine the external processing time of the audio data; the external audio output device can interact with the display device in the register of the display device; the display device can obtain the external processing time in real time; taking an external audio output delay of 78ms as an example and an external processing time of 30ms as an example, the external audio delay compensation is obtained by subtracting the external processing time of 30ms from the external audio output delay of 78ms; the display device generates a delay control instruction containing the external audio delay compensation of 48ms, so that the external audio output device outputs audio data with an external audio delay compensation of 48ms.

[0116] In some embodiments, the controller is further configured to:

[0117] Get the current audio settings parameters of the display device;

[0118] The external processing time for audio data is determined by combining audio setting parameters, and the external processing time varies depending on the different audio setting parameters. These audio setting parameters are one or more Digital Audio Out (DAO) formats, including: MAT (Metamaterial Absorption Technology), DDP (Dolby Digital Plus), Atmos, Dolby Digital (DD), Digital Theater Systems (DTS), and Digital Theater Systems High Definition (DTSHD).

[0119] Figure 12 An exemplary illustration shows a schematic diagram of audio setting parameters according to an exemplary embodiment, such as... Figure 12 As shown, the user's audio settings interface 1201 includes: a MAT control 1201, a DDP control 1202, an Atmos control 1203, a DD control 1204, a DTS control 1205, and a DTSHD control 1206. Users can click the corresponding control to set the audio output format of the external audio output device. For example, clicking the Atmos control 1203 sets the audio output format of the external audio output device to Atmos format.

[0120] In some embodiments, the controller is further configured to:

[0121] When a change in the audio settings parameters of the display device is detected, the external processing time of the audio data is recalculated based on the new audio settings parameters.

[0122] The external audio delay compensation or internal audio delay compensation is re-determined based on the external processing time of the audio data.

[0123] In the specific implementation, when a change in the audio setting parameters of the display device is detected, the STAT_CHNG_CONF in the display device register jumps from 1 to 0. When the STAT_CHNG_CONF in the register jumps from 1 to 0, the external processing time of the audio data is re-determined in conjunction with the new audio setting parameters.

[0124] It should be noted that when users input user operation commands to the display device through the control device or smart device to adjust the audio setting parameters, the STAT_CHNG_CONF register changes from 1 to 0 simultaneously.

[0125] Step S905: Control the audio output based on the external audio output delay and the internal audio output delay.

[0126] In a specific implementation, this application also provides another display device to avoid the audio-visual desynchronization problem that may exist in scenario 1 above. The display device shown in this application includes a monitor; an external device interface for connecting an external audio output device; and a controller for executing... Figure 13 The following steps S1301-S1305 are shown:

[0127] Step S1301: Obtain the audio-visual data of the media assets, which includes image data and audio data;

[0128] In practice, the specific method for obtaining the audio-visual data of media assets is the same as that in step S901 above, and will not be described in detail here.

[0129] Step S1302: Determine the output delay of the image data;

[0130] In the specific implementation, the method for determining the output delay of image data is the same as in step S902 above, and will not be described in detail here.

[0131] Step S1303: Determine the total output delay of the audio data based on the output delay of the image data, wherein the total output delay of the audio data is consistent with the output delay of the image data;

[0132] In practice, the specific method for obtaining the audio-visual data of media assets is the same as that in step S903 above, and will not be described in detail here.

[0133] Step S1304: Determine the internal audio output delay of the display device based on the total output delay of the audio data and the external audio output delay generated by the external audio output device; wherein, the output delay of the audio data is equal to the sum of the internal audio output delay and the external audio output delay;

[0134] In some embodiments, the controller performs the function of determining the internal output delay of the display device based on the total output delay of the audio data and the external audio output delay generated by the external audio output device, and is further configured to:

[0135] Delay in receiving external audio output from external audio output devices;

[0136] The internal audio output delay is obtained by subtracting the external audio output delay from the total output delay.

[0137] The controller performs audio output control based on the external audio output delay and the internal audio output delay, and is further configured to:

[0138] Audio data is output to external audio devices based on the internal output delay.

[0139] In some embodiments, the controller performs the action of outputting audio data to an external audio output device according to the internal audio output delay, and is further configured to:

[0140] Internal processing time for acquiring audio data;

[0141] The internal audio delay compensation of the audio data is obtained by subtracting the internal processing time from the internal audio output delay.

[0142] The audio data is output to the external audio output device according to the internal audio delay compensation.

[0143] In the specific implementation, the display device receives the external audio output delay sent by the external audio device. At this time, the external audio output device only processes the audio through the audio processing module. The external audio output delay is the external processing time. The external audio output device sends the external audio processing time to the display device, and the display device adjusts the internal audio processing delay according to the external audio output delay.

[0144] Taking a normal image data output delay of 80ms as an example, the display device receives the audio data from the external audio output device in real time, which takes 30ms. Since the external audio output device does not perform delay compensation on the audio data in this embodiment, the external audio output delay is determined to be 30ms, and the internal audio output delay is determined to be 50ms. Taking the internal audio processing time of 2ms as an example, the display device adjusts the internal audio delay compensation to 48ms.

[0145] Step S1305: Control audio output based on the external audio output delay and the internal audio output delay.

[0146] In some embodiments, this application also provides an audio-visual synchronization method, including:

[0147] Acquire audio-visual data of media assets, wherein the audio-visual data includes image data and audio data;

[0148] Determine the output delay of the image data;

[0149] In some embodiments, determining the output delay of the image data includes:

[0150] Obtain the current image setting parameters of the display device;

[0151] The output delay of the image data is determined by combining the image setting parameters, and the output delay of the image data is different depending on the different image setting parameters.

[0152] In some embodiments, the method further includes:

[0153] When a change in the image setting parameters of the display device is detected, the output delay of the image data is re-determined based on the new image setting parameters;

[0154] The total output delay of the audio data is re-determined based on the output delay of the image data.

[0155] The total output delay of the audio data is determined based on the output delay of the image data, and the total output delay of the audio data is consistent with the output delay of the image data;

[0156] The external audio output delay of the external audio output device is determined based on the total output delay of the audio data and the internal audio output delay generated by the display device; wherein, the output delay of the audio data is equal to the sum of the internal audio output delay and the external audio output delay;

[0157] In some embodiments, determining the external audio output delay of the external audio output device based on the total output delay of the audio data and the internal audio output delay generated by the display device includes:

[0158] Determine the internal audio output delay of the audio data;

[0159] The external audio output delay is obtained by subtracting the internal audio output delay from the total output delay.

[0160] The audio data is output to the external audio output device according to the internal audio output delay;

[0161] Additionally, a delay control instruction is generated based on the external audio output delay, and the delay control instruction is sent to the external audio output device so that the external audio output device outputs the audio data according to the external audio output delay.

[0162] The audio output is controlled based on the external audio output delay and the internal audio output delay.

[0163] In some embodiments, this application also provides a method for audio-visual synchronization, including:

[0164] Acquire audio-visual data of media assets, wherein the audio-visual data includes image data and audio data;

[0165] Determine the output delay of the image data;

[0166] In some embodiments, determining the output delay of the image data includes:

[0167] Obtain the current image setting parameters of the display device;

[0168] The output delay of the image data is determined by combining the image setting parameters, and the output delay of the image data is different depending on the different image setting parameters.

[0169] In some embodiments, the method further includes:

[0170] When a change in the image setting parameters of the display device is detected, the output delay of the image data is re-determined based on the new image setting parameters;

[0171] The total output delay of the audio data is re-determined based on the output delay of the image data.

[0172] The total output delay of the audio data is determined based on the output delay of the image data, and the total output delay of the audio data is consistent with the output delay of the image data;

[0173] The internal audio output delay of the display device is determined based on the total output delay of the audio data and the external audio output delay generated by the external audio output device; wherein, the output delay of the audio data is equal to the sum of the internal audio output delay and the external audio output delay;

[0174] In some embodiments, determining the internal audio output delay generated by the display device based on the total output delay of the audio data and the external audio output delay generated by the external audio output device includes:

[0175] Delay in receiving external audio output from external audio output devices;

[0176] The internal audio output delay is obtained by subtracting the external audio output delay from the total output delay.

[0177] The controller performs audio output control based on the external audio output delay and the internal audio output delay, and is further configured to:

[0178] The audio data is output to the external audio device according to the internal output delay.

[0179] The audio output is controlled based on the external audio output delay and the internal audio output delay.

[0180] It should be understood that the specific implementation methods of each step in the above-described audio-visual synchronization method can be found in the aforementioned display device embodiments, and will not be repeated here. As can be seen from the above embodiments, the display device and audio-visual synchronization method disclosed in this application can avoid the phenomenon of audio-visual asynchrony caused by the long processing time of image data, which makes the time required for image data to reach the display longer than the time required for audio data to reach the built-in audio output module or external audio output device, and the problem that the display device and external audio output device cannot achieve real-time audio-visual synchronization. This improves the user experience.

[0181] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0182] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion in some embodiments above is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of the embodiments suitable for specific application considerations.

Claims

1. A display device, characterized by comprising: The application relates to a display device, comprising: a display; an external device interface for connecting an external audio output device; a controller configured to: obtain audio-visual data of a media asset, the audio-visual data comprising image data and audio data; obtain current image setting parameters of the display device; determine an output delay of the image data in combination with the image setting parameters, the output delay of the image data being different for different image setting parameters; determine a total output delay of the audio data in accordance with the output delay of the image data, the total output delay of the audio data being consistent with the output delay of the image data; when a change in the image setting parameters of the display device is detected, re-determine the output delay of the image data in combination with new image setting parameters; re-determine the total output delay of the audio data in accordance with the output delay of the image data; determine an external audio output delay of the external audio output device in accordance with the total output delay of the audio data and an internal audio output delay generated by the display device, or determine an internal audio output delay of the display device in accordance with the total output delay of the audio data and an external audio output delay generated by the external audio output device, wherein the output delay of the audio data is equal to the sum of the internal audio output delay and the external audio output delay; control audio output in accordance with the external audio output delay and the internal audio output delay.

2. The display device of claim 1, wherein, The controller, which determines the external audio output delay of the external audio output device in accordance with the total output delay of the audio data and the internal audio output delay generated by the display device, is further configured to: determine the internal audio output delay of the audio data; obtain the external audio output delay by subtracting the internal audio output delay from the total output delay. The controller, which controls audio output in accordance with the external audio output delay and the internal audio output delay, is further configured to: output the audio data to the external audio output device in accordance with the internal audio output delay; generate a delay control instruction in accordance with the external audio output delay, and send the delay control instruction to the external audio output device, so that the external audio output device outputs the audio data in accordance with the external audio output delay.

3. The display device of claim 2, wherein, The controller, which generates the delay control instruction in accordance with the external audio output delay, is further configured to: generate the delay control instruction containing the external audio output delay, so that the external audio output device determines an external audio delay compensation in accordance with the external audio output delay and an external audio processing time consumption, and outputs the audio data in accordance with the external audio delay compensation.

4. The display device of claim 3, wherein, The controller, which generates the delay control instruction in accordance with the external audio output delay, is further configured to: determine the external audio processing time consumption of the external audio output device for the audio data; obtain the external audio delay compensation by subtracting the external audio processing time consumption from the external audio output delay; generate the delay control instruction containing the external audio delay compensation.

5. The display device of claim 1, wherein, The controller is configured to determine the internal audio output delay of the display device according to the total output delay of the audio data and the external audio output delay generated by the external audio output device, and further configured to: receive the external audio output delay sent by the external audio output device; obtain the internal audio output delay by subtracting the external audio output delay from the total output delay; The controller is configured to control audio output according to the external audio output delay and the internal audio output delay, and further configured to: output the audio data to the external audio output device according to the internal audio output delay.

6. The display device according to any one of claims 1 to 5, wherein The external audio output delay includes an external processing time consumption, and the controller is further configured to: obtain the current audio setting parameter of the display device; determine the external processing time consumption of the audio data in combination with the audio setting parameter, and the external processing time consumption of the audio data is different according to different audio setting parameters.

7. The display device of claim 6, wherein, The external audio output delay further includes an external audio delay compensation, and the internal audio output delay further includes an internal audio delay compensation. The controller is further configured to: when a change in the audio setting parameter of the display device is monitored, re-determine the external processing time consumption of the audio data in combination with the new audio setting parameter; re-determine the external audio delay compensation or the internal audio delay compensation according to the external processing time consumption of the audio data.

8. A method for synchronizing audio and video, the method comprising: The method comprises: obtaining audio-visual data of the media asset, the audio-visual data comprising image data and audio data; obtaining the current image setting parameter of the display device; determining the output delay of the image data in combination with the image setting parameter, and the output delay of the image data is different according to different image setting parameters; determining the total output delay of the audio data according to the output delay of the image data, the total output delay of the audio data being consistent with the output delay of the image data; when a change in the image setting parameter of the display device is monitored, re-determining the output delay of the image data in combination with the new image setting parameter; re-determining the total output delay of the audio data according to the output delay of the image data; determining the external audio output delay of the external audio output device according to the total output delay of the audio data and the internal audio output delay generated by the display device, or determining the internal audio output delay of the display device according to the total output delay of the audio data and the external audio output delay generated by the external audio output device; wherein the output delay of the audio data is equal to the sum of the internal audio output delay and the external audio output delay; controlling audio output according to the external audio output delay and the internal audio output delay.

Images