Display device, external device, and audio playback method

Abstract

The present application provides a display device, an external device, and an audio playback method. The method can automatically change the identification identifier of the display device to a first identifier after the user inputs a control instruction for enabling the low-latency sound mode, so that the external device can send the first audio data to the display device according to the first identifier. After receiving the first audio data, the display device plays the first audio data to achieve audio output. Since the sound effect processing time of the first audio data is shorter, the display device can quickly achieve audio output, reduce the delay time of sound playback, and solve the problem of audio and picture asynchrony of the display device in the low-latency picture mode.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device, an external device, and an audio playback method. Background Art

[0002] A display device refers to a terminal device that can output specific display images. It can be based on Internet application technology, have an open operating system and controller, have an open application platform, and can realize two-way human-computer interaction functions. It is a product that integrates multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users.

[0003] The display device also has an external device interface, which can be connected to an external device to receive and play audio and video data sent by the external device. For example, the display device may have a High Definition Multimedia Interface (HDMI). An external device such as a console can be connected to the display device via the HDMI interface and output game images to the display device, allowing the display device to display the game images on the large screen of the display device, providing a better gaming experience.

[0004] In gaming mode, the display device needs to reduce image display latency, i.e., enter low-latency mode, so that the display can quickly respond to the user's gaming operations. However, because gaming mode also requires specific sound effects processing for game sounds, when the display device activates low-latency mode, the sound lags behind the image by approximately 100ms, causing audio and video to become out of sync. Summary of the Invention

[0005] The present application provides a display device, an external device and an audio playback method to solve the problem of audio and video being out of sync in a traditional display device in a low-latency mode.

[0006] In a first aspect, the present application provides a display device comprising: a display, an external device interface, and a controller. The display is configured to display an interface; the external device interface is configured to connect to an external device; and the controller is configured to execute the following program steps:

[0007] Get the control command for enabling low-latency audio mode;

[0008] In response to the control instruction, modify the identification identifier of the display device to a first identifier; the identification identifier includes the first identifier; the first identifier is used to indicate that the display device supports a first audio decoding function;

[0009] Sending a connection request to the external device to establish an audio output channel;

[0010] The first audio data sent by the external device is received through the audio input channel, and the first audio data is played.

[0011] In a second aspect, the present application further provides an external device comprising: an output module and a processing module. The output module is configured to connect to a display device to send audio and video data to the display device; the processing module is configured to execute the following program steps:

[0012] Detecting an identification identifier of the display device, the identification identifier including a first identifier or a second identifier; the first identifier is used to indicate that the display device supports a first audio decoding function; the second identifier is used to indicate that the display device supports a second audio decoding function; and the sound effect processing time of the first audio is less than the sound effect processing time of the second audio;

[0013] If the identification identifier is the first identifier, sending first audio data to the display device;

[0014] If the identification mark is the second identification mark, second audio data is sent to the display device.

[0015] In a third aspect, the present application further provides an audio playback method, which is applied to the display device provided in the first aspect and the external device provided in the second aspect. The audio playback method comprises the following steps:

[0016] The display device obtains a control instruction for enabling a low-latency audio mode; and in response to the control instruction, modifies the identification identifier of the display device to a first identifier; the identification identifier includes the first identifier; the first identifier is used to indicate that the display device supports a first audio decoding function;

[0017] The display device sends a connection request to the external device to establish an audio output channel;

[0018] The external device sends first audio data to the display device through the audio input channel

[0019] The display device receives the first audio data and plays the first audio data.

[0020] It can be seen from the above technical solutions that the display device, external device and audio playback method provided by this application can automatically change the identification identifier of the display device to the first identifier after the user inputs a control instruction for enabling the low-latency sound mode, so that the external device can send the first audio data to the display device according to the first identifier. After receiving the first audio data, the display device plays the first audio data to achieve audio output. Since the sound effect processing time of the first audio data is shorter, the display device can quickly achieve audio output, reduce the delay time of sound playback, and solve the problem of audio and picture asynchrony of the display device in the low-latency picture mode. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solution of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] Figure 1 This is a schematic diagram of the application scenario structure of the display device in the embodiment of this application;

[0023] Figure 2 This is a schematic diagram of the hardware configuration of the display device in the embodiment of the present application;

[0024] Figure 3 This is a schematic diagram of the connection relationship between the display device and the external device in the embodiment of the present application;

[0025] Figure 4 This is a schematic diagram of the connection interface form in the embodiment of this application;

[0026] Figure 5 This is a schematic diagram of the process of obtaining audio and video data according to the identification identifier in an embodiment of the present application;

[0027] Figure 6 This is a schematic diagram of the image setting interface in the embodiment of the present application;

[0028] Figure 7 This is a schematic diagram of the display mode menu in the embodiment of the present application;

[0029] Figure 8 This is a diagram showing the relationship between automatic and rapid game response data transmission in an embodiment of the present application;

[0030] Figure 9 This is a flowchart of the audio output method in an embodiment of the present application;

[0031] Figure 10 Schematic diagram of a flow chart for generating a control instruction according to a mode setting state in an embodiment of the present application;

[0032] Figure 11This is a schematic diagram of the audio output process when the low-latency mode is turned off in an embodiment of the present application;

[0033] Figure 12 This is a schematic diagram of the process of outputting audio through an external audio playback device in an embodiment of the present application;

[0034] Figure 13 2 is a timing diagram of outputting audio signals in an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to make the purpose and implementation of this application clearer, the exemplary implementation of this application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only part of the embodiments of this application, not all of the embodiments.

[0036] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0037] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0038] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0039] The display device provided in the embodiments of the present application may have various implementation forms, for example, it may be a television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc.

[0040] Figure 1 Schematic diagram of an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown, the user can operate the display device 200 through the control device 300 or the control apparatus 100 .

[0041] In some embodiments, the control device 100 may be a remote controller. Communication between the remote controller and the display device may include infrared protocol communication, Bluetooth protocol communication, or other short-range communication methods, and the display device 200 may be controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, and the like.

[0042] In some embodiments, a control device 300 (such as a mobile phone, tablet computer, computer, laptop computer, etc.) can also be used to control the display device 200. For example, the display device 200 can be controlled using an application running on the control device 300.

[0043] In some embodiments, the display device 200 may not use the above-mentioned control device 300 or control apparatus 100 to receive instructions, but may receive user control through touch or gestures.

[0044] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the control device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.

[0045] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be connected to a local area network (LAN), a wireless local area network (WLAN), or other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be a single cluster or multiple clusters, and may include one or more types of servers.

[0046] like Figure 2 As shown, the display device 200 may include at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0047] In some embodiments, the controller 250 may include a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and first to nth interfaces for input / output.

[0048] The display 260 may include the following components, namely: a display screen component for presenting images; a driving component for driving image display; a component for receiving image signals output from the controller 250 to display video content, image content, and menu control interface, as well as a component for user control UI interface, etc.

[0049] The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0050] Communicator 220 is a component used to communicate with external devices or servers using various communication protocols. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, or other network communication protocol chip or a near-field communication protocol chip, as well as an infrared receiver. Display device 200 can use communicator 220 to send and receive control signals and data signals with external control device 100 or server 400.

[0051] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote controller, etc.).

[0052] Detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or detector 230 includes an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or detector 230 includes a sound collector, such as a microphone, for receiving external sounds.

[0053] The external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by multiple of the above interfaces.

[0054] The tuner / demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. In some embodiments, the controller 250 and the tuner / demodulator 210 may be located in different separate devices, that is, the tuner / demodulator 210 may also be located in an external device to the main device where the controller 250 is located, such as an external set-top box.

[0055] Controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. Controller 250 controls the overall operation of display device 200. For example, in response to receiving a user command to select a UI object for display on display 260, controller 250 may perform operations related to the object selected by the user command.

[0056] In some embodiments, the controller 250 includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM Random Access Memory (RAM), ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0057] In the embodiment of the present application, the connection between the display device 200 and the external device 500 refers to establishing a communication connection, and the display device 200 and the external device 500 that establish the communication connection serve as a receiving end (Sink end) and a sending end (Source end) respectively. Figure 3 As shown, the external device 500 can be a gaming device. When a user uses the gaming device, the external device 500 can output video data and audio data in real time for the gaming process, and send the video data and audio data to the display device 200 so that the video data and audio data are output as video images and sounds via the display device 200. In this case, the gaming device acts as a transmitter, and the display device 200 acts as a receiver.

[0058] The sending end and the receiving end can realize communication connection through a specific interface to transfer data. To this end, both the sending end and the receiving end should have a data interface with the same interface specification and function. For example, Figure 4 As shown, both the display device 200 and the external device 500 are equipped with a High Definition Multimedia Interface (HDMI). During use, the user can plug the two ends of the HDMI interface data cable into the display device 200 and the external device 500 respectively, and after starting the external device 500 and the display device 200, set the signal source of the display device 200 to the HDMI interface, thereby realizing data transmission between the display device 200 and the external device 500.

[0059] It should be noted that in order to achieve a communication connection between the display device 200 and the external device 500, other connection methods can be used between the display device 200 and the external device 500. In some embodiments, the connection method can be a wired connection method, such as DVI (Digital Visual Interface), VGA (Video Graphics Array), USB (Universal Serial Bus), etc.; it can also be a wireless connection method, such as wireless LAN, Bluetooth connection, infrared connection, etc. Different communication connection methods can use different information transmission protocols. For example, when an HDMI interface is used for connection, the HDMI protocol can be used for data transmission.

[0060] The data transmitted between the display device 200 and the external device 500 can be audio and video data. For example, the display device 200 can be connected to a gaming device via an HDMI interface. When a user plays a game, the gaming device can output video and audio data by running a game-related application. The video and audio data can be sent to the display device 200 via the HDMI protocol and output through the screen and speakers of the display device 200, playing the video and audio of the gaming device.

[0061] After the external device 500 is connected to the display device 200, data can be transmitted based on a specific standard so that the display device 200 can establish mutual recognition and a data transmission channel with the external device 500. Figure 5 As shown, according to the transmission rules specified by the HDMI interface protocol, the display device 200 can establish a connection with the external device 500 based on the extended display identification data (EDID) and realize mutual identification and control.

[0062] In some embodiments, the display device 200 can send the currently supported audio and video data decoding function to the external device 500 via EDID, so that the external device 500 can send audio and video data based on the display device 200's support for the audio and video data decoding function. For ease of description, in an embodiment of the present application, the audio data and video data sent by the external device 500 to the display device 200 can be collectively referred to as audio and video data. Obviously, the audio and video data are generated by the external device 500 by running a specific application. For example, when the external device 500 is a gaming device, the video data corresponds to the game screen, and the audio data corresponds to the game sound effects. The game screen can be sent to the display device 200 in the form of video data, and the game sound effects are sent to the display device 200 in the form of audio data.

[0063] In addition to transmitting video and audio data, the established data transmission channel can also be used to transmit identification information. The identification information may include the identification identifier of the display device 200 and the identification identifier of the external device 500. For example, the external device 500 can simultaneously send video and audio data to the display device 200 while receiving EDID information sent by the display device 200. After receiving the EDID information, the external device 500 can read the identification identifier of the current display device 200 in the EDID information to determine the audio and video decoding functions supported by the display device 200 based on the identification identifier.

[0064] Obviously, for display devices 200 with different hardware configurations, the corresponding supported audio and video decoding capabilities are different. For example, for audio data, when the display device 200 has an independent audio processing chip, the audio data sent by the external device 500 can be decoded through the audio processing chip, and sound effects such as Digital Theater System (DTS) and Dolby can be processed. For display devices 200 without an independent audio processing chip, audio pulse code modulation (PCM) data or linear pulse code modulation (LPCM) data is generally obtained, and audio is directly output after decoding.

[0065] For some external devices 500 connected to the display device 200, since they need to quickly complete the response of images and sounds during use, the display device 200 can provide a low-latency mode when such external devices 500 are running. For example, when the external device 500 is a gaming device, and the gaming device runs action, shooting, or racing games that require a fast response speed, the user expects that the display device 200 should be able to present the corresponding game screen changes and play game sound effects in a very short time after performing game interactive operations. At this time, the display device 200 can enter a low-latency mode, that is, the display device 200 can directly decode and output the video data by bypassing some unnecessary image quality processing programs, and present it on the screen of the display device 200 in a timely manner. Among them, the bypass function is a transmission method that allows two devices to be directly physically connected through a specific trigger state. After the bypass function connection is established between the two devices, the transmitted data no longer needs to be packetized, and the source end device can directly transmit the original data to the sink end device, thereby improving transmission efficiency.

[0066] The low-latency mode can be built into the operating system of the display device 200 as a playback mode for the user to choose to enable or disable. For example, the operating system of the display device 200 can have a built-in image mode control program that can interact with the user through a mode adjustment interface. Figure 6 As shown, in the mode adjustment interface, the mode options can be set in the control menu, and the user can set the image output mode of the display device 200 by clicking the normal mode option or the low delay mode option.

[0067] It should be noted that the normal mode and low-latency mode can be set to different specific mode names according to the operating system style or the type of the display device 200 in actual application. Figure 7 As shown in the figure, Normal mode can also be called Vivid mode, Standard mode, Energy Saving mode, Theater mode (including Theater Day and Theater Night), Filmmaker mode, etc. Low latency mode can also be called Game mode, Rapid Response mode, etc.

[0068] In some embodiments, low latency mode can be entered in multiple ways. For example, Figure 8 As shown, the user can select the game mode option through the image mode adjustment interface to control the display device 200 to enter low latency mode. The user can also choose to turn on the Instant Game Response switch in the setting interface of the display device 200, that is, set it to "on" to control the display device 200 to enter low latency mode. The user can also set the Instant Game Response in the setting interface to automatic, that is, Instant Game Response = auto, then when the display device 200 detects that the source information contains the ALLM (Auto Low Latency Mode) flag, the display device 200 is controlled to enter low latency mode.

[0069] For the display device 200 with low-latency mode enabled, it can quickly complete the image rendering and control the time difference between the user interaction operation and the image presentation within a delay time of less than or equal to 16ms, thereby achieving a low-latency effect. Since some display devices 200 may also have a built-in sound effect processing module, the sound effect processing module can process the audio data received by the display device 200 and adjust some parameters in the audio data to obtain sound effects adapted to specific scenes. These sound effect processing processes will also consume a certain amount of time, that is, the problem of audio and video being out of sync will occur. For example, when the image mode of the display device 200 is in low-latency mode, the video data is output through bypass to reduce the delay time. Relatively speaking, the processing speed of audio data will be slower than the processing speed of video data, so that the playback time difference of audio and video data is within the range of 120-150ms, that is, the sound lags behind the image by about 150ms, which is obviously beyond the range of human subjective perception.

[0070] To alleviate the issue of audio and video being out of sync, in some embodiments, the display device 200 can adopt a "fast waits for slow" principle, delaying the output of the first processed audio or video data until the other data is processed and then playing it synchronously. For example, in low-latency mode, the display device 200 needs to delay image processing, that is, cache image data, and wait for audio data to arrive, in order to achieve synchronization between audio and video.

[0071] However, the audio-visual synchronization method based on the "fast waits for slow" principle will increase the response time between interactive actions and the display image (or playing sound effects). For example, the low-latency mode requires the image delay to be less than or equal to 16ms. Therefore, adjusting the delay wait within the range of 0-16ms is of little significance and cannot effectively alleviate the problem of audio-visual asynchrony. If the wait time is further extended, the image delay time will exceed 16ms, and the low-latency effect cannot be achieved. Moreover, the audio-visual synchronization method based on the "fast waits for slow" principle has a high cost for caching images. The memory occupied by each frame of image data varies depending on the format. The higher the format, the more memory is occupied. Taking 4K video as an example, each frame of 4K video has a data volume of about 30MB. By caching image data, according to the physiological structure of the human eye, the human eye can experience visual persistence if the frame is less than 15 frames. Therefore, a minimum of 8 frames needs to be cached, which requires a memory capacity of more than 240M, which cannot be supported by the memory capacity of many display devices 200.

[0072] In order to improve the aforementioned long response time and excessive memory requirements, and at the same time alleviate the problem of audio and video being out of sync, some embodiments of the present application also provide an audio playback method, some steps of which can be applied to the display device 200, and some steps can be applied to the external device 500 connected to the display device 200. Obviously, when implementing the audio playback method, the display device 200 and the external device 500 require certain hardware support. That is, the display device 200 includes a display 260, an external device interface 240, and a controller 250; the display external device 500 includes at least an output module 510 and a processing module 520.

[0073] The display 260 is used to display the screen corresponding to the audio data sent by the external device 500 through the user interface, and the external device interface 240 is used to connect to the output module 510 of the external device 500 to obtain audio and video data. Figure 9 As shown, the controller 250 and the processing module 520 are respectively used to execute the program steps corresponding to the audio playback method, which specifically include the following:

[0074] Get the control instruction for enabling the low-latency sound mode. The control instruction for enabling the low-latency sound mode can be actively input by the user, or it can be automatically generated by the display device 200 through the monitoring results of the current operating status. That is, in some embodiments, the display device 200 can obtain the control instruction for enabling the low-latency sound mode based on the interactive action input by the user. For example, the user can call up the setting menu interface through the button on the display device 200 or the button on the control device 100 supporting the display device 200. And control the focus cursor on the setting menu interface to move through the direction keys. When the user moves the focus cursor to the low-latency mode option and presses the "confirm button", the low-latency mode of the display device 200 is turned on. At this time, the display device 200 obtains the control instruction for enabling the low-latency sound mode.

[0075] It should be noted that the low-latency picture mode and the low-latency sound mode of the display device 200 can be uniformly configured in one mode, namely the low-latency mode. Then when the user chooses to turn on or off the low-latency mode, the display device 200 can enable the low-latency picture mode and the low-latency sound mode at the same time. The low-latency picture mode and the low-latency sound mode can also be two independent modes, and support users to set them separately. For example, the two low-latency modes can be in different setting menus or interfaces, that is, the low-latency picture mode option can be in the submenu of the image setting option, and the low-latency sound mode can be in the submenu of the sound setting option.

[0076] like Figure 10As shown, in some embodiments, the display device 200 can automatically generate a control instruction for enabling the sound low-latency mode when it determines that the low-latency mode needs to be enabled based on the current operating state. The display device 200 can obtain a mode setting state during operation, wherein the mode setting state includes one of an on-low-latency state, an off-low-latency state, and an automatic mode state. If the mode setting state is an on-low-latency state, a control instruction for enabling the sound low-latency mode is generated. If the mode setting state is an automatic state, the display device 200 can monitor the audio and video data sent by the external device 500 and generate a control instruction based on the monitoring result.

[0077] In some embodiments, the display device 200 may first acquire audio and video data, where the audio and video data includes video data, audio data, and source information. The source information is informational data content established according to the transmission protocol between the display device 200 and the external device 500, and can be used to transmit the respective operating status and control instructions of the display device 200 and the external device 500 to achieve coordinated control.

[0078] Therefore, after obtaining the audio and video data, the display device 200 can parse the source information from the audio and video data. The source information includes a flag for the automatic low-latency mode. The display device 200 can determine whether the current operating state of the external device 500 requires the display device 200 to enable the low-latency mode by reading the status value of the automatic low-latency mode flag. If the status value is on, a control instruction for enabling the audio low-latency mode is generated, which causes the display device 200 to obtain the control instruction for enabling the audio low-latency mode.

[0079] After receiving a control instruction for enabling the low-latency audio mode, the display device 200 may, in response to the control instruction, modify the display device's identification identifier to a first identifier. The identification identifier may include a first identifier or a second identifier; the first identifier indicates that the display device supports a first audio decoding function; the second identifier indicates that the display device supports a second audio decoding function; and the sound effect processing time of the first audio is less than the sound effect processing time of the second audio.

[0080] For example, when the external device 500 identifies the display device 200 via EDID, the identification data corresponding to the EDID may include parameter bits corresponding to the identification identifier. By reading the specific data values in the parameter bits, the external device 500 can obtain the data processing supported by the display device 200. Here, the identifier indicating that the current display device 200 supports low-level sound effects such as PCM and LPCM is the first identifier; the identifier indicating that the current display device 200 supports high-level sound effects such as DTS and dobly is the second identifier.

[0081] Low-level sound effects such as PCM and LPCM have lower requirements for audio data, such as only needing to include content audio. However, high-level sound effects such as DTS and dobly have higher requirements for audio data. While including content-related audio, they also include ambient sound, azimuth sound, and other sound-effect-related audio. This makes the display device 200 take longer to process the second audio effect than the first audio effect, which is not conducive to achieving low-latency mode. Therefore, in this embodiment, after starting low-latency mode, the display device 200 can modify the identification data corresponding to the EDID so that the specific value of the parameter bit corresponding to the identification identifier is the first identifier corresponding to low-level sound effects such as PCM and LPCM.

[0082] Since identification data containing identifiers such as EDID is generally sent to the external device 500 via protocol data, in some embodiments, during the step of modifying the display device's identification identifier to the first identifier, the display device 200 can extract an initial identification configuration file from the protocol data corresponding to the external device interface 240, i.e., extract the file containing the identification identifier before the modification to the first identifier. The identification identifier in the initial identification configuration file is then read. If the identification identifier in the initial identification configuration file is the second identifier, indicating that the external device 500 currently supports advanced audio processing, the external device 500 sends audio data adapted for the advanced audio processing algorithm to the display device 200. At this point, the display device 200 can delete the initial identification configuration file and create an updated identification configuration file. The updated identification configuration file contains the first identifier, indicating that the external device 500 currently supports low-level audio processing. The updated identification configuration file is then added to the protocol data, causing the external device 500 to send audio data adapted for the low-level audio processing algorithm to the display device 200.

[0083] For example, when low-latency mode is not enabled, if the protocol data sent by display device 200 to external device 500 includes protocol data identifying support for DTS sound effects, external device 500 can send audio data corresponding to DTS sound effects to display device 200. When display device 200 detects that the user has enabled low-latency mode, display device 200 can delete the initial identification profile in the protocol data and then create an updated identification profile identifying support for PCM sound effect processing, so that external device 500 can send PCM audio data to display device 200, reducing the time it takes for display device 200 to process audio data.

[0084] It should be noted that, in the process of deleting the initial identification configuration file, since the external device 500 detects that the current display device 200 supports low-level sound effect processing, the audio data subsequently sent by the external device 500 to the display device 200 are all audio data corresponding to the low-level sound effect processing form. However, if the user turns off the low-latency mode, that is, if he wants to obtain high-quality sound effects, he also needs to change the identification identifier back to the second identifier. Based on this, when deleting the initial identification configuration file, the display device 200 can move the initial identification configuration file to be deleted to the backup database for storage, so that it can be directly called from the backup database when the low-latency mode is subsequently turned off, without the need to re-perform device identification detection, thereby facilitating rapid mode switching.

[0085] After adjusting the identification identifier to the first identifier, the display device 200 can send a connection request to the external device 500. The connection request is used to trigger the re-establishment of the audio output channel between the display device 200 and the external device 500. Different connection request forms can be used depending on the interface method between the display device 200 and the external device 500. For example, when the display device 200 and the external device 500 are connected via an HDMI interface, the connection request can be a hot plug connection request. A hot plug connection request is a signal that mimics the voltage change when hardware is connected. When the external device 500 receives the hot plug connection request, it is equivalent to a new device being connected to the external device 500. At this time, the external device 500 can be triggered to read the identification identifier of the connected device and establish a new audio output channel based on the identification identifier. When the display device 200 and the external device 500 are connected via a wireless transmission method, the connection request can be an initialization connection request under the corresponding wireless connection method. The initialization connection request can imitate the first connection state to trigger the external device 500 to re-establish the wireless connection with the display device 200 based on the new identification identifier.

[0086] It's important to note that the audio output channel established based on the connection request is physically identical to the original audio output channel, but differs in the type of data being transmitted. Therefore, before the connection request is sent, the physical channel is used to transmit the second audio data, i.e., the audio data corresponding to the high-level sound effects; after the connection request is sent, the physical channel is used to transmit the first audio data, i.e., the audio data corresponding to the low-level sound effects.

[0087] In addition, in the embodiment of the present application, the high-level sound effects and the low-level sound effects are only used to distinguish audio data with different sound effect processing times, and do not limit the types of sound effects. Since some relatively high-level audio data with a short processing time can also be processed as low-level sound effect data, in order to determine the first audio and the second audio, the display device 200 and the external device 400 can have a built-in device information table, and the device information table can record the sound effect processing methods supported by the display device 200, as well as the audio data types corresponding to various sound effects. Moreover, based on pre-test conditions, the sound effect processing times corresponding to various sound effect processing methods can be classified, so that sound effects with short processing times are classified as low-level sound effects, and the corresponding audio data are the first audio; and sound effects with long processing times are classified as high-level sound effects, and the corresponding audio data are the second audio.

[0088] After establishing the audio output channel, the external device 500 can send audio data matching the identification identifier to the display device 200 based on the newly established audio output channel. Specifically, the external device 500 detects the identification identifier of the display device. If the identification identifier is the first identifier, the first audio data is sent to the display device; if the identification identifier is the second identifier, the second audio data is sent to the display device.

[0089] For example, if the external device 500 is a game box, when the display device 200 changes the supported audio processing mode to PCM / LPCM through EDID and sends a hot plug request to the game box, the game box can first read the EDID and then perform a handshake with the display device 200, thereby using the game box as the source end. It will change the output audio data format to PCM or LPCM according to the request sent by the display device 200 sync end.

[0090] Corresponding to the external device 500 sending the first audio data through the audio output channel, the display device 200 can receive the first audio data through the audio output channel and play the received first audio data. During the playback of the first audio data, since the sound effect processing time of the first audio data is shorter than that of the second audio data, the display device 200 can decode the first audio data more efficiently and can output the sound signal in a shorter time, achieving a low-latency effect.

[0091] As can be seen in the above embodiment, after the user activates low-latency mode, the display device 200 can change the format of the audio data received by the display device 200 by modifying the identification flag, thereby triggering the external device 500 to send the first audio data with a shorter sound effect processing time to the display device 200. By adjusting the output data format on the source side, the sound effect processing time of the display device 200 can be shortened, allowing the display device 200 to output sound responses in a shorter time, thus achieving low-latency audio functionality.

[0092] Similarly, when the user controls the display device 200 to switch from low-latency mode back to normal mode, the display device 200 also needs to modify the identification mark so that the external device 500 can send higher-quality audio data or video data to the display device 200 to improve the media playback effect. Figure 11 As shown, in some embodiments, the display device 200 can obtain a shutdown instruction for disabling the low-latency audio mode. Similar to the control instruction for enabling the low-latency audio mode, the shutdown instruction can also be manually input by the user or automatically generated by the display device 200 after detecting the current operating state.

[0093] For example, the audio low-latency mode switch is set to "off" by default and is linked to the image low-latency mode menu. When the user sets the image low-latency mode switch to "on", the display device 200 automatically turns on the audio low-latency mode. When the user sets the image low-latency mode switch to "off", the display device 200 automatically turns off the audio low-latency mode, that is, obtains the off instruction.

[0094] After receiving the shutdown instruction, the display device 200 can respond to the shutdown instruction by modifying its identification identifier to the second identifier. This notifies the external device 500 that the display device 200 currently supports the advanced audio processing mode, allowing the external device 500 to feed the second audio data back to the display device 200 based on the second identifier. The display device 200 then sends a connection request to the external device 500 to reestablish the audio output channel. The display device 200 then receives the second audio data sent by the external device 500 through the audio input channel and plays the second audio data.

[0095] For example, when the low-latency sound mode is turned on, if the identification mark in the EDID of the display device 200 indicates that it supports the PCM sound processing function, the external device 500 can send audio data in PCM format to the display device 200. After the user turns off the low-latency sound mode, the display device 200 can change the identification mark in the EDID to support the DTS sound processing function. At this time, the external device 500 will feedback the DTS audio data to the display device 200 based on the identification mark. After receiving the DTS audio data, the display device 200 performs sound processing on the audio data according to the DTS sound processing algorithm to obtain high-quality audio output effects.

[0096] It should be noted that in the above embodiments, the display device 200 may be a television, an integrated audio and video display, a mobile phone, a smart screen, etc., which has a built-in speaker or other audio output device. However, for some display devices 200, due to the limitations of their hardware configuration, they do not have a built-in audio output device, that is, the display device 200 itself cannot output sound. Therefore, in order to output sound, in some embodiments, the user can also connect an audio playback device through the external device interface 240 or the audio output interface 270. For example, the display device 200 can be connected to an audio device through a USB interface (external device interface 240), or an AV interface (audio output interface 270), or a Bluetooth connection module (communicator 220). And when sound needs to be output, the sound signal is sent to the audio device to output the sound through the audio device.

[0097] like Figure 12 As shown, for this display device 200 that outputs sound through an external device, the audio data sent by the external device 500 can also be directly passed to the audio output device by constructing an audio bypass, so that the first audio data can be decoded and processed by the audio output device. That is, after the display device 200 obtains the first audio data sent by the external device 500, it detects whether an audio playback device is currently connected to the external device interface 240, the audio output interface 270, and the communicator 220. If an audio playback device is connected to the above components, the display device 200 can construct an audio bypass for transmitting the first audio data, and forward the received first audio data to the audio playback device by means of a bypass, so as to trigger the audio playback device to perform decoding on the first audio data.

[0098] For example, after the display device 200 modifies the EDID to support PCM sound effects, the game box can feed back audio data in PCM format to the display device 200 according to the EDID. The display device 200 then detects the access status of the USB interface. When the USB interface is connected to an audio device, the audio data in PCM format can be transmitted to the audio device in a bypass manner. After receiving the audio data in PCM format, the audio device decodes the audio data and converts it into a sound signal for output. When the USB interface is not connected to an audio device, the display device 200 can decode the received audio data through a decoding program, thereby converting it into a sound signal for output from the local speaker of the display device 200.

[0099] As can be seen, in the above embodiment, when the display device 200 outputs sound signals through an external device, the display device 200 can modify the sound processing link after the user activates low-latency mode. That is, the display device 200 sends the sound to the audio playback device for decoding in a bypass manner, so that the audio data reaches the external device as quickly as possible, reducing playback delay and achieving the effect of synchronized image and sound output.

[0100] Similarly, when the user controls the display device 200 to turn off the low-latency mode, the display device 200 can traverse the device connected to the external device interface 240 when playing the second audio data. If the external device interface 240 is connected to an audio playback device, the audio bypass is turned off, and audio decoding is performed on the second audio data to generate an audio signal. The decoded audio signal is then sent to the audio playback device for playback via the audio playback device.

[0101] That is, when low-latency audio mode is disabled, the audio data sent by the external device 500 is still decoded and processed by the display device 200. This allows the display device 200 to utilize its enhanced audio processing capabilities to achieve higher-quality sound and enhance the user experience. Furthermore, this reduces the hardware requirements for the audio playback device connected to the display device 200, improving product promotion.

[0102] Since the audio data format received by the display device 200 changes when switching to the low-latency mode, the display device 200 may experience popping sounds at the moment of switching the audio signal when switching the audio format, thereby reducing the user experience. To this end, in some embodiments, the display device 200 may also turn on the silent mode when switching modes. That is, the display device 200 may turn on the silent mode before modifying the identification identifier of the display device to the first identifier; and when the display device 200 decodes the first audio data, the display device 200 may monitor the decoding process in real time, and when it detects that the display device 200 has completed decoding, the silent mode may be turned off to continue outputting the sound signal.

[0103] When the display device 200 plays a sound signal through an external device, the display device 200 can receive a decoding success signal from the audio playback device after sending the first audio data to the audio playback device. When the audio playback device returns the decoding success signal, the display device 200 can turn off the mute mode to continue to output sound through the audio playback device.

[0104] For example, when the user turns on low-latency mode or game mode, the display device 200 will first turn on silent mode and mute the entire device to prevent popping sounds when switching modes. Then, by deleting the original local EDID and generating a new EDID, and the local device initiates a hot plug application so that the game box connected through the HDMI interface can send PCM / LPCM data according to the current EDID after receiving the application. The display device 200 then determines whether each interface is currently connected to a sound peripheral speaker. If a peripheral speaker is connected, the game box is directly sent to the audio data in the buffer on the display device 200 end, and sent to the peripheral speaker via bypss. And the feedback signal of the HDMI signal analysis stability is detected. When the display device 200 receives the instruction that the HDMI signal analysis is stable, the display device 200 then initiates an unmute instruction to turn off the silent mode. At this point, the process of turning on low-latency mode or game mode is completed.

[0105] Similarly, when the display device 200 turns off low-latency audio mode, popping sounds are also prone to occur. Therefore, the display device 200 can also enable silent mode after receiving the shutdown command and turn off silent mode after signal analysis stabilizes. For example, when the user controls the display device 200 to turn off low-latency mode or game mode, the display device 200 needs to first enable silent mode to mute the entire device to prevent popping sounds when switching modes. The local EDID that supports LPCM / PCM is then deleted, and the device information of the display device 200 is extracted from the data backup to generate a new EDID. The new EDID supports advanced audio processing such as dobly and DTS. The display device 200 then initiates a hot plug request, so that after receiving the request, the game box sends the corresponding audio data according to the current EDID. At the same time, the display device 200 determines whether a sound peripheral is connected. If a peripheral is connected, the bypass audio circuit is disabled, and the system-on-chip (SOC) of the display device 200 is restored to perform decoding, encoding, and audio processing, and then sends the data to the peripheral for sound output. Then, the HDMI signal parsing is detected and stabilized. When the HDMI signal parsing is stable, the unmute command is issued to turn off the mute mode. At this point, the process of turning off the low-latency mode or game mode is completed.

[0106] In the above embodiment, the display device 200 achieves low-latency image processing by disabling unnecessary image quality processing, and achieves low-latency sound processing by adjusting the output data format of the source end and / or modifying the sound processing link. The low-latency implementation provided in the above embodiment can shorten the processing time of image and sound data in the display device 200, so that the delay of the image and sound output by the display device 200 can be controlled to a range of less than or equal to 16ms.

[0107] In some embodiments, when the user does not pay attention to the delay of picture and sound, that is, turns off the low delay mode, the display device 200 can also detect the signal generation time difference between audio data and video data in the audio and video data, and set the delay time of the audio data according to the signal generation time difference obtained by the detection, so as to play the audio data according to the delay time.

[0108] For example, the display device 200 can detect the time T1 for forming a video signal and the time T2 for forming a sound signal after decoding in normal mode. Then calculate the difference ΔT between the formation time of the two signals, that is, ΔT = |T2-T1|. Then judge the time difference ΔT. When the time difference is greater than or equal to the synchronization threshold T0, that is, ΔT≥T0, it is determined that there is an abnormality of asynchrony between the current picture and sound. Therefore, the delay time of the audio data can be set according to the signal generation time difference ΔT, that is, the audio signal can be played in advance or delayed by ΔT to achieve synchronization with the picture. In addition, when the time difference is less than the synchronization threshold T0, that is, ΔT<T0, it is determined that the current sound and image playback difference is within a reasonable range, and there is no problem of audio and video asynchrony. Then the display device 200 can meet user needs in a normal audio and video playback manner.

[0109] Based on the audio playing method provided in the above embodiment, a display device 200 is also provided in some embodiments of the present application. Figure 13 As shown, the display device 200 includes: a display 260, an external device interface 240, and a controller 250. The display 260 is configured to display a user interface and a video image sent by an external device 500; the external device interface 240 is configured to connect to the external device 500; and the controller is configured to execute the following program steps:

[0110] Get the control command for enabling low-latency audio mode;

[0111] In response to the control instruction, modify the identification identifier of the display device to a first identifier; the identification identifier includes a first identifier or a second identifier; the first identifier is used to indicate that the display device supports a first audio decoding function; the second identifier is used to indicate that the display device supports a second audio decoding function; and the sound effect processing time of the first audio is less than the sound effect processing time of the second audio;

[0112] Sending a connection request to the external device to establish an audio output channel;

[0113] The first audio data sent by the external device is received through the audio input channel, and the first audio data is played.

[0114] In conjunction with the display device 200, some embodiments of the present application further provide an external device 500. The external device 500 includes an output module 510 and a processing module 520. The output module 510 is configured to connect to the display device 200 to send audio and video data to the display device 200; the processing module 520 is configured to execute the following program steps:

[0115] Detecting an identification identifier of the display device, the identification identifier including a first identifier or a second identifier; the first identifier is used to indicate that the display device supports a first audio decoding function; the second identifier is used to indicate that the display device supports a second audio decoding function; and the sound effect processing time of the first audio is less than the sound effect processing time of the second audio;

[0116] If the identification identifier is the first identifier, sending first audio data to the display device;

[0117] If the identification mark is the second identification mark, second audio data is sent to the display device.

[0118] It can be seen from the above technical solution that the display device 200 and the external device 500 provided in the above embodiment can automatically change the identification identifier to the first identifier after the display device 200 obtains the control instruction for enabling the low-latency sound mode, so that the external device 500 can send the first audio data to the display device 200 according to the first identifier. After receiving the first audio data, the display device 200 plays the first audio data to achieve audio output. Since the sound effect processing time of the first audio data is shorter, the display device can quickly achieve audio output, reduce the delay time of sound playback, and solve the problem of audio and picture asynchrony of the display device in the low-latency picture mode.

[0119] Similar parts between the embodiments provided in this application can be referenced to each other. The specific implementation methods provided above are only a few examples under the overall concept of this application and do not constitute a limitation on the scope of protection of this application. For those skilled in the art, any other implementation methods expanded based on the scheme of this application without expending creative work shall fall within the scope of protection of this application.

Claims

1. A display device, characterized in that: include: monitor; At least one HDMI port; The controller is configured as: After the gaming device is connected via the HDMI interface, a hot plug connection request is sent to the gaming device to trigger the gaming device to read an identification identifier preset by the display device, and when a second identifier is read, send second audio data corresponding to a second audio decoding function; Receive a control command for enabling a low-latency audio mode; In response to the control instruction, changing the identification identifier from the second identifier to the first identifier; Re-sending a hot plug connection request to the gaming device via the HDMI interface to trigger the gaming device to read the modified identification identifier, and, when the first identifier is read, to send first audio data corresponding to a first audio decoding function; receiving the first audio data through the HDMI interface, and decoding and performing sound effect processing on the first audio data before playing the first audio data; The first identifier is used to indicate that the display device supports the first audio decoding function, where the first audio decoding function refers to a function of decoding audio data corresponding to the first sound effect; The second identifier is used to indicate that the display device supports the second audio decoding function, where the second audio decoding function refers to a function of decoding audio data corresponding to the second sound effect; The sound effect processing time of the audio data corresponding to the first sound effect is shorter than the sound effect processing time of the audio data corresponding to the second sound effect.

2. The display device according to claim 1, wherein The controller changes the identification mark from the second mark to the first mark in response to the control instruction, and is further configured to: Extracting an initial identification configuration file from the protocol data of the HDMI interface; If the identification identifier in the initial identification configuration file is not the first identifier, deleting the initial identification configuration file; Creating an update identification configuration file, wherein the identification identifier in the update identification configuration file is the first identification; The update identification configuration file is added to the protocol data.

3. The display device according to claim 1, wherein After the controller is connected to the gaming device via the HDMI interface, it sends a hot plug connection request to the gaming device to trigger the gaming device to read the identification identifier preset by the display device, and when a second identifier is read, sends second audio data corresponding to a second audio decoding function. After the gaming device is connected via the HDMI interface, the hot plug connection request is sent to the gaming device to trigger the gaming device to establish an audio output channel with the display device when the second identifier is read, wherein the audio output channel is used to transmit the second audio data; The controller resends a hot plug connection request to the gaming device via the HDMI interface to trigger the gaming device to read the modified identification identifier, and when the first identifier is read, sends first audio data corresponding to the first audio decoding function, and is further configured to: The hot plug connection request is sent again to the gaming device through the HDMI interface, so that when the gaming device reads the first identifier, it re-establishes an audio output channel with the display device according to the first identifier, and the re-established audio output channel is used to transmit the first audio data.

4. The display device according to claim 1, wherein The controller changes the identification identifier of the display device from the second identifier to the first identifier in response to the control instruction, and is further configured to: Before changing the identification identifier of the display device from the second identifier to the first identifier, turning on a silent mode; The controller receives the first audio data through the HDMI interface and is further configured to: After detecting that decoding of the first audio data is completed, the silent mode is turned off.

5. The display device according to claim 1, wherein The controller is further configured to: Receive a shutdown command for shutting down the low-latency audio mode; In response to the shutdown instruction, changing the identification identifier of the display device from the first identifier to the second identifier; sending a hot plug connection request to the gaming device to trigger the gaming device to read the modified identification identifier of the display device, and upon reading the second identifier, re-establishing an audio output channel with the display device according to the second identifier and sending the second audio data; wherein the re-established audio output channel is used to transmit the second audio data; The second audio data is received through the re-established audio output channel, and the second audio data is played.

6. The display device according to claim 1, wherein The controller is further configured to: Get mode setting status; If the mode setting state is an automatic state, obtaining audio and video data, the audio and video data including video data, audio data and film source information; Parsing source information from the audio and video data, wherein the source information includes an automatic low-latency mode flag; Read the status value of the automatic low latency mode flag; If the state value is on, a control instruction for enabling a low-latency audio mode is generated.

7. The display device according to claim 6, wherein: After obtaining the mode setting state, the controller is further configured to: If the mode setting state is low latency off, obtaining audio and video data, the audio and video data including video data, audio data and source information; detecting a signal generation time difference between the audio data and the video data in the audio and video data; Generating a time difference according to the signal, setting a delay time of the audio data; The audio data is played according to the delay time.

8. The display device according to claim 1, wherein The controller receives the first audio data through the HDMI interface and is further configured to: When it is detected that an audio playback device is connected, establishing an audio bypass for transmitting the first audio data; The first audio data is delivered to the audio playback device through the audio bypass to trigger the audio playback device to decode the first audio data.

9. The display device according to claim 5, wherein: The controller plays the second audio data and is further configured to: Traversing the devices connected to the at least one HDMI interface; If an audio playback device is connected to the HDMI interface and an audio bypass has been established, closing the audio bypass; wherein the audio bypass is used to transmit the undecoded first audio data from the display device to the audio playback device; performing audio decoding on the second audio data based on the second audio decoding function to generate an audio signal; The audio signal is sent to the audio playback device so that the audio signal is played through the audio playback device.

10. The display device according to any one of claims 1 to 9, characterized in that: The first sound effect includes at least one of pulse code modulation (PCM) and linear pulse code modulation (LPCM); The second sound effect includes at least one of the digital theater system DTS and Dolby dobly.

11. A gaming device, characterized in that: include: an output module, configured to connect to a display device to send audio and video data to the display device; The processing module is configured to: receiving a hot plug connection request sent by the display device; Reading an identification identifier of the display device, the identification identifier including a first identifier or a second identifier; the first identifier is used to indicate that the display device supports a first audio decoding function, where the first audio decoding function refers to a function of decoding audio data corresponding to a low-level sound effect; the second identifier is used to indicate that the display device supports a second audio decoding function, where the second audio decoding function refers to a function of decoding audio data corresponding to a high-level sound effect, wherein an audio effect processing time of the audio data corresponding to the low-level sound effect is shorter than an audio effect processing time of the audio data corresponding to the high-level sound effect; establishing an audio output channel with the display device according to the identification identifier, wherein the audio output channel is used to transmit audio data, and the audio data corresponds to the audio decoding function corresponding to the identification identifier; If the identification identifier is the first identifier, sending first audio data to the display device through the audio output channel, the first audio data corresponding to the first audio decoding function; If the identification identifier is the second identifier, second audio data is sent to the display device through the audio output channel, and the second audio data corresponds to the second audio decoding function.

12. An audio playback method, characterized in that: include: After the display device is connected to the gaming device, a hot plug connection request is sent to the gaming device to trigger the gaming device to read an identification identifier preset by the display device, and when a second identifier is read, send second audio data corresponding to a second audio decoding function; The display device receives a control instruction for enabling a low-latency audio mode; The display device changes the identification mark from the second mark to the first mark in response to the control instruction; The display device sends a hot plug connection request to the gaming device again to trigger the gaming device to read the modified identification identifier, and when the first identifier is read, to send the first audio data corresponding to the first audio decoding function; The display device receives the first audio data, and decodes and processes the first audio data with sound effects before playing the first audio data; The first identifier is used to indicate that the display device supports the first audio decoding function, where the first audio decoding function refers to a function of decoding audio data corresponding to the first sound effect; The second identifier is used to indicate that the display device supports the second audio decoding function, where the second audio decoding function refers to a function of decoding audio data corresponding to the second sound effect; The sound effect processing time of the audio data corresponding to the first sound effect is shorter than the sound effect processing time of the audio data corresponding to the second sound effect.

Images