Display apparatus and method for controlling same

Abstract

A display device disclosed herein comprises: a first connection interface connected to a source device; a second connection interface connected to an acoustic output device; a first controller for using a first data channel of the first connection interface to perform a first lip sync adjustment on a video output and an audio output; a second controller for using a second data channel of the second connection interface to perform a second lip sync adjustment on the video output and the audio output; and a main controller for determining the first lip sync adjustment by the first controller or the second lip sync adjustment by the second controller on the basis of whether the source device supports the first lip sync adjustment through the first data channel.

Description

Display device and control method thereof

[0001] The disclosed invention relates to a display device capable of performing lip sync adjustment of video output and audio output and a control method thereof.

[0002] The display device may include various connection interfaces for connection to external devices. For example, the display device may include a High Definition Multimedia Interface (HDMI). The display device may be connected to at least one of a source device and an audio output device via the connection interface. As a sink device, the display device may receive source data, including video data and audio data, from the source device.

[0003] A display device can process video data to output video and process audio data to output audio to an audio output device. Depending on the performance of the display device and the source data, the time required to process video data and the time required to process audio data may differ. If there is a difference between the video latency due to the video data processing time and the audio latency due to the audio data processing time, lip sync between the video and audio outputs may not match. To synchronize the video and audio outputs, various techniques exist to adjust lip sync between the video and audio outputs.

[0004] The disclosed invention provides a display device and a control method thereof, which can prevent errors caused by the overlapping application of multiple lip-sync control techniques by selectively using one of the multiple lip-sync control techniques.

[0005] A display device according to one embodiment may include: a first connection interface connected to a source device; a second connection interface connected to an audio output device; a first controller configured to perform a first lip sync adjustment for video output and audio output using a first data channel of the first connection interface; a second controller configured to perform a second lip sync adjustment for the video output and the audio output using a second data channel of the second connection interface; and a main controller configured to determine the first lip sync adjustment by the first controller or the second lip sync adjustment by the second controller based on whether the source device supports the first lip sync adjustment through the first data channel.

[0006] A method for controlling a display device according to one embodiment may include: identifying, by a processor, whether the source device supports a first lip sync adjustment for a video output and an audio output using a first data channel of the first connection interface; and determining, by the processor, the first lip sync adjustment using the first data channel or the second lip sync adjustment for the video output and the audio output using a second data channel of the second connection interface based on whether the source device supports the second lip sync adjustment via the first data channel.

[0007] The disclosed display device and its control method can appropriately adjust the synchronization of video output and audio output by selectively using one of a plurality of lip sync control techniques. In other words, the disclosed display device and its control method can prevent errors occurring due to the overlapping application of a plurality of lip sync control techniques.

[0008] Figure 1 illustrates a system according to one embodiment.

[0009] Figure 2 illustrates a configuration of a display device according to one embodiment.

[0010] FIG. 3 is a flowchart illustrating a method for controlling a display device according to one embodiment.

[0011] FIG. 4 is a flowchart explaining in more detail the control method of the display device described in FIG. 3.

[0012] Figure 5 is a flowchart illustrating an example of data and information exchange between a display device, a source device, and an audio output device.

[0013] Figure 6 is a flowchart illustrating another example of data and information exchange between a display device, a source device, and an audio output device.

[0014] It should be understood that the various embodiments and terms used in this document are not intended to limit the technical features described in this document to specific embodiments, but rather to include various modifications, equivalents, or substitutes of the embodiments.

[0015] In connection with the description of the drawings, similar reference numerals may be used for similar or related components.

[0016] The singular form of a noun corresponding to an item may include one or more items, unless the context clearly indicates otherwise.

[0017] In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in that phrase, or all possible combinations thereof. For example, "at least one of A, B, and C" can refer to A, B, C, a combination of A and B, a combination of A and C, a combination of B and C, or a combination of A, B, and C.

[0018] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not qualify the components in any other respect (e.g., importance or order).

[0019] When a component (e.g., a first component) is referred to as being “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0020] The terms “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in this document, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0021] When a component is said to be “connected,” “coupled,” “supported,” or “in contact with” another component, this includes not only cases where the components are directly connected, coupled, supported, or in contact, but also cases where the components are indirectly connected, coupled, supported, or in contact through a third component.

[0022] When we say that a component is "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where there is another component between the two components.

[0023] The term “and / or” includes any combination of a plurality of related described elements or any one of a plurality of related described elements.

[0024] The operating principle and embodiments of the present invention will be described with reference to the attached drawings below.

[0025] Figure 1 illustrates a system according to one embodiment.

[0026] Referring to FIG. 1, the system (1) may include a display device (10), a source device (20), and an audio output device (30). The display device (10) and the source device (20) may be connected via a first cable (C1). The display device (10) and the audio output device (30) may be connected via a second cable (C2).

[0027] Various connection interfaces may be used for connecting the display device (10) and the source device (20) and for connecting the display device (10) and the audio output device (30). For example, the connection interface may include an HDMI (High Definition Multimedia Interface). The first cable (C1) and the second cable (C2) may be HDMI (High Definition Multimedia Interface) cables.

[0028] The display device (10) may include various devices capable of displaying images and / or videos. The display device (10) may also output audio. For example, the display device (10) may correspond to a light-emitting diode (LED) display device, a liquid crystal display (LCD) device, an organic light-emitting diode (OLED) display device, an inorganic light-emitting diode display device, or a beam projector. The display device (10) is not limited to those exemplified.

[0029] A source device (20) can transmit source data including video data and audio data to a display device (10). For example, the source device (20) may correspond to a set-top box, a cable receiver, a satellite broadcast receiver, a personal computer, a game console, a smartphone, or a Blu-ray disc player. The source device (20) is not limited to those exemplified.

[0030] The display device (10) can receive source data including video data and audio data from the source device (20) and process the source data. In other words, the display device (10) can correspond to a sink device. The display device (10) can process video data to output video through the display (140). The display device (10) can process audio data to output audio through a speaker (150) or an audio output device (30).

[0031] The audio output device (30) may include various devices capable of outputting audio. For example, the audio output device (30) may correspond to a sound bar or an AV (Audio Video) receiver. The audio output device (30) is not limited to those exemplified. The audio output device (30) may receive audio data from the display device (10). The audio output device (30) may output audio based on the received audio data.

[0032] Figure 2 illustrates a configuration of a display device according to one embodiment.

[0033] Referring to FIG. 2, the display device (10) may include a first connection interface (101) and a second connection interface (102). The first connection interface (101) and the second connection interface (102) may be of the same type and may correspond to a High Definition Multimedia Interface (HDMI). The source device (20) may be connected to the display device (10) through the first connection interface (101). The audio output device (30) may be connected to the display device (10) through the second connection interface (102).

[0034] The first connection interface (101) and the second connection interface (102) may each include various data channels. For example, the first connection interface (101) and the second connection interface (102) corresponding to HDMI may include a Transition Minimized Differential Signaling (TMDS) channel, a Display Data Channel (DDC), a Status and Control Data Channel (SCDC), and a Consumer Electronics Control (CEC) channel.

[0035] Source data provided by the source device (20) can be transmitted to the display device (10), which is a sink device, via a TMDS channel. That is, the display device (10) can receive video data and audio data via the TMDS channel.

[0036] The source device (20) can check the EDID (Extended Display Identification) of the display device (10) through the display data channel (DDC). The EDID may include detailed information of the display device (10). For example, the EDID may include a manufacturer ID indicating a manufacturing company, a model ID indicating a model name of a product, functions supported by the display device (10), horizontal and vertical sizes of the display, color characteristic information, resolution information, and timing information. The source device (20) can check the EDID of the display device (10) and transmit source data suitable for the display device (10).

[0037] The Status and Control Data Channel (SCDC) is a peer-to-peer data channel. SCDC provides a serial communication-based, one-to-one communication protocol that enables data exchange between a source device (20) and a sink device. The Status and Control Data Channel (SCDC) may correspond to the first data channel described below.

[0038] The source device (20) can provide capability information of the source device (20) to the display device (10) via a display data channel (DDC). The display device (10) can determine whether the source device (20) supports the use of SCDC and lip sync adjustment via SCDC based on the acquired capability information of the source device (20).

[0039] The CEC channel can be used to transmit control commands between a source device (20) and a display device (10) and between a display device (10) and an audio output device (30). The CEC channel provides an additional protocol for performing high-level control functions. Devices connected through the CEC channel can be controlled together. For example, when a power-on command to turn on the display device (10) is input, the power of the source device (20) and the power of the audio output device (30) can be turned on simultaneously. The CEC channel may correspond to a second data channel described below.

[0040] The display device (10) may include a source data receiver (110), a first controller (120), a second controller (130), a display (140), a speaker (150), a user interface (160), a power circuit (170), a memory (180), and a main controller (190).

[0041] The source data receiver (110) can receive source data including video data and audio data through the first connection interface (101) and transmit the source data to the main controller (190).

[0042] The display device (10) may include a first controller (120) that performs a first lip sync adjustment for video output and audio output using a first data channel (e.g., SCDC) of a first connection interface (101) connected to a source device (20). The first data channel may represent a status and control data channel (SCDC). The first controller (120) is illustrated as being included in the source data receiver (110), but is not limited thereto. The first controller (120) may be provided separately from the source data receiver (110). The first controller (120) may include a processor. The first controller (120) may also be referred to as a first lip sync controller.

[0043] The display device (10) may include a second controller (130) that performs second lip sync adjustment for video output and audio output using a second data channel (e.g., CEC) of a second connection interface (102) connected to an audio output device (30). The second data channel may represent a CEC channel. Audio data processed by the audio processor (192) may be transmitted to the audio output device (30) via the second connection interface (102). The main processor (193) may control the second controller (130) to transmit the audio data to the audio output device (30). The second controller (130) may include a processor. The second controller (130) may also be referred to as a second lip sync controller.

[0044] The display (140) can output video and / or images under the control of the main controller (190). The display (140) can be provided with various panels. For example, the display (140) can be provided with an LED panel, an LCD panel, an OLED panel, or an inorganic LED panel. The speaker (150) can output audio under the control of the main controller (190).

[0045] The user interface (160) can obtain user input. The user interface (160) can include various physical buttons and / or touch buttons provided on the display device (10). If the display (140) includes a touch screen panel, the display (140) can also function as a user interface. The user interface (160) can obtain user input for controlling the display device (10), such as turning the display device (10) on, off, adjusting volume, adjusting channels, adjusting screens, and changing various settings.

[0046] The power circuit (170) can supply power to components of the display device (10). The power circuit (170) can supply power to electronic components included in the display device (10). The main controller (190) can convert power transmitted from the power circuit (170) to be suitable for each electronic component of the display device (10) and then provide the converted power to each electronic component.

[0047] The memory (180) can store various information required for the operation of the display device (10). The memory (180) can store programs, data, instructions, software, and / or applications for controlling the operation of the display device (10). The memory (180) can include volatile memory such as Static Random Access Memory (S-RAM) or Dynamic Random Access Memory (D-RAM) for temporarily storing data. In addition, the memory (180) can include nonvolatile memory such as Read Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM), or Electrically Erasable Programmable Read Only Memory (EEPROM) for long-term storage of data.

[0048] The main controller (190) can control the overall operation of the display device (10). The main controller (190) can control the operation of the display device (10) using programs, instructions, and / or data stored in the memory (180).

[0049] The main controller (190) may include an image processor (191), an audio processor (192), and a main processor (193). The image processor (191) may process video data to be suitable for video output through a display (140). The audio processor (192) may process audio data to be suitable for audio output through a speaker (150) or an audio output device (30).

[0050] The main processor (193) can control the display (140) to output video based on video data processed by the image processor (191). The main processor (193) can control the speaker (150) to output audio based on audio data processed by the audio processor (192). The main processor (193) can control components of the display device (10) to perform operations corresponding to user input obtained through the user interface (160). The main processor (193) can also transmit processed audio data to the audio output device (30).

[0051] In addition, the main processor (193) can control the first controller (120) to perform lip sync adjustment for video output and audio output using the first data channel of the first connection interface (101) connected to the source device (20). The main processor (193) can control the second controller (130) to perform lip sync adjustment for video output and audio output using the second data channel of the second connection interface (102) connected to the audio output device (30). The first connection interface (101) and the second connection interface (102) may be of the same type, and the first data channel and the second data channel may be of different types.

[0052] Meanwhile, depending on the performance of the display device (10) and the source data transmitted from the source device (20), the time required to process video data and the time required to process audio data may differ. If there is a difference between the video latency due to the processing time of the video data and the audio latency due to the processing time of the audio data, lip sync between the video output and the audio output may not match. Various methods can be used to adjust the lip sync of the video output and the audio output.

[0053] For example, lip sync adjustment can be performed between the display device (10) and the source device (20). The display device (10) can generate total latency information including the video latency generated by the display device (10), the first audio latency, and the second audio latency generated by the audio output device (30), and transmit the total latency information to the source device (20). The total latency information can include a lip sync adjustment command. The display device (10) can also transmit a transmission delay request of video data or a transmission delay request of audio data to the source device (20) together with the total latency information. The source device (20) can transmit source data with lip sync adjusted in consideration of the total latency information transmitted from the display device (10) to the display device (10). In this way, the display device (10) transmits the total latency information to the source device (20) to perform lip sync adjustment is referred to as first lip sync adjustment.

[0054] As another example, lip sync adjustment may be performed between a display device (10) and an audio output device (30). The display device (10) may determine a transmission timing of audio data for transmitting audio data to the audio output device (30) by considering a video latency and a first audio latency generated by the display device (10) and a second audio latency generated by the audio output device (30). This adjustment of the transmission timing of audio data by the display device (10) to the audio output device (30) to perform lip sync adjustment is referred to as second lip sync adjustment.

[0055] However, if the sync adjustment between the video output and the audio output is individually performed by each of the multiple methods, a problem of lip sync being misaligned may occur. For example, even though the video latency is longer than the overall audio latency and the delay in transmitting audio data from the display device (10) to the audio output device (30) is determined, the transmission of audio data from the source device (20) to the display device (10) may also be delayed. In this case, since the transmission delay of audio data occurs repeatedly by each of the display device (10) and the source device (20), the audio output through the audio output device (30) may be excessively delayed.

[0056] To prevent lip sync adjustment from being performed repeatedly, the display device (10) needs to selectively use one of a plurality of lip sync control techniques. To this end, the main controller (190) of the display device (10) can determine whether the source device (20) supports the first lip sync adjustment via the first data channel (e.g., SCDC) of the first connection interface (101). The main controller (190) can determine whether the source device (20) supports the first lip sync adjustment via the first data channel based on capability information of the source device (20) provided from the source device (20).

[0057] The main controller (190) can determine the first lip sync adjustment by the first controller (120) or the second lip sync adjustment by the second controller (130) based on whether the source device (20) supports the first lip sync adjustment via the first data channel (e.g., SCDC).

[0058] The main controller (190) can control the first controller (120) to perform a first lip-sync adjustment using the first data channel based on the source device (20) supporting the first lip-sync adjustment via the first data channel. In addition, the main controller (190) can control the second controller (130) not to perform a second lip-sync adjustment using the second data channel of the second connection interface (102) connected to the audio output device (30).

[0059] If the source device (20) does not support the first lip sync adjustment via the first data channel, the display device (10) cannot transmit the entire latency information to the source device (20), and cannot issue a lip sync adjustment command, a request for delaying transmission of video data, or a request for delaying transmission of audio data to the source device (20). In this case, the main controller (190) can control the second controller (130) to perform the second lip sync adjustment using the second data channel of the second connection interface (102) connected to the audio output device (30).

[0060] In this way, a separate main controller (190) capable of controlling the operations of the first controller (120) and the second controller (130) that perform lip sync adjustment using different data channels is provided, and by selectively using lip sync adjustment by the first controller (120) and lip sync adjustment by the second controller (130), the sync of video output and audio output can be appropriately adjusted.

[0061] The main controller (190) can obtain source data including video data and audio data from the source device (20). The main controller (190) can determine video latency for the video data and first audio latency for the audio data. In addition, the main controller (190) can obtain second audio latency from the audio output device (30). The second audio latency corresponds to audio latency generated by the audio output device (30).

[0062] The main controller (190) can generate overall latency information including video latency for video data, first audio latency for audio data, and second audio latency of the audio output device (30). Based on the source device (20) supporting the first lip sync adjustment through the first data channel, the main controller (190) can control the first controller (120) to transmit the overall latency information to the source device (20) to perform the first lip sync adjustment. The overall latency information can include a lip sync adjustment command.

[0063] The main controller (190) can compare the sum of the first audio latency and the second audio latency with the video latency. If the source device (20) supports the first lip sync adjustment through the first data channel, the main controller (190) can control the first controller (120) to transmit a request for delaying transmission of video data or a request for delaying transmission of audio data to the source device (20) based on the result of comparing the video latency and the overall audio latency. The request for delaying transmission of video data or the request for delaying transmission of audio data may be included in the overall latency information.

[0064] For example, if the sum of the first audio latency and the second audio latency is longer than the video latency, the main controller (190) can control the first controller (120) to transmit a request for delaying transmission of video data to the source device (20). If the sum of the first audio latency and the second audio latency is shorter than the video latency, the main controller (190) can control the first controller (120) to transmit a request for delaying transmission of audio data to the source device (20).

[0065] If the source device (20) does not support the first lip sync adjustment through the first data channel, the main controller (190) can determine the transmission timing of audio data for transmitting the audio data to the audio output device (30). The main controller (190) can determine the transmission timing of the audio data based on the difference between the total audio latency and the video latency, which is the sum of the first audio latency generated by the display device (10) and the second audio latency generated by the audio output device (30).

[0066] The main controller (190) can control the second controller (130) to transmit audio data to the audio output device (30) at a determined transmission timing. If the video latency is longer than the overall audio latency, the main controller (190) can delay the transmission of audio data by a time corresponding to the difference between the overall audio latency and the video latency.

[0067] The configuration of the display device (10) is not limited to that described in FIG. 2. Other configurations may be added in addition to those described in FIG. 2, or the configurations described in FIG. 2 may be omitted.

[0068] Fig. 3 is a flowchart illustrating a method for controlling a display device according to one embodiment. Fig. 4 is a flowchart illustrating in more detail the method for controlling the display device described in Fig. 3.

[0069] Referring to FIG. 3, the main controller (190) of the display device (10) can identify the connection between the first connection interface (101) and the source device (20) (301). The main controller (190) can identify the connection between the second connection interface (102) and the audio output device (30) (302).

[0070] The main controller (190) can determine whether lip sync adjustment is possible using the first data channel (e.g., SCDC) of the first connection interface (101) connected to the source device (20) (303). Lip sync adjustment using the first data channel of the first connection interface (101) can be performed by the display device (10) and the source device (20). The main controller (190) can determine whether the source device (20) supports lip sync adjustment through the first data channel of the first connection interface (101) based on capability information of the source device (20) provided from the source device (20).

[0071] If lip sync adjustment is possible using the first data channel (e.g., SCDC) of the first connection interface (101) connected to the source device (20), the main controller (190) can determine to perform the first lip sync adjustment using the first data channel of the first connection interface (101) (304). In addition, the main controller (190) can prohibit the second lip sync adjustment using the second data channel of the second connection interface (102) connected to the audio output device (30) (305).

[0072] Referring to FIG. 4, the main controller (190) can obtain source data including video data and audio data from the source device (20) (401). The main controller (190) can determine video latency indicating the time required to process the video data and first audio latency indicating the time required to process the audio data (402). The main controller (190) can determine second audio latency generated by the audio output device (30) (403). The main controller (190) can obtain information regarding the second audio latency from the audio output device (30).

[0073] Since the source device (20) supports the use of the first data channel, the main controller (190) can transmit the entire latency information to the source device (20) (404). The entire latency information can include video latency, first audio latency, and second audio latency. The main controller (190) can control the first controller (120) to transmit the entire latency information to the source device (20).

[0074] The main controller (190) can obtain source data with adjusted lip sync from the source device (20) (405). The main controller (190) can process audio data included in the source data with adjusted lip sync and transmit the processed audio data to the audio output device (30) (406). The main controller (190) can process video data included in the source data with adjusted lip sync and control the display (140) to output the video (407). Since the source data transmitted from the source device (20) reflects the entire latency information generated by the display device (10) and the audio output device (30), the video output through the display (140) and the audio output through the audio output device (30) can be synchronized without additional lip sync adjustment.

[0075] Referring again to FIG. 3, if the source device (20) does not support lip sync adjustment via the first data channel, the main controller (190) may determine that the first lip sync adjustment via the first data channel is not possible. In this case, the main controller (190) may determine to perform the second lip sync adjustment using the second data channel of the second connection interface (102) connected to the audio output device (30) (306).

[0076] Figure 5 is a flowchart illustrating an example of data and information exchange between a display device, a source device, and an audio output device.

[0077] Referring to FIG. 5, the display device (10) can identify the connection between the first connection interface (101) and the source device (20) (501). The display device (10) can identify the connection between the second connection interface (102) and the audio output device (30) (502).

[0078] The source device (20) may transmit capability information to the display device (10) (503). The capability information of the source device (20) may include information regarding whether the source device (20) supports the use of a first data channel (e.g., SCDC) included in the first connection interface (101) and whether it supports lip sync adjustment via the first data channel.

[0079] The display device (10) can identify that the first lip sync adjustment using the first data channel is possible from the capability information of the source device (20) (504). Since the first lip sync adjustment using the first data channel is possible, the display device (10) may not perform the second lip sync adjustment using the second data channel of the second connection interface (102) to which the audio output device (30) is connected.

[0080] A source device (20) can transmit source data including video data and audio data to a display device (10) (505). The display device (10) can determine a video latency indicating a time required to process the video data and a first audio latency indicating a time required to process the audio data (506). An audio output device (30) can transmit information regarding a second audio latency generated by the audio output device (30) to the display device (10) (507). The display device (10) can generate overall latency information including the video latency, the first audio latency, and the second audio latency (508). The display device (10) can transmit the overall latency information to the source device (20).

[0081] In addition, the display device (10) may transmit a request for delaying transmission of video data or a request for delaying transmission of audio data to the source device (20) based on a result of comparing the sum of the first audio latency and the second audio latency with the video latency (510). For example, if the sum of the first audio latency and the second audio latency is longer than the video latency, the main controller (190) may control the first controller (120) to transmit a request for delaying transmission of video data to the source device (20). If the sum of the first audio latency and the second audio latency is shorter than the video latency, the main controller (190) may control the first controller (120) to transmit a request for delaying transmission of audio data to the source device (20). The request for delaying transmission of video data or the request for delaying transmission of audio data may also be included in the overall latency information.

[0082] The source device (20) can transmit lip-sync-adjusted source data reflecting the overall latency information to the display device (10) (511). The display device (10) can transmit audio data included in the source data to the audio output device (30).

[0083] The display device (10) can output video based on video data included in the source data (513). The audio output device (30) can output audio based on audio data received from the display device (10) (514). Accordingly, the video output through the display device (10) and the audio output through the audio output device (30) can be synchronized.

[0084] Figure 6 is a flowchart illustrating another example of data and information exchange between a display device, a source device, and an audio output device.

[0085] Referring to FIG. 6, the display device (10) can identify the connection between the first connection interface (101) and the source device (20) (601). The display device (10) can identify the connection between the second connection interface (102) and the audio output device (30) (602). The source device (20) can transmit capability information to the display device (10) (603).

[0086] The display device (10) can identify that the first lip sync adjustment using the first data channel is impossible from the capability information of the source device (20) (604). Since the first lip sync adjustment using the first data channel is impossible, the display device (10) can determine the second lip sync adjustment using the second data channel (e.g., CEC channel) of the second connection interface (102) to which the audio output device (30) is connected (605).

[0087] A source device (20) can transmit source data including video data and audio data to a display device (10) (606). The display device (10) can determine a video latency indicating a time required to process video data and a first audio latency indicating a time required to process audio data (607). An audio output device (30) can transmit information regarding a second audio latency generated by the audio output device (30) to the display device (10) (608).

[0088] The display device (10) can determine the transmission timing of audio data for transmitting audio data to the audio output device (30) (609). The display device (10) can determine the transmission timing of audio data based on the difference between the total audio latency, which is the sum of the first audio latency and the second audio latency, and the video latency. The display device (10) can transmit the audio data to the audio output device (30) at the determined transmission timing (610).

[0089] The display device (10) can output video based on video data (611). The audio output device (30) can output audio based on audio data received from the display device (10) (612). Accordingly, the video output through the display device (10) and the audio output through the audio output device (30) can be synchronized.

[0090] The disclosed display device may include a first connection interface connected to a source device; a second connection interface connected to an audio output device; a first controller performing a first lip sync adjustment for video output and audio output using a first data channel of the first connection interface; a second controller performing a second lip sync adjustment for the video output and the audio output using a second data channel of the second connection interface; and a main controller determining the first lip sync adjustment by the first controller or the second lip sync adjustment by the second controller based on whether the source device supports the first lip sync adjustment through the first data channel.

[0091] The main controller can control the first controller to perform the first lip-sync adjustment using the first data channel based on whether the source device supports the first lip-sync adjustment through the first data channel, and can control the second controller not to perform the second lip-sync adjustment using the second data channel.

[0092] The main controller can obtain source data including video data and audio data from the source device. The main controller can generate overall latency information including video latency for the video data, first audio latency for the audio data, and second audio latency of the audio output device. The main controller can control the first controller to transmit the overall latency information to the source device to perform the first lip sync adjustment.

[0093] The main controller may compare the sum of the first audio latency and the second audio latency with the video latency. Based on the comparison result, the main controller may control the first controller to transmit a request for delaying transmission of the video data or a request for delaying transmission of the audio data to the source device.

[0094] The main controller can control the second controller to perform the second lip sync adjustment using the second data channel based on the source device not supporting the first lip sync adjustment via the first data channel.

[0095] The main controller may obtain source data including video data and audio data from the source device, and determine a video latency for the video data, a first audio latency for the audio data, and a second audio latency of the audio output device. The main controller may determine a transmission timing of the audio data based on a difference between the total audio latency that is the sum of the first audio latency and the second audio latency and the video latency. The main controller may control the second controller to transmit the audio data to the audio output device at the determined transmission timing.

[0096] The first connection interface may be of the same type as the second connection interface. The first data channel may be of a different type than the second data channel.

[0097] The first connection interface and the second connection interface may correspond to a High Definition Multimedia Interface (HDMI). The first data channel may correspond to a Status and Control Data Channel (SCDC). The second data channel may correspond to a Consumer Electronics Control (CEC) channel.

[0098] The main controller can determine whether the source device supports the first lip sync adjustment through the first data channel based on the capability information of the source device.

[0099] A method for controlling a display device including a first connection interface connected to a source device, a second connection interface connected to an audio output device, and a processor may include: identifying, by the processor, whether the source device supports a first lip sync adjustment for video output and audio output using a first data channel of the first connection interface; and determining, by the processor, the first lip sync adjustment using the first data channel or the second lip sync adjustment using a second data channel of the second connection interface for the video output and the audio output based on whether the source device supports the second lip sync adjustment through the first data channel.

[0100] Based on the ability to transmit information to the source device through the first data channel, the first lip sync adjustment may be performed and the second lip sync adjustment may be inhibited.

[0101] Performing the first lip sync adjustment may include: obtaining source data including video data and audio data from the source device; generating overall latency information including a video latency for the video data, a first audio latency for the audio data, and a second audio latency of the audio output device; and transmitting the overall latency information to the source device.

[0102] Performing the first lip sync adjustment may include comparing the sum of the first audio latency and the second audio latency with the video latency; and transmitting a request for delaying transmission of the video data or a request for delaying transmission of the audio data to the source device based on the comparison result.

[0103] The second lip sync adjustment may be performed based on the inability to transmit information to the source device through the first data channel. Performing the second lip sync adjustment may include: obtaining source data including video data and audio data from the source device; determining a video latency for the video data, a first audio latency for the audio data, and a second audio latency of the audio output device; determining a transmission timing of the audio data based on a difference between the total audio latency that is the sum of the first audio latency and the second audio latency and the video latency; and transmitting the audio data to the audio output device at the determined transmission timing.

[0104] As described above, the disclosed display device and its control method can appropriately adjust the synchronization of video output and audio output by selectively using one of a plurality of lip sync control techniques. In other words, the disclosed display device and its control method can prevent errors resulting from the overlapping application of a plurality of lip sync control techniques.

[0105] Meanwhile, the disclosed embodiments may be implemented in the form of a storage medium storing computer-executable instructions. The instructions may be stored in the form of program code, and when executed by a processor, may generate program modules to perform the operations of the disclosed embodiments.

[0106] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0107] The methods according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0108] The disclosed embodiments have been described with reference to the attached drawings as described above. Those skilled in the art will understand that the present invention can be implemented in forms other than the disclosed embodiments without altering the technical spirit or essential features of the present invention. The disclosed embodiments are illustrative and should not be construed as limiting.

Claims

1. A first connection interface connected to the source device; A second connection interface connected to an audio output device; A first controller performing a first lip sync adjustment for video output and audio output using a first data channel of the first connection interface; A second controller performing a second lip sync adjustment for the video output and the audio output using a second data channel of the second connection interface; and A display device comprising a main controller that determines the first lip-sync adjustment by the first controller or the second lip-sync adjustment by the second controller based on whether the source device supports the first lip-sync adjustment through the first data channel.

2. In paragraph 1, The above main controller A display device that controls the first controller to perform the first lip-sync adjustment using the first data channel, and controls the second controller not to perform the second lip-sync adjustment using the second data channel, based on the source device supporting the first lip-sync adjustment via the first data channel.

3. In paragraph 2, The above main controller Obtaining source data including video data and audio data from the above source device, Generate overall latency information including video latency for the video data, first audio latency for the audio data, and second audio latency of the audio output device, A display device controlling the first controller to transmit the overall latency information to the source device to perform the first lip sync adjustment.

4. In paragraph 3, The above main controller Compare the sum of the first audio latency and the second audio latency with the video latency, A display device that controls the first controller to transmit a request for delaying transmission of the video data or a request for delaying transmission of the audio data to the source device based on a comparison result.

5. In paragraph 1, The above main controller A display device that controls the second controller to perform the second lip sync adjustment using the second data channel based on the fact that the source device does not support the first lip sync adjustment via the first data channel.

6. In paragraph 5, The above main controller Obtaining source data including video data and audio data from the above source device, Determine a video latency for the above video data, a first audio latency for the above audio data, and a second audio latency of the audio output device, Determine the transmission timing of the audio data based on the difference between the total audio latency that is the sum of the first audio latency and the second audio latency and the video latency, A display device that controls the second controller to transmit the audio data to the audio output device at the determined transmission timing.

7. In paragraph 1, The above first connection interface is of the same type as the above second connection interface, A display device wherein the first data channel is of a different type from the second data channel.

8. In paragraph 7, The above first connection interface and the above second connection interface are HDMI (High Definition Multimedia Interface), The above first data channel is a Status and Control Data Channel (SCDC), A display device wherein the second data channel is a CEC (Consumer Electronics Control) channel.

9. In paragraph 1, The above main controller A display device that determines whether the source device supports the first lip sync adjustment through the first data channel from the capability information of the source device.

10. A method for controlling a display device including a first connection interface connected to a source device, a second connection interface connected to an audio output device, and a processor, By the processor, identifying whether the source device supports a first lip sync adjustment for video output and audio output using a first data channel of the first connection interface; A method of controlling a display device, comprising: determining, by the processor, the first lip sync adjustment using the first data channel or the second lip sync adjustment for the video output and the audio output using a second data channel of the second connection interface, based on whether the source device supports the first lip sync adjustment via the first data channel.

11. In paragraph 10, A method for controlling a display device, wherein the first lip sync adjustment is performed and the second lip sync adjustment is prohibited based on the ability to transmit information to the source device through the first data channel.

12. In paragraph 11, Performing the above first lip sync adjustment is: Obtaining source data including video data and audio data from the source device; Generate overall latency information including video latency for the video data, first audio latency for the audio data, and second audio latency of the audio output device; A method for controlling a display device, comprising: transmitting the entire latency information to the source device.

13. In paragraph 12, Performing the above first lip sync adjustment is: comparing the sum of the first audio latency and the second audio latency with the video latency; A method for controlling a display device, comprising: transmitting a request for delaying transmission of the video data or a request for delaying transmission of the audio data to the source device based on a comparison result; 14. In paragraph 10, The above second lip sync adjustment is It is performed based on the impossibility of transmitting information to the source device through the first data channel, Performing the above second lip sync adjustment Obtaining source data including video data and audio data from the source device; Determine a video latency for the video data, a first audio latency for the audio data, and a second audio latency of the audio output device; Determine the transmission timing of the audio data based on the difference between the total audio latency which is the sum of the first audio latency and the second audio latency and the video latency; A method for controlling a display device, comprising: transmitting the audio data to the audio output device at the determined transmission timing.

15. In paragraph 10, The above first connection interface is of the same type as the above second connection interface, A method for controlling a display device, wherein the first data channel is of a different type from the second data channel.

Images