Display device and control method thereof

Abstract

A display device includes a display, a plurality of light sources provided to the display, a receiver, and a processor. The processor is configured to: based on an audio signal having a plurality of channels received from the receiver, obtain a plurality of audio signals corresponding to the plurality of channels from the audio signal, respectively; based on the frequency components of the plurality of audio signals among the plurality of frequency components, respectively identify a plurality of colors of the plurality of audio signals, and based on the mapping of the plurality of light sources to the plurality of channels, respectively control the plurality of light sources to emit light having a plurality of colors.

Description

Technical Field

[0001] The present disclosure relates to a display device and a control method thereof, and more particularly, to a display device including at least one light source and a control method thereof. Background Art

[0002] In recent years, with the development of electronic technology, various electronic devices have been developed. In particular, a display device including a light source has been developed. The purpose of such a display device is to provide a user with visual satisfaction by emitting light from the light source.

[0003] However, the display device of the related art only provides light of a color set by a user through a light source, and thus cannot sufficiently provide visual satisfaction to the user. Summary of the invention

[0004] A display device and a control method thereof are provided, wherein the display device controls a light source based on characteristics of an audio signal to provide a user with visual satisfaction, thereby immersing the user in an image.

[0005] Additional aspects will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the presented embodiments.

[0006] According to aspects of the present disclosure, a display device is provided, comprising: a display; a plurality of light sources; a receiver; and a processor, the processor being configured to: obtain a plurality of audio signals corresponding to the plurality of channels from an audio signal having a plurality of channels received from the receiver; identify a plurality of colors corresponding to the plurality of audio signals based on a frequency component of each of the plurality of audio signals; and control the plurality of light sources to emit light having the plurality of colors based on information about the plurality of light sources mapped to the plurality of channels.

[0007] According to aspects of the present disclosure, a method for controlling a display device is provided, the method comprising: receiving an audio signal having multiple channels; obtaining multiple audio signals corresponding to the multiple channels from the audio signal; identifying multiple colors corresponding to the multiple audio signals based on a frequency component of each of the multiple audio signals; and controlling the multiple light sources mapped to the multiple channels to emit light having the multiple colors based on information about the multiple light sources. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0009] Figure 1A is a view showing a rear surface of a display device according to an embodiment;

[0010] Figure 1B is a view showing a front surface of a display device according to an embodiment;

[0011] Figure 1C is a view showing a situation where a first light source according to an embodiment emits light;

[0012] Figure 1D is a view showing a situation where the second to fourth light sources according to the embodiment emit light;

[0013] Figure 2 is a block diagram for explaining a display device according to an embodiment.

[0014] Figure 3A is a view showing an embodiment in which a plurality of light sources are controlled based on an audio signal of a second channel and an audio signal of a third channel according to an embodiment;

[0015] Figure 3B is a view showing an embodiment in which a plurality of light sources are controlled based on an audio signal of a first channel, an audio signal of a second channel, and an audio signal of a third channel according to an embodiment;

[0016] Figure 4 is a view showing an embodiment in which a plurality of light sources are controlled based on frequency characteristics according to the embodiment;

[0017] Figure 5A is a view showing a display device emitting light having a first brightness according to an embodiment;

[0018] Figure 5B is a view showing a display device emitting light having a second brightness according to an embodiment;

[0019] Fig. 6A is a view showing a display device emitting light at a first speed according to an embodiment;

[0020] Figure 6B is a view showing a display device emitting light at a second speed according to an embodiment;

[0021] Figure 7 is a block diagram of a display device according to an embodiment;

[0022] Figure 8 is a view showing an embodiment in which a display device controls a light source based on information about a position of an object included in content data according to an embodiment; and

[0023] Fig. 9 is a flowchart illustrating the operation of the display device according to the embodiment. DETAILED DESCRIPTION

[0024] The terms used herein have been selected as general terms as much as possible in consideration of the functions described herein. However, these terms may change over time according to the intentions of those skilled in the art, precedents, technical interpretations, the emergence of new technologies, etc. In addition, there are terms arbitrarily selected by the applicant. These terms may be interpreted as defined herein, and if there is no specific definition of a term herein, it may be interpreted based on the specification and common technical knowledge in the technical field.

[0025] Certain embodiments will be described in detail with reference to the accompanying drawings, but this is not restrictive and various modifications may exist.

[0026] Figure 1A is a view showing a rear surface of a display device according to an embodiment, Figure 1B is a view showing a front surface of a display device according to an embodiment.

[0027] The display device 100 according to the embodiment may include a plurality of light sources. The plurality of light sources may be arranged on one side of the display. Figure 1A , the first light source 130-1 may be disposed on an area of ​​the rear surface of the display. Figure 1B , the second light source 130-2 is disposed on the front surface of the lower left portion of the display, the third light source 130-3 may be disposed on the front surface of the lower right portion of the display, the fourth light source 130-4 may be disposed on the bottom surface of the lower left portion of the display, and the fifth light source 130-5 may be disposed on the bottom surface of the lower right portion of the display. The lower left portion of the display and the lower right portion of the display are disposed opposite to each other with respect to a vertical axis passing through the center of the display, but this is not restrictive.

[0028] Multiple light sources can emit light. For example, refer to Figure 1C , the first light source 130-1 may emit light from the rear surface of the display. Figure 1D , the second light source 130-2 can emit light on the front surface of the lower left portion of the display (reference number 2), the third light source 130-3 can emit light on the front surface of the lower right portion of the display (reference number 3), the fourth light source 130-4 can emit light on the bottom surface of the lower left portion of the display (reference number 4), and the fifth light source 130-5 can emit light on the bottom surface of the lower right portion of the display (reference number 5).

[0029] The positions of the first to fifth light sources described above are merely examples, and various changes may be made. For example, the second light source 130-2 may be disposed on the front surface of the upper left portion of the display, and the third light source 130-3 may be disposed on the front surface of the upper right portion of the display. The second light source 130-2 may be disposed on the upper surface of the upper left portion of the display, and the third light source 130-3 may be disposed on the upper surface of the upper right portion of the display.

[0030] The number of the above light sources is only an example, and the number of light sources can be changed in various ways. Figure 1A and Figure 1B In addition to the first to fifth light sources, the display device 100 according to the embodiment may further include a sixth light source disposed on the front surface (or upper surface) of the upper left portion of the display and a seventh light source disposed on the front surface (or upper surface) of the upper right portion of the display. The display device 100 according to the embodiment may include two light sources, and the two light sources may be a first light source on the front surface of the left portion of the display and a second light source on the front surface of the right portion of the display.

[0031] The display device 100 according to the embodiment may exhibit light effects through a plurality of light sources.

[0032] Figure 2 is a block diagram for explaining a display device according to an embodiment.

[0033] Reference Figure 2 , the display device 100 according to the embodiment may include a display 110 , a receiver 120 , a light source 130 , and a processor 140 .

[0034] The display 110 may display various images. The images may include at least one of a still image or a moving image, and the display 110 may display various images such as broadcast content, multimedia content, game content, etc. The display 110 may display various user interfaces (UIs) and icons.

[0035] The display 110 described above may be implemented with various types of displays such as a liquid crystal display (LCD) panel, a light emitting diode (LED), an organic light emitting diode (OLED), a liquid crystal on silicon (LCoS), a digital light processing (DLP), etc. The display 110 may further include a driving circuit and / or a backlight unit, which may be implemented as an a-si TFT, a low temperature polysilicon (LTPS) TFT, or an organic TFT (OTFT).

[0036] The receiver 120 may receive an audio signal. The receiver 120 may receive an audio signal from an external device through a sound card, a high-definition multimedia interface (HDMI), or a display port (DP). The receiver 120 may receive an audio signal from an external device through a wireless network. To this end, the receiver 120 may include a Wi-Fi module, a Bluetooth module, a ZigBee module, etc.

[0037] The light source 130 may emit light. The light source 130 may be implemented as an LED, but is not limited thereto. The light source 130 may be implemented variously, such as an LCD, an OLED, an active matrix organic light emitting diode (AM-OLED), a plasma display panel (PDP), and the like.

[0038] The display device 100 according to the embodiment may include a plurality of light sources. Figure 1A and Figure 1B As described, the display device 100 may include the first to fifth light sources, but is not limited thereto.

[0039] The processor 140 may control general operations of the display apparatus 100. To this end, the processor 140 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP).

[0040] The processor 140 may operate an operating system or an application program to control hardware or software elements connected to the processor 140 and perform various data processing and operations. The processor 140 may load instructions or data received from at least one of the other elements into a volatile memory and process them, and store various data pieces in a nonvolatile memory.

[0041] The processor 140 may receive an audio signal via the receiver 120. The audio signal may be an audio signal received from an external device (e.g., a server, a PC, a user terminal device, etc.). For example, if a game application is executed, the processor 140 may receive an audio signal related to the game from an external server via the receiver 120. However, this is merely an example, and the audio signal may be an audio signal generated by the execution of content (e.g., music content, movie content, etc.) pre-stored in the display device 100.

[0042] The audio signal may be an audio signal having a plurality of channels. For example, the audio signal may include a first audio signal of a center (C) channel, a second audio signal of a left (L) channel, a third audio signal of a right (R) channel, a fourth audio signal of a left surround (LS) channel, and a fifth audio signal of a right surround (RS) channel as a 5.1-channel audio signal.

[0043] However, this is merely an example, and the audio signal may be an audio signal of stereo channels including a first audio signal of a left channel and a second audio signal of a right channel, and may be an audio signal of 7.1 channels including a first audio signal of a center channel, a second audio signal of a left channel, a third audio signal of a right channel, a fourth audio signal of a left surround channel, a fifth audio signal of a right surround channel, a sixth audio signal of a left back (LB) channel, and a seventh audio signal of a right back (RB) channel.

[0044] The processor 140 can obtain a plurality of audio signals corresponding to the plurality of channels from an audio signal having a plurality of channels. For example, the processor 140 can obtain a first audio signal of a center channel, a second audio signal of a left channel, a third audio signal of a right channel, a fourth audio signal of a left surround channel, and a fifth audio signal of a right surround channel from an audio signal of a 5.1 channel.

[0045] To this end, the processor 140 may identify the number of channels of the audio signal based on information about the number of channels included in the audio signal. The processor 140 may divide the audio signal of each channel based on the preamble included in the audio signal and obtain a plurality of divided audio signals as a plurality of audio signals corresponding to the plurality of channels.

[0046] However, this is merely an example, and the processor 140 may obtain a plurality of audio signals corresponding to a plurality of channels from the audio signal by various methods. For example, the processor 140 may divide a plurality of audio signals allocated to each channel (e.g., C, L, R, LS, and RS) in the audio signal based on an identifier of each channel, and obtain a plurality of divided audio signals as a plurality of audio signals corresponding to the plurality of channels.

[0047] The processor 140 may control the plurality of light sources based on the plurality of audio signals divided for each channel. The processor 140 may control the plurality of light sources based on information about the plurality of light sources mapped to the plurality of channels.

[0048] The information about the multiple light sources mapped to the multiple channels may include information about the light sources mapped to each channel of the audio signal. For example, the information about the multiple light sources mapped to the multiple channels may include information about the first light source 130-1 mapped to the first audio signal of the center channel, information about the second light source 130-2 mapped to the second audio signal of the left channel, information about the third light source 130-3 mapped to the third audio signal of the right channel, information about the fourth light source 130-4 mapped to the fourth audio signal of the left surround channel, and information about the fifth light source 130-5 mapped to the fifth audio signal of the right surround channel. Therefore, if an audio signal corresponding to a specific channel is obtained, the processor 140 can identify the light source mapped to the specific channel and control the corresponding light source to emit light.

[0049] For example, if the second audio signal and the third audio signal are obtained, the processor 140 may control the second light source 130-2 and the third light source 130-3 to emit light, such as Figure 3A If a first audio signal of a center channel, a second audio signal of a left channel, and a third audio signal of a right channel are obtained, the processor 140 may control the first light source 130-1, the second light source 130-2, and the third light source 130-3 to emit light, as shown. Figure 3B shown.

[0050] As a result, users can experience stereoscopic visual effects with stereo sound and can be highly immersed in the images.

[0051] The processor 140 may control the plurality of light sources to emit a plurality of colors based on the frequency components of the plurality of audio signals corresponding to the plurality of channels. The plurality of audio signals may be signals converted into analog signals by a digital-to-analog converter (DAC).

[0052] To this end, the processor 140 may identify whether the plurality of audio signals corresponding to the plurality of channels are audio signals having high frequency components, audio signals having low frequency components, or audio signals having middle frequency components.

[0053] The processor 140 may input the plurality of audio signals converted into analog signals into a plurality of filters. The plurality of filters may include a high pass filter, a low pass filter, and a band pass filter. The high pass filter may be a filter that outputs a signal having a frequency component higher than a first frequency (e.g., 180 Hz) when receiving an audio signal, and the low pass filter may be a filter that outputs a signal having a frequency component lower than a second frequency (e.g., 165 Hz) when receiving an audio signal. The band pass filter may be a filter that outputs a signal having a frequency component lower than or equal to a first frequency (e.g., 180 Hz) and higher than or equal to a second frequency (e.g., 165 Hz) when receiving an audio signal.

[0054] The processor 140 may identify the audio signal passing through the high pass filter among the plurality of audio signals as an audio signal having a high frequency component, and may identify the audio signal passing through the low pass filter as an audio signal having a low frequency component. The processor 140 may identify the audio signal passing through the band pass filter as an audio signal having a medium frequency component.

[0055] The processor 140 may identify a plurality of colors corresponding to a plurality of audio signals based on information about a plurality of colors mapped to a plurality of frequency components.

[0056] The information about the multiple colors mapped to the multiple frequency components may include information about the colors mapped for each frequency component. For example, the information about the multiple colors mapped to the multiple frequency components may include information about the first color mapped to the high-frequency component (e.g., the frequency component higher than 180 Hz), information about the second color mapped to the mid-frequency component (e.g., the frequency component higher than 165 Hz and lower than 180 Hz), and information about the third color mapped to the low-frequency component (e.g., the frequency component lower than 165 Hz). The first color may be red, the second color may be blue, and the third color may be green, but are not limited thereto.

[0057] The processor 140 may control the plurality of light sources to emit light having a plurality of recognized colors. The processor 140 may control the light sources mapped to the channels of the audio signal having the high frequency component to emit the first color, control the light sources mapped to the channels of the audio signal having the mid-frequency component to emit the second color, and control the light sources mapped to the channels of the audio signal having the low frequency component to emit the third color.

[0058] Here, the first color to the third color are taken as an example, but this is only an example. According to an embodiment, if the frequency component of the audio signal is distinguished into one of the first frequency band to the fifth frequency band, the processor 140 can identify one of the first color, the second color, the third color, the fourth color and the fifth color as the color corresponding to the audio signal according to the frequency component of the audio signal.

[0059] The processor 140 may control the plurality of light sources based on the channels of the audio signal and the frequency components of the audio signal.

[0060] For example, if a second audio signal of a left channel and a third audio signal of a right channel are obtained, the second audio signal has a high frequency component, and the third audio signal has a low frequency component, the processor 140 may control the second light source to emit red light, and control the third light source to emit green light, such as Figure 4If all of the first to third audio signals have high frequency components, the processor 140 may control the first light source, the second light source, and the third light source to emit red light. According to an embodiment, the plurality of colors may be different or the same.

[0061] Therefore, the user can visually confirm at which position the sound of the high-frequency component is output, or at which position the sound of the low-frequency component is output, and can concentrate on the image with a high sense of immersion.

[0062] As described above, the filter includes a high-pass filter, a low-pass filter, and a band-pass filter, but some of these elements may be omitted according to an embodiment.

[0063] As described above, for each frequency band, the audio signal is identified as a signal having a high frequency component, a signal having a low frequency component, or a signal having a middle frequency component. According to an embodiment, the processor 140 may identify a plurality of colors corresponding to a plurality of audio signals based on the frequency components themselves.

[0064] To this end, the processor 140 can analyze the frequency sampling values ​​of multiple audio signals and identify the frequency components of the multiple audio signals. The processor 140 can identify the colors mapped to the identified frequency components based on information about the multiple colors mapped to the multiple frequency components. For example, if the frequency of the audio signal is a first frequency, the processor 140 can identify the first color mapped to the first frequency based on information about the multiple colors mapped to the multiple frequency components. If the above-mentioned first frequency is the frequency of the audio signal of the center channel, the processor 140 can control the first light source to emit the first color. As described above, by controlling multiple light sources based on frequency components, the present disclosure can provide visual effects to the user through light with more colors.

[0065] According to an embodiment, multiple signals of the same channel may be received via the receiver 120. For example, according to the execution of the game content, an audio signal of the first channel corresponding to the sound of a gun may be received according to a user operation, while an audio signal of the first channel corresponding to the background music of the game content may be received.

[0066] As described above, if a second audio signal of a first channel is received together with the first audio signal of the first channel, the processor 140 may control a light source mapped to the first channel among a plurality of light sources to emit a color obtained by combining a first color corresponding to the first audio signal and a second color corresponding to the second audio signal.

[0067] The processor 140 may identify a first color corresponding to the first audio signal based on a frequency component of the first audio signal when receiving a first audio signal of the first channel, identify a second color corresponding to the second audio signal based on a frequency component of the second audio signal when receiving a second audio signal of the first channel, and control the light source mapped to the first channel to emit light having a color obtained by combining the first color and the second color.

[0068] For example, if the first audio signal of the first channel is a signal having a high frequency component and the second audio signal of the first channel is a signal having a low frequency component, the processor 140 may control the first light source as the light source mapped to the first channel to emit a color obtained by combining red and green.

[0069] In an embodiment, if the second audio signal of the first channel is received together with the first audio signal of the first channel, the processor 140 may control the first light source as the light source mapped to the first channel to emit light in one of the first color and the second color according to the priority. For example, if the priority of the audio signal with a higher frequency is set higher than the priority of the audio signal with a lower frequency, the processor 140 may identify the audio signal with a high frequency component in the first audio signal and the second audio signal, and control the light source to emit light in a color corresponding to the audio signal with the high frequency component. For example, as in the above-mentioned embodiment, if the frequency of the first audio signal is higher than the frequency of the second audio signal, the processor 140 may control the first light source to emit red light.

[0070] The processor 140 may obtain a plurality of audio signals corresponding to the plurality of channels from an audio signal having the plurality of channels, identify the magnitudes of amplitudes of the plurality of audio signals, and adjust the intensity of light emitted by the light source according to the magnitudes of the amplitudes.

[0071] The processor 140 may identify the magnitude of the amplitude corresponding to each audio signal from the plurality of sampled audio signals. The processor 140 may convert the obtained audio signal into an analog signal through a DAC, and identify the magnitude of the amplitude corresponding to each audio signal based on the voltage value of the analog signal.

[0072] The processor 140 may control the light source to emit light with different brightness according to the magnitude of the amplitude. For example, if the magnitude of the amplitude of the audio signal is a first magnitude, the processor 140 may control the light source to emit light with a first brightness corresponding to the first magnitude, and if the magnitude of the amplitude of the audio signal is a second magnitude, the processor 140 may control the light source to emit light with a second brightness corresponding to the second magnitude. The first magnitude may be greater than the second magnitude, and the first brightness may be brighter than the second brightness.

[0073] The processor 140 may control the plurality of light sources based on at least one of a channel of the audio signal and a frequency component of the audio signal and a magnitude of an amplitude of the audio signal.

[0074] For example, refer to Figure 5A If the obtained audio signal is an audio signal of a center channel and the magnitude of the amplitude of the audio signal is a first magnitude, the processor 140 may control the first light source 130-1 to emit light having a first brightness. Figure 5B If the obtained audio signal is an audio signal of a center channel and the amplitude of the audio signal is a second size greater than the first size, the processor 140 may control the first light source 130-1 to emit light having a second brightness with a higher intensity (i.e., brighter than the first brightness).

[0075] If the obtained audio signal is a signal having a high frequency component and the magnitude of the amplitude of the audio signal is a first magnitude, the processor 140 may control the light source to emit red light having a first brightness.

[0076] If the obtained audio signal is an audio signal of a center channel, the frequency component of the audio signal is a high frequency component, and the magnitude of the amplitude of the audio signal is a first magnitude, the processor 140 may control the first light source to emit red light having a first brightness. The processor 140 may control the plurality of light sources to emit light of different colors having different brightnesses according to the channel, frequency component, and amplitude of the audio signal.

[0077] The processor 140 may obtain a plurality of audio signals corresponding to the plurality of channels from an audio signal having the plurality of channels, identify a plurality of rhythms corresponding to the plurality of audio signals, and control a plurality of light sources to flash at a plurality of speeds corresponding to the plurality of rhythms.

[0078] The processor 140 may convert the plurality of audio signals into analog signals through the DAC and identify the rhythms of the plurality of audio signals based on the number of bits included in the analog signals. The processor 140 may identify the rhythms of the plurality of audio signals based on rhythm information included in the audio signals received via the receiver 120.

[0079] The processor 140 may control the light source to flash at different speeds according to the rhythm of the audio signal. For example, if the rhythm of the audio signal is a first rhythm, the processor 140 may control the light source to flash at a first speed, and if the rhythm of the audio signal is a second rhythm, the processor 140 may control the light source to flash at a second speed. The second rhythm may be faster than the first rhythm, and the second speed may be faster than the first speed, but is not limited thereto.

[0080] The processor 140 may control the plurality of light sources based on a channel of the audio signal, a frequency component of the audio signal, and at least one of an amplitude of the audio signal and a rhythm of the audio signal.

[0081] For example, refer to Fig. 6A , if the audio signal is an audio signal of a center channel and the rhythm of the audio signal is a first rhythm, the processor 140 may control the first light source to emit light at a first speed. Figure 6B , if the audio signal is an audio signal of a center channel and the rhythm of the audio signal is a second rhythm faster than the first rhythm, the processor 140 may control the first light source to emit light at the second speed faster than the first speed.

[0082] If the audio signal is an audio signal of a center channel, the magnitude of the amplitude of the audio signal is a first magnitude, and the rhythm of the audio signal is a first rhythm, the processor 140 may control the first light source to emit light having a first brightness corresponding to the first magnitude.

[0083] Thus, when sound with a high bpm is output, the user can utilize a rapidly flashing light source to increase the degree of immersion in the image.

[0084] Figure 7 is a block diagram of a display device according to an embodiment.

[0085] Reference Figure 7 , the display device 100 according to the embodiment may include a display 110, a receiver 120, a plurality of light sources 130 including first to n-th light sources, an audio output unit 150, a high pass filter 160-1, a low pass filter 160-2, and a processor 140. However, this is merely an example, and the display device 100 may further include elements other than the above elements.

[0086] The receiver 120 may receive an audio signal. The receiver 120 may receive an audio signal from an external device through a sound card, HDMI or DP. The receiver 120 may receive an audio signal from an external device via a wireless network. To this end, the receiver 120 may include a Wi-Fi module, a Bluetooth module, a ZigBee module, etc.

[0087] The receiver 120 may receive content data including an image signal and an audio signal. In this case, the processor 140 may demultiplex the content data into an image signal and an audio signal through a demultiplexer (demultiplexer), and decode the image signal and the audio signal divided due to the demultiplexing.

[0088] The processor 140 may output an image via the display 110 based on the decoded image signal, and output a sound via the audio output unit 150 based on the decoded audio signal. According to an embodiment, in the case of the decoded audio signal, the sound may be output via a speaker or earphone through a DAC and a low-frequency amplifier. The sound may be output via a speaker of the display device 100, or may be output via a speaker of an external device such as, for example, a sound bar.

[0089] The processor 140 may control the plurality of light sources 130 based on at least one of the channel, frequency component, amplitude, and rhythm of the audio signal. When receiving content data, the processor 140 may display an image on the display 110 based on an image signal included in the content data, and control the plurality of light sources 130 to emit light based on an audio signal included in the content data.

[0090] For example, when receiving an audio signal having a center channel, an audio signal having a left channel, an audio signal having a right channel, an audio signal having a left surround channel, and an audio signal having a right surround channel, the processor 140 may control light emission of the first to fifth light sources.

[0091] The processor 140 may identify the color of the audio signal corresponding to the center channel based on the frequency component of the audio signal corresponding to the center channel among the multiple audio signals, and control the first light source to emit light having the color corresponding to the audio signal of the center channel; and may identify the color of the audio signal corresponding to the left channel based on the frequency component of the audio signal corresponding to the left channel among the multiple audio signals, and control the second light source to emit light having the color corresponding to the audio signal of the left channel. The processor 140 may identify the color of the audio signal corresponding to the left surround channel based on the frequency component of the audio signal corresponding to the left surround channel among the multiple audio signals, and control the fourth light source to emit light having the color corresponding to the audio signal of the left surround channel; identify the color of the audio signal corresponding to the right channel based on the frequency component of the audio signal corresponding to the right channel among the multiple audio signals, and control the third light source to emit light having the color corresponding to the audio signal of the right channel; and identify the color corresponding to the audio signal of the right surround channel based on the frequency component of the audio signal corresponding to the right surround channel among the multiple audio signals, and control the fifth light source to emit light having the color corresponding to the audio signal of the right surround channel.

[0092] The frequency components of the audio signal can be identified based on the high-pass filter 160-1 and the low-pass filter 160-2. The processor 140 can input a plurality of audio signals to the high-pass filter 160-1 and the low-pass filter 160-2, and if the audio signal is output via the high-pass filter 160-1, it is identified that the audio signal has a high-frequency component, and if the audio signal is output via the low-pass filter 160-2, it is identified that the audio signal has a low-frequency component.

[0093] The processor 140 may perform upmixing or downmixing of the audio signal based on the number of light sources. When an audio signal having a smaller number of channels than the number of light sources is received via the receiver 120, the processor 140 may perform upmixing of the audio signal so that the audio signal has the same number of channels as the number of light sources, and when an audio signal having a larger number of channels than the number of light sources is received via the receiver 120, the processor 140 may perform downmixing of the audio signal so that the audio signal has the same number of channels as the number of light sources.

[0094] For example, when the plurality of light sources are the first light source and the second light source and an audio signal having five channels is received, the processor 140 may perform downmixing of the audio signal into a signal having two channels. The processor 140 may control the first light source and the second light source based on the characteristics of the audio signal of the left channel and the characteristics of the audio signal of the right channel.

[0095] When the plurality of light sources are the first to fifth light sources and an audio signal having seven channels is received, the processor 140 may perform downmixing of the audio signal into a signal having five channels. The processor 140 may control the first to fifth light sources based on the audio signal of the center channel, the audio signal of the left channel, the audio signal of the right channel, the audio signal of the left surround channel, and the audio signal of the right surround channel.

[0096] Therefore, even if an audio signal having a different number of channels from a number of light sources is received, the display device can sufficiently provide a visual effect to a user.

[0097] Figure 8 is a view showing an embodiment in which a display device controls a light source based on information about a position of an object included in content data according to an embodiment.

[0098] The processor 140 may receive content data including an image signal and an audio signal via the receiver 120. The content data may be data received from an external server by running a game application, but is not limited thereto, and may be various types of data, such as data received by running a movie application.

[0099] The processor 140 may display an image based on an image signal included in the content data via the display 110. For example, the processor 140 may include a graphics processing unit (GPU), but is not limited thereto.

[0100] The processor 140 may control the plurality of light sources based on the plurality of audio signals included in the content data.The processor 140 may control the plurality of light sources 130 based on at least one of a channel, a frequency component, a magnitude of an amplitude, and a rhythm of an audio signal.

[0101] The processor 140 may control at least one light source based on information about the position of an object included in the content data. For example, the processor 140 may control at least one light source based on information about the position of an object included in an image displayed on the display. The object may be an object displayed on the display 110 based on an image signal or an object to be displayed on the display 110 based on an image signal. For example, if the content data is data related to game content, the object may be a character displayed on the game image or a character to be displayed on the game image.

[0102] When the content data is received, the processor 140 may identify an audio signal generated based on an object from a plurality of audio signals included in the content data. The audio signal generated based on the object is an audio signal generated according to a user command input to an input unit (e.g., a mouse or keyboard), and may be an audio signal generated when a user inputs a command to drop a bomb via the input unit and the user's character drops the bomb. The content data may also include information about an object mapped to the audio signal, and the processor 140 may identify an audio signal generated based on the object from a plurality of audio signals based on the information about the object mapped to the audio signal.

[0103] The processor 140 may identify the distance between the first object of the first user and the second object of the second user based on the information about the position of the object included in the content data. The information about the position of the object may be the position of the object on the map of the content provided by the content data. The first object of the first user may be the character of the first user, and the second object of the second user may be the character of the second user. The audio signal generated based on the above objects may be an audio signal generated based on the second object. Hereinafter, for ease of description, the audio signal generated based on the second object may be referred to as the audio signal of the second object.

[0104] The processor 140 may control a light source of a channel of an audio signal mapped to the second object based on a distance between the first object and the second object.

[0105] The processor 140 may control a light source of a channel of an audio signal mapped to the second object based on at least one of a channel, a frequency component, a magnitude and a rhythm of an amplitude of the audio signal, and a distance between the first object and the second object.

[0106] The processor 140 may control the light source of the channel of the audio signal of the second object among the plurality of light sources mapped to the channel of the audio signal of the second object based on the channel of the audio signal of the second object. For example, if the channel of the audio signal of the second object is the center channel, the processor 140 may control the first light source located on the rear surface of the display 110 to emit light.

[0107] The processor 140 may identify the color of the audio signal corresponding to the second object based on the frequency component of the audio signal of the second object and the distance between the first object and the second object. When it is identified that the distance between the first object and the second object is the first distance and the frequency of the audio signal of the second object is the first frequency, the processor 140 may identify a color having a lower grayscale than a color identified based on information about a plurality of colors mapped to a plurality of frequency components as a color corresponding to the audio signal of the second object having a lower grayscale. For example, when the distance between the first object and the second object is the first distance, the color corresponding to the first frequency is red, and the channel of the audio signal of the second object is the center channel, the processor 140 may control the first light source to emit orange light.

[0108] When it is identified that the distance between the first object and the second object is the second distance and the frequency of the audio signal of the second object is the first frequency, the processor 140 may identify a color having a higher grayscale than a color identified based on information about a plurality of colors mapped to a plurality of frequency components as a color corresponding to the audio signal of the second object. For example, when the distance between the first object and the second object is the second distance, the color corresponding to the first frequency is red, and the channel of the audio signal of the second object is the center channel, the processor 140 may control the first light source to emit red light. The above-mentioned first distance may be longer than the second distance, but is not limited thereto.

[0109] The processor 140 may identify the brightness of the audio signal corresponding to the second object based on the magnitude of the amplitude of the audio signal of the second object and the distance between the first object and the second object.

[0110] When it is identified that the distance between the first object and the second object is the first distance and the magnitude of the amplitude of the audio signal of the second object is the first amplitude, the processor 140 may identify a color having a lower brightness than the color identified based on the plurality of pieces of brightness information mapped to the plurality of amplitudes as a color corresponding to the audio signal of the second object. For example, when the distance between the first object and the second object is the first distance, the brightness corresponding to the first amplitude is the first brightness, the channel of the audio signal of the second object is the center channel, and the color corresponding to the audio signal of the second object is red, the processor 140 may control the first light source to emit red light having a brightness lower than the first brightness.

[0111] When it is identified that the distance between the first and second objects is the second distance and the magnitude of the amplitude of the audio signal of the second object is the first amplitude, the processor 140 may identify a brightness higher than the brightness identified based on the plurality of brightness information mapped to the plurality of amplitudes as the brightness of the audio signal corresponding to the second object. For example, when the distance between the first object and the second object is the second distance, the brightness corresponding to the first amplitude is the first brightness, the channel of the audio signal of the second object is the center channel, and the color of the audio signal corresponding to the second object is red, the processor 140 may control the first light source to emit red light having a brightness higher than the first brightness. The first distance may be longer than the second distance, but is not limited thereto.

[0112] Therefore, the user can separate the audio signal generated by the character near the user character and the audio signal generated by the character far from the user character and receive the stereoscopic lighting effect.

[0113] Fig. 9 is a flowchart illustrating the operation of the display device according to the embodiment.

[0114] The display apparatus 100 may receive an audio signal having a plurality of channels (operation S910 ).

[0115] The display device 100 may receive an audio signal from an external device through a sound card, HDMI or DP. The display device 100 may receive an audio signal from an external device through a wireless network. To this end, the receiver 120 may include a Wi-Fi module, a Bluetooth module, a ZigBee module, etc.

[0116] For example, when running a game application, the display device 100 may receive an audio signal related to the game from an external server. However, this is merely an example, and the audio signal may be an audio signal generated by running content (e.g., music content, movie content, etc.) pre-stored in the display device 100.

[0117] The audio signal may be an audio signal having a plurality of channels. For example, the audio signal may include a first audio signal of a center (C) channel, a second audio signal of a left (L) channel, a third audio signal of a right (R) channel, a fourth audio signal of a left surround (LS) channel, and a fifth audio signal of a right surround (RS) channel as a 5.1-channel audio signal.

[0118] The display apparatus 100 may obtain a plurality of audio signals corresponding to a plurality of channels from the audio signal (operation S920 ).

[0119] To this end, the display device 100 may identify the number of channels of the audio signal based on information about the number of channels included in the audio signal. The display device 100 may divide the audio signal of each channel based on the preamble included in the audio signal, and obtain a plurality of divided audio signals as a plurality of audio signals corresponding to the plurality of channels.

[0120] However, this is merely an example, and the display device 100 may obtain a plurality of audio signals corresponding to a plurality of channels from the audio signal by various methods. For example, the display device 100 may divide a plurality of audio signals allocated to each channel (e.g., C, L, R, LS, and RS) in the audio signal based on an identifier of each channel, and obtain a plurality of divided audio signals as a plurality of audio signals corresponding to the plurality of channels.

[0121] The display apparatus 100 may recognize a plurality of colors corresponding to the plurality of audio signals based on frequency components of the plurality of audio signals (operation S930). The plurality of audio signals may be signals converted into analog signals by a DAC.

[0122] The display device 100 may input a plurality of audio signals converted into analog signals to a plurality of filters. The plurality of filters may include a high pass filter, a low pass filter, and a band pass filter.

[0123] The display device 100 may identify the audio signal passing through the high pass filter among the plurality of audio signals as an audio signal having a high frequency component, and may identify the audio signal passing through the low pass filter as an audio signal having a low frequency component. The display device 100 may identify the audio signal passing through the band pass filter as an audio signal having a medium frequency component.

[0124] The display apparatus 100 may identify a plurality of colors corresponding to a plurality of audio signals based on information about a plurality of colors mapped to a plurality of frequency components. The information about a plurality of colors mapped to a plurality of frequency components may include information about a color mapped for each frequency component.

[0125] The display apparatus 100 may control the plurality of light sources to emit light having a plurality of colors based on the information about the plurality of light sources mapped to the plurality of channels (operation S940). The information about the plurality of light sources mapped to the plurality of channels may include information about the light source mapped to each channel of the audio signal.

[0126] According to the embodiment, a display device and a control method thereof for controlling a plurality of light sources based on characteristics of an audio signal may be provided. Therefore, a user may have sufficient visual satisfaction and increased image immersion.

[0127] Embodiments may be implemented as software, which includes one or more instructions stored in a machine-readable (e.g., computer-readable) storage medium (e.g., internal memory or external memory). The processor may call instructions from the storage medium and may operate according to the called instructions, including an electronic device (e.g., display device 100). When the instructions are executed by the processor, the processor may use other components to perform functions corresponding to the instructions directly or under the control of the processor. The instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-temporary storage medium.

[0128] The method according to the embodiment may be implemented as software or an application program installable in a display device.

[0129] As a non-limiting example, the method according to the embodiment may be implemented simply by software upgrade or hardware upgrade in the display device of the related art.

[0130] The above-mentioned embodiments may be executed by an embedded server provided in the display device or an external server of the electronic device.

[0131] A non-transitory computer-readable medium storing a program for sequentially executing the method for controlling a display device according to the present disclosure may be provided.

[0132] A non-transitory computer-readable medium is not a medium that stores data for a short period of time, such as a register, cache, or memory, but refers to a medium that stores data semi-permanently and can be read by a machine. The above-mentioned various applications or programs can be stored and provided to a non-transitory computer-readable medium such as a CD, DVD, hard disk drive, Blu-ray disc, USB, memory card, and ROM.

[0133] Although certain embodiments have been specifically shown and described with reference to the accompanying drawings, the embodiments are provided for illustrative purposes, and those skilled in the art will appreciate that various modifications and other equivalent embodiments may be made according to the present disclosure. Therefore, the true technical scope of the present disclosure is defined by the technical spirit of the appended claims.

Claims

1. A display device, include: monitor; Multiple light sources; Receiver; as well as The processor is configured as: Based on an audio signal having a plurality of channels being received from the receiver, a plurality of initial sub audio signals corresponding to the plurality of channels are obtained from the audio signal, performing mixing on the plurality of initial sub audio signals based on the number of the plurality of light sources and the number of the plurality of channels to obtain a plurality of sub audio signals having the same number of channels as the number of the plurality of light sources, identifying a plurality of colors corresponding to the plurality of sub audio signals based on a frequency component of each of the plurality of sub audio signals, and controlling the plurality of light sources to emit light having the plurality of colors based on information about the plurality of light sources mapped to the plurality of channels, Wherein, the processor is further configured to: Based on the audio signal including first and second audio signals respectively corresponding to a first channel among the plurality of channels, a light source mapped to the first channel is controlled to emit light having a combined color obtained by combining a color corresponding to the first audio signal and a color corresponding to the second audio signal.

2. The display device according to claim 1, further comprising: include: Multiple filters, Wherein, the processor is further configured to: inputting the plurality of sub-audio signals to the plurality of filters, respectively identifying frequency components of the plurality of sub audio signals based on the plurality of signals output from the plurality of filters, and The plurality of colors corresponding to the plurality of sub audio signals are respectively identified based on information about the plurality of colors mapped to the plurality of frequency components.

3. The display device according to claim 2, in, The plurality of filters include: a high-pass filter, configured to allow a signal having a frequency component higher than the first frequency among the plurality of frequency components to pass; a low-pass filter for passing a signal having a frequency component lower than a second frequency among the plurality of frequency components; and A bandpass filter is used to pass a signal having a frequency component lower than or equal to the first frequency and higher than or equal to the second frequency among the multiple frequency components.

4. The display device according to claim 1, in, The plurality of light sources include a first light source located on a rear surface of the display, and Wherein, the processor is further configured to: identifying a first color corresponding to a first sub audio signal of a center channel among the plurality of sub audio signals based on a frequency component of the first sub audio signal, and The first light source is controlled to emit light having the first color.

5. The display device according to claim 4, in, The plurality of light sources further comprises: a second light source and a fourth light source located at a lower left portion of the display relative to a vertical axis passing through a center of the display, and a third light source and a fifth light source located at a lower right portion of the display relative to the vertical axis, and Wherein, the processor is further configured to: identifying a second color corresponding to a second sub audio signal of a left channel among the plurality of sub audio signals based on a frequency component of the second sub audio signal, controlling the second light source to emit light having the second color, identifying a third color corresponding to a third sub audio signal of a right channel among the plurality of sub audio signals based on a frequency component of the third sub audio signal, controlling the third light source to emit light having the third color, identifying a fourth color corresponding to a fourth sub audio signal of a left surround channel among the plurality of sub audio signals based on a frequency component of the fourth sub audio signal, controlling the fourth light source to emit light having the fourth color, identifying a fifth color corresponding to a fifth sub audio signal of a right surround channel among the plurality of sub audio signals based on a frequency component of the fifth sub audio signal, controlling the fifth light source to emit light having the fifth color, and Among them, some or all of the first color, the second color, the third color, the fourth color and the fifth color are the same, or all of the first color, the second color, the third color, the fourth color and the fifth color are different from each other.

6. The display device according to claim 5, in, The second light source is located on the front surface of the lower left portion of the display, the fourth light source is located on the bottom surface of the lower left portion, the third light source is located on the front surface of the lower right portion of the display, and the fifth light source is located on the bottom surface of the lower right portion.

7. The display device according to claim 1, in, The processor is further configured to: respectively identifying the magnitudes of the amplitudes of the plurality of sub-audio signals, and The multiple light sources are controlled respectively to emit light with the multiple colors and different brightness according to the magnitude of the amplitude.

8. The display device according to claim 1, in, The processor is further configured to: identifying a plurality of rhythms corresponding to the plurality of sub-audio signals respectively, and The plurality of light sources are respectively controlled to flash at a plurality of speeds corresponding to the plurality of rhythms.

9. The display device according to claim 1, in, The processor is further configured to: displaying an image based on the image signal on the display based on content data including the image signal and the audio signal being received via the receiver, and The plurality of light sources emit light based on the audio signal.

10. The display device according to claim 9, in, The content data further includes information about the location of an object included in the content data, and Wherein, the processor is further configured to: identifying an object audio signal generated based on the object from among the plurality of sub audio signals, identifying a color and brightness corresponding to the object audio signal based on information about the position of the object, and A light source of the plurality of light sources mapped to a channel of the object audio signal among the plurality of channels is controlled to emit light having the color and the brightness.

11. A method for controlling a display device, the method include: Receiving an audio signal having a plurality of channels; Obtaining a plurality of initial sub audio signals corresponding to the plurality of channels from the audio signal; performing mixing on the plurality of initial sub audio signals based on the number of the plurality of light sources and the number of the plurality of channels to obtain a plurality of sub audio signals having the same number of channels as the number of the plurality of light sources; identifying a plurality of colors corresponding to the plurality of sub audio signals based on a frequency component of each of the plurality of sub audio signals; controlling the plurality of light sources to emit light having the plurality of colors based on information about the plurality of light sources mapped to the plurality of channels; as well as Based on the audio signal including first and second audio signals respectively corresponding to a first channel among the plurality of channels, a light source mapped to the first channel is controlled to emit light having a combined color obtained by combining a color corresponding to the first audio signal and a color corresponding to the second audio signal.

12. The method according to claim 11, in, Identifying the plurality of colors further comprises: inputting the plurality of sub-audio signals into a plurality of filters; identifying frequency components of the plurality of sub audio signals respectively based on the plurality of signals output from the plurality of filters; and The plurality of colors corresponding to the plurality of sub audio signals are respectively identified based on information about the plurality of colors mapped to the plurality of frequency components.

13. The method according to claim 12, in, The plurality of filters include: a high-pass filter, configured to allow a signal having a frequency component higher than the first frequency among the plurality of frequency components to pass; a low-pass filter for passing a signal having a frequency component lower than a second frequency among the plurality of frequency components; and A bandpass filter is used to pass a signal having a frequency component lower than or equal to the first frequency and higher than or equal to the second frequency among the multiple frequency components.

14. The method according to claim 11, in, The plurality of light sources include a first light source located on a rear surface of a display of the display device, and Wherein, controlling the plurality of light sources further comprises: identifying a first color corresponding to a first sub audio signal of a center channel based on a frequency component of the first sub audio signal among the plurality of sub audio signals; and The first light source is controlled to emit light having a first color.

Images