Display device

Abstract

A display device according to an embodiment of the present invention may comprise: a speaker; and a controller for transmitting a sound source to the speaker, receiving information including a plurality of hearing loss magnitudes of a user for a plurality of frequencies, respectively, comparing each of the plurality of hearing loss magnitudes with a first reference magnitude to obtain an inaudible frequency, the hearing loss magnitude of which is greater than or equal to the first reference magnitude, among the plurality of frequencies, and outputting, to the speaker, a compensation sound resource obtained by compensating the inaudible frequency among frequencies constituting the sound source.

Description

[Technical Field]

[0001] The present disclosure relates to a display device.[Background Art]

[0002] As the average life expectancy of people increases, the speed of aging is accelerating. Even though the elderly population is increasing at a very rapid rate, preparations for this are almost insufficient, leading to growing social problems.

[0003] Furthermore, problems experienced by the elderly population in daily life are continuing to appear. For example, as a general person gets older, their hearing function naturally deteriorates, and the number of people experiencing hearing loss problems, where they cannot properly hear the sound from a TV when watching it, is continuously increasing.

[0004] In addition, the number of people experiencing noise-induced hearing loss due to the use of electronic devices such as earphones is also increasing.

[0005] Recently, as focus has been placed on methods for accurately representing audio, audio compensation measures for hearing loss caused by increased use of earphones and aging are insufficient.

[0006] When the audio volume is increased, the output magnitude of all frequencies increases, which causes a problem where a frequency with hearing loss sounds relatively smaller.[Disclosure][Technical Problem]

[0007] The present disclosure is to provide a display device and an operating method thereof for improving a viewing environment of a user experiencing hearing loss.

[0008] The present disclosure is to provide a display device and an operating method thereof capable of providing a customized viewing environment to an individual by considering a degree of hearing loss experienced by each user.

[0009] The present disclosure is to provide a display device and an operating method thereof that minimize a hearing loss problem while minimizing inconvenience for users in an environment used by multiple users.[Technical Solution]

[0010] A display device according to an embodiment of the present disclosure may include a speaker and a controller configured to: provide a sound source to the speaker; receive information including a plurality of hearing loss magnitudes for each of a plurality of frequencies of a user; acquire an inaudible frequency, from among the plurality of frequencies, of which a hearing loss magnitude is greater than or equal to a first reference magnitude by comparing each of the plurality of hearing loss magnitudes with the first reference magnitude; and output a compensated sound source, in which the inaudible frequency among frequencies constituting the sound source is compensated, to the speaker.

[0011] The display device according to an embodiment of the present disclosure may compensate for the inaudible frequency by shifting the inaudible frequency to an audible frequency of which a hearing loss magnitude is less than the first reference magnitude.

[0012] The display device according to an embodiment of the present disclosure may filter the inaudible frequency and shift the filtered inaudible frequency to the audible frequency.

[0013] The display device according to an embodiment of the present disclosure may shift the inaudible frequency to the audible frequency by shifting the inaudible frequency by a preset ratio.

[0014] The display device according to an embodiment of the present disclosure may compensate for the inaudible frequency by amplifying an output magnitude of the inaudible frequency.

[0015] The display device according to an embodiment of the present disclosure may amplify the output magnitude of the inaudible frequency to be greater than or equal to the hearing loss magnitude.

[0016] The display device according to an embodiment of the present disclosure may amplify the output magnitude of the inaudible frequency based on the hearing loss magnitude of the inaudible frequency.

[0017] The display device according to an embodiment of the present disclosure may output the compensated sound source by amplifying an output magnitude of a first inaudible frequency of which the hearing loss magnitude is a first magnitude, and shifting a second inaudible frequency of which the hearing loss magnitude is a second magnitude, wherein the first magnitude is less than a second reference magnitude, and the second magnitude is greater than or equal to the second reference magnitude.

[0018] The display device according to an embodiment of the present disclosure may separate a voice signal and a non-voice signal included in the sound source to acquire whether the inaudible frequency is included in the voice signal, and in response to the inaudible frequency being included in the voice signal, output the compensated sound source by synthesizing another voice signal not including the inaudible frequency with the non-voice signal.

[0019] The display device according to an embodiment of the present disclosure may include a wireless communication interface for wireless communication with an external device, and transmit, to the external device, at least one of information including the plurality of hearing loss magnitudes for each of the plurality of frequencies and information related to the compensated sound source.

[0020] The display device according to an embodiment of the present disclosure may receive the information including the plurality of hearing loss magnitudes for each of the plurality of frequencies of the user from an external server.

[0021] The display device according to an embodiment of the present disclosure may display, on a display, an audio setting menu for acquiring the information including the plurality of hearing loss magnitudes for each of the plurality of frequencies of the user.

[0022] The display device according to an embodiment of the present disclosure may output ample sound sources corresponding to each of the plurality of frequencies, and acquire a hearing loss magnitude for each of the sample sound sources.

[0023] The display device according to an embodiment of the present disclosure may further include a camera, identify the user based on an image captured through the camera, and output the compensated sound source based on the information including the plurality of hearing loss magnitudes for each of the plurality of frequencies of the identified user.

[0024] The display device according to an embodiment of the present disclosure may output the compensated sound source based on a user input for selecting whether to output the compensated sound source.[Advantageous Effects]

[0025] According to an embodiment of the present disclosure, since a sound source in which a frequency difficult for a user to hear is compensated is output, there is an advantage that the user can hear all sounds even when an entire volume of audio is not increased.

[0026] According to an embodiment of the present disclosure, since the frequency to be compensated is automatically adjusted according to the user, there is an advantage that inconvenience of the user having to individually adjust the frequency to be compensated can be minimized.

[0027] According to an embodiment of the present disclosure, since whether to output the compensated sound source can be set automatically or manually, there is an advantage that the ease of viewing is maintained.[Description of Drawings]

[0028] FIG. 1 is a block diagram illustrating a configuration of a display device according to an embodiment of the present disclosure. FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure. FIG. 3 shows an example of an actual configuration of a remote control device according to an embodiment of the present disclosure. FIG. 4 shows an example of utilizing a remote control device according to an embodiment of the present disclosure. FIG. 5 is an example of a graph illustrating a hearing loss magnitude of a user. FIG. 6 is an example of a graph including an output magnitude and an audible magnitude of a sound source. FIG. 7 is a block diagram of a display device according to an embodiment of the present disclosure. FIG. 8 is a flowchart for explaining a method in which a display device outputs a compensated sound source by compensating for an inaudible frequency according to an embodiment of the present disclosure. FIG. 9 is a view for explaining an example of a method in which a display device acquires hearing information of a user according to an embodiment of the present disclosure. FIG. 10 is a graph illustrating an example of a frequency compensation region of a sound source according to an embodiment of the present disclosure. FIG. 11 is a view for explaining amplification compensation according to an embodiment of the present disclosure. FIG. 12 is a view illustrating an audible magnitude after amplification compensation according to an embodiment of the present disclosure. FIG. 13 is a view for explaining shifting compensation according to an embodiment of the present disclosure. FIG. 14 is a view illustrating an audible magnitude after shifting compensation according to an embodiment of the present disclosure. FIG. 15 is a view illustrating an example of a waveform of a sound source before frequency compensation is performed according to an embodiment of the present disclosure. FIG. 16 is a view illustrating an example of a waveform of a sound source after shifting compensation is performed according to an embodiment of the present disclosure. FIG. 17 is an example of an output magnitude according to a frequency of a compensated sound source output by a display device according to an embodiment of the present disclosure. FIG. 18 is a flowchart for explaining a method in which a display device outputs a compensated sound source according to an embodiment of the present disclosure. FIG. 19 is an example of a voice signal waveform including an inaudible frequency. FIG. 20 is an example of a voice signal waveform not including an inaudible frequency. [Best Mode]

[0029] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. The suffixes "module" and "unit or portion" for components used in the following description are merely provided only for facilitation of preparing this specification, and thus they are not granted a specific meaning or function.

[0030] FIG. 1 is a block diagram showing a configuration of a display device according to an embodiment of the present disclosure.

[0031] Referring to FIG. 1, a display device 100 may include a broadcast receiver 130, an external device interface 135, a memory 140, a user input interface 150, a controller 170, a wireless communication interface 173, a microphone 175, a display 180, a speaker 185, and a power supply circuit 190.

[0032] The broadcast receiver 130 may include a tuner 131, a demodulator 132, and a network interface 133.

[0033] The tuner 131 may select a specific broadcast channel according to a channel selection command. The tuner 131 may receive a broadcast signal for the selected specific broadcast channel.

[0034] The demodulator 132 may separate the received broadcast signal into an image signal, an audio signal, and a data signal related to a broadcast program, and restore the separated image signal, audio signal, and data signal to a format capable of being output.

[0035] The network interface 133 may provide an interface for connecting the display device 100 to a wired / wireless network including an Internet network. The network interface 133 may transmit or receive data to or from other users or other electronic devices through a connected network or another network linked to the connected network.

[0036] The network interface 133 may access a predetermined web page through the connected network or the other network linked to the connected network. That is, it is possible to access a predetermined web page through a network, and transmit or receive data to or from a corresponding server.

[0037] In addition, the network interface 133 may receive content or data provided by a content provider or a network operator. That is, the network interface 133 may receive content such as movies, advertisements, games, VOD, and broadcast signals and information related thereto provided from a content provider or a network provider through a network.

[0038] In addition, the network interface 133 may receive update information and update files of firmware provided by the network operator, and may transmit data to an Internet or content provider or a network operator.

[0039] The network interface 133 may select and receive a desired application from among applications that are open to the public through a network.

[0040] The external device interface 135 may receive an application or a list of applications in an external device adjacent thereto, and transmit the same to the controller 170 or the memory 140.

[0041] The external device interface 135 may provide a connection path between the display device 100 and an external device. The external device interface 135 may receive one or more of images and audio output from an external device connected to the display device 100 in a wired or wireless manner, and transmit the same to the controller 170. The external device interface 135 may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more High Definition Multimedia Interface (HDMI) terminals, and a component terminal.

[0042] The image signal of the external device input through the external device interface 135 may be output through the display 180. The audio signal of the external device input through the external device interface 135 may be output through the speaker 185.

[0043] The external device connectable to the external device interface 135 may be any one of a set-top box, a Blu-ray player, a DVD player, a game machine, a sound bar, a smartphone, a PC, a USB memory, and a home theater, but this is only an example.

[0044] In addition, a part of content data stored in the display device 100 may be transmitted to a selected user among a selected user or a selected electronic device among other users or other electronic devices registered in advance in the display device 100.

[0045] The memory 140 may store programs for signal processing and control of the controller 170, and may store images, audio, or data signals, which have been subjected to signal-processed.

[0046] In addition, the memory 140 may perform a function for temporarily storing images, audio, or data signals input from an external device interface 135 or the network interface 133, and store information on a predetermined image through a channel storage function.

[0047] The memory 140 may store an application or a list of applications input from the external device interface 135 or the network interface 133.

[0048] The display device 100 may play a content file (a moving image file, a still image file, a music file, a document file, an application file, or the like) stored in the memory 140 and provide the same to the user.

[0049] The user input interface 150 may transmit a signal input by the user to the controller 170 or a signal from the controller 170 to the user. For example, the user input interface 150 may receive and process a control signal such as power on / off, channel selection, screen settings, and the like from the remote control device 200 in accordance with various communication methods, such as a Bluetooth communication method, a WB (Ultra Wideband) communication method, a ZigBee communication method, an RF (Radio Frequency) communication method, or an infrared (IR) communication method or may perform processing to transmit the control signal from the controller 170 to the remote control device 200.

[0050] In addition, the user input interface 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting value to the controller 170.

[0051] The image signal image-processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to a corresponding image signal. Also, the image signal image-processed by the controller 170 may be input to an external output device through the external device interface 135.

[0052] The audio signal processed by the controller 170 may be output to the speaker 185. Also, the audio signal processed by the controller 170 may be input to the external output device through the external device interface 135.

[0053] In addition, the controller 170 may control the overall operation of the display device 100.

[0054] In addition, the controller 170 may control the display device 100 by a user command input through the user input interface 150 or an internal program and connect to a network to download an application a list of applications or applications desired by the user to the display device 100.

[0055] The controller 170 may allow the channel information or the like selected by the user to be output through the display 180 or the speaker 185 along with the processed image or audio signal.

[0056] In addition, the controller 170 may output an image signal or an audio signal through the display 180 or the speaker 185, according to a command for playing an image of an external device through the user input interface 150, the image signal or the audio signal being input from an external device, for example, a camera or a camcorder, through the external device interface 135.

[0057] Meanwhile, the controller 170 may allow the display 180 to display an image, for example, allow a broadcast image which is input through the tuner 131 or an external input image which is input through the external device interface 135, an image which is input through the network interface or an image which is stored in the memory 140 to be displayed on the display 180. In this case, an image being displayed on the display 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

[0058] In addition, the controller 170 may allow content stored in the display device 100, received broadcast content, or external input content input from the outside to be played, and the content may have various forms such as a broadcast image, an external input image, an audio file, still images, accessed web screens, and document files.

[0059] The wireless communication interface 173 may communicate with an external device through wired or wireless communication. The wireless communication interface 173 may perform short range communication with an external device. To this end, the wireless communication interface 173 may support short range communication using at least one of Bluetooth ™< , Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wi-Fi (Wireless-Fidelity), Wi-Fi(Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. The wireless communication interface 173 may support wireless communication between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 and a network in which the display device 100 (or an external server) is located through wireless area networks. The wireless area networks may be wireless personal area networks.

[0060] Here, another display device 100 may be a wearable device (e.g., a smartwatch, smart glasses or a head mounted display (HMD), a mobile terminal such as a smart phone, which is able to exchange data (or interwork) with the display device 100 according to the present disclosure. The wireless communication interface 173 may detect (or recognize) a wearable device capable of communication around the display device 100. Furthermore, when the detected wearable device is an authenticated device to communicate with the display device 100 according to the present disclosure, the controller 170 may transmit at least a portion of data processed by the display device 100 to the wearable device through the wireless communication interface 173. Therefore, a user of the wearable device may use data processed by the display device 100 through the wearable device.

[0061] The microphone 175 can acquire audio. The microphone 175 can include at least one microphone device (not shown) and can acquire audio around the display device 100 through the microphone device (not shown).

[0062] The display 180 may convert image signals, data signals, and OSD signals processed by the controller 170, or image signals or data signals received from the external device interface 135 into R, G, and B signals, and generate drive signals.

[0063] Meanwhile, since the display device 100 shown in FIG. 1 is only an embodiment of the present disclosure, some of the illustrated components may be integrated, added, or omitted depending on the specification of the display device 100 that is actually implemented.

[0064] That is, two or more components may be combined into one component, or one component may be divided into two or more components as necessary. In addition, a function performed in each block is for describing an embodiment of the present disclosure, and its specific operation or device does not limit the scope of the present disclosure.

[0065] According to another embodiment of the present disclosure, unlike the display device 100 shown in FIG. 1, the display device 100 may receive an image through the network interface 133 or the external device interface 135 without a tuner 131 and a demodulator 132 and play the same.

[0066] For example, the display device 100 may be divided into an image processing device, such as a set-top box, for receiving broadcast signals or content according to various network services, and a content playback device that plays content input from the image processing device.

[0067] In this case, an operation method of the display device according to an embodiment of the present disclosure will be described below may be implemented by not only the display device 100 as described with reference to FIG. 1 and but also one of an image processing device such as the separated set-top box and a content playback device including the display 180 and the speaker 185.

[0068] The speaker 185 receives a voice-processed signal from the controller 170 and outputs it as voice.

[0069] The power supply circuit 190 supplies corresponding power throughout the display device 100. In particular, the power supply circuit 190 may supply power to the controller 170, which may be implemented in the form of a System On Chip (SOC), the display 180 for image display, and the speaker 185 for audio output, and the like.

[0070] Specifically, the power supply circuit 190 may include a converter configured to convert AC power into DC power, and a DC / DC converter configured to convert a level of the DC power.

[0071] Next, a remote control device according to an embodiment of the present disclosure will be described with reference to FIGS. 2 to 3.

[0072] FIG. 2 is a block diagram of a remote control device according to an embodiment of the present disclosure, and FIG. 3 shows an actual configuration example of a remote control device 200 according to an embodiment of the present disclosure.

[0073] First, referring to FIG. 2, the remote control device 200 may include a fingerprint reader 210, a wireless communication circuit 220, a user input interface 230, a sensor 240, an output interface 250, a power supply circuit 260, a memory 270, a controller 280, and a microphone 290.

[0074] Referring to FIG. 2, the wireless communication circuit 220 may transmit and receive signals to and from any one of display devices according to embodiments of the present disclosure described above.

[0075] The remote control device 200 may include an RF circuit 221 capable of transmitting and receiving signals to and from the display device 100 according to the RF communication standard, and an IR circuit 223 capable of transmitting and receiving signals to and from the display device 100 according to the IR communication standard. In addition, the remote control device 200 may include a Bluetooth circuit 225 capable of transmitting and receiving signals to and from the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 may include an NFC circuit 227 capable of transmitting and receiving signals to and from the display device 100 according to the NFC (near field communication) communication standard, and a WLAN circuit 229 capable of transmitting and receiving signals to and from the display device 100 according to the wireless LAN (WLAN) communication standard.

[0076] In addition, the remote control device 200 may transmit a signal containing information on the movement of the remote control device 200 to the display device 100 through the wireless communication circuit 220.

[0077] In addition, the remote control device 200 may receive a signal transmitted by the display device 100 through the RF circuit 221, and transmit a command regarding power on / off, channel change, volume adjustment, or the like to the display device 100 through the IR circuit 223 as necessary.

[0078] The user input interface 230 may include a keypad, a button, a touch pad, a touch screen, or the like. The user may input a command related to the display device 100 to the remote control device 200 by operating the user input interface 230. When the user input interface 230 includes a hard key button, the user may input a command related to the display device 100 to the remote control device 200 through a push operation of the hard key button. Details will be described with reference to FIG. 3.

[0079] Referring to FIG. 3, the remote control device 200 may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button 212, a power button 231, a home button 232, a live button 233, an external input button 234, a volume control button 235, a voice recognition button 236, a channel change button 237, an OK button 238, and a back-play button 239.

[0080] The fingerprint recognition button 212 may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button 212 may enable a push operation, and thus may receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on / off the power of the display device 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a real-time broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The volume control button 235 may be a button for adjusting the level of the volume output by the display device 100. The voice recognition button 236 may be a button for receiving a user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The OK button 238 may be a button for selecting a specific function, and the back-play button 239 may be a button for returning to a previous screen.

[0081] A description will be given referring again to FIG. 2.

[0082] When the user input interface 230 includes a touch screen, the user may input a command related to the display device 100 to the remote control device 200 by touching a soft key of the touch screen. In addition, the user input interface 230 may include various types of input means that may be operated by a user, such as a scroll key or a jog key, and the present embodiment does not limit the scope of the present disclosure.

[0083] The sensor 240 may include a gyro sensor 241 or an acceleration sensor 243, and the gyro sensor 241 may sense information regarding the movement of the remote control device 200.

[0084] For example, the gyro sensor 241 may sense information about the operation of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 may sense information about the moving speed of the remote control device 200. Meanwhile, the remote control device 200 may further include a distance measuring sensor to sense the distance between the display device 100 and the display 180.

[0085] The output interface 250 may output an image or audio signal corresponding to the operation of the user input interface 230 or a signal transmitted from the display device 100. The user may recognize whether the user input interface 230 is operated or whether the display device 100 is controlled through the output interface 250.

[0086] For example, the output interface 250 may include an LED 251 that emits light, a vibrator 253 that generates vibration, a speaker 255 that outputs sound, or a display 257 that outputs an image when the user input interface 230 is operated or a signal is transmitted and received to and from the display device 100 through the wireless communication interface 220.

[0087] In addition, the power supply circuit 260 may supply power to the remote control device 200, and stop power supply when the remote control device 200 has not moved for a predetermined time to reduce power consumption. The power supply circuit 260 may restart power supply when a predetermined key provided in the remote control device 200 is operated.

[0088] The memory 270 may store various types of programs and application data required for control or operation of the remote control device 200. When the remote control device 200 transmits and receives signals wirelessly through the display device 100 and the RF circuit 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band.

[0089] The controller 280 of the remote control device 200 may store and refer to information on a frequency band capable of wirelessly transmitting and receiving signals to and from the display device 100 paired with the remote control device 200 in the memory 270.

[0090] The controller 280 may control all matters related to the control of the remote control device 200. The controller 280 may transmit a signal corresponding to a predetermined key operation of the user input interface 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor 240 through the wireless communication interface 220.

[0091] Also, the microphone 290 of the remote control device 200 may obtain a speech.

[0092] A plurality of microphones 290 may be provided, and may acquire voice through the microphone 291.

[0093] Next, a description will be given referring to FIG. 4.

[0094] FIG. 4 shows an example of using a remote control device according to an embodiment of the present disclosure.

[0095] In FIG. 4, (a) illustrates that a pointer 205 corresponding to the remote control device 200 is displayed on the display 180.

[0096] The user may move or rotate the remote control device 200 up, down, left and right. The pointer 205 displayed on the display 180 of the display device 100 may correspond to the movement of the remote control device 200. As shown in the drawings, the pointer 205 is moved and displayed according to movement of the remote control device 200 in a 3D space, so the remote control device 200 may be called a space remote control device.

[0097] In (b) of FIG. 4, it is illustrated that that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display 180 of the display device 100 moves to the left correspondingly.

[0098] Information on the movement of the remote control device 200 detected through a sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 may calculate the coordinates of the pointer 205 based on information on the movement of the remote control device 200. The display device 100 may display the pointer 205 to correspond to the calculated coordinates.

[0099] In (c) of FIG. 4, it is illustrated that a user moves the remote control device 200 away from the display 180 while pressing a specific button in the remote control device 200. Accordingly, a selected area in the display 180 corresponding to the pointer 205 may be zoomed in and displayed enlarged.

[0100] Conversely, when the user moves the remote control device 200 to be close to the display 180, the selected area in the display 180 corresponding to the pointer 205 may be zoomed out and displayed reduced.

[0101] On the other hand, when the remote control device 200 moves away from the display 180, the selected area may be zoomed out, and when the remote control device 200 moves to be close to the display 180, the selected area may be zoomed in.

[0102] Also, in a state in which a specific button in the remote control device 200 is being pressed, recognition of up, down, left, or right movements may be excluded. That is, when the remote control device 200 moves away from or close to the display 180, the up, down, left, or right movements are not recognized, and only the forward and backward movements may be recognized. In a state in which a specific button in the remote control device 200 is not being pressed, only the pointer 205 moves according to the up, down, left, or right movements of the remote control device 200.

[0103] Meanwhile, the movement speed or the movement direction of the pointer 205 may correspond to the movement speed or the movement direction of the remote control device 200.

[0104] Meanwhile, in the present specification, a pointer refers to an object displayed on the display 180 in response to an operation of the remote control device 200. Accordingly, objects of various shapes other than the arrow shape shown in the drawings are possible as the pointer 205. For example, the object may be a concept including a dot, a cursor, a prompt, a thick outline, and the like. In addition, the pointer 205 may be displayed corresponding to any one point among points on a horizontal axis and a vertical axis on the display 180, and may also be displayed corresponding to a plurality of points such as a line and a surface.

[0105] A frequency of sound that a human can hear may include 20 Hz to 20,000 Hz. That is, a human audible frequency band may include 20 Hz to 20,000 Hz.

[0106] The display device 100 may output a sound source including 20 Hz to 20,000 Hz.

[0107] However, hearing for a specific frequency may be lost, or an audible frequency bandwidth may decrease due to reasons such as noise-induced hearing loss or age-related hearing loss.

[0108] Accordingly, a user may have difficulty clearly hearing sound of some frequencies among the sound source output from the display device 100.

[0109] In this regard, description will be provided with reference to FIGS. 5 and 6.

[0110] FIG. 5 is an example of a graph illustrating a hearing loss magnitude of a user. FIG. 6 is an example of a graph including an output magnitude and an audible magnitude of a sound source.

[0111] FIG. 5(a) is a graph illustrating a hearing loss magnitude due to noise-induced hearing loss, and FIG. 5(b) is a graph illustrating a hearing loss magnitude due to age-related hearing loss.

[0112] Referring to FIG. 5(a), when a user is exposed to noise from earphones or the like for less than 5 years, it can be confirmed that a hearing magnitude for a sound of 4,960 Hz decreases by about 13 dB. In addition, when the user is exposed to noise for 15 years or more, it can be confirmed that hearing for the sound of 4,960 Hz is lost by about 34 dB. Accordingly, the user may have difficulty hearing a sound corresponding to 4,960 Hz among the sound source output from the display device 100. At this time, an inaudible frequency of the user may include 4,960 Hz.

[0113] In addition, referring to FIG. 5(b), when the user is 65 years of age or older, it can be confirmed that hearing for a sound of 4,000 Hz is lost by about 32 dB. In addition, it can be confirmed that as the frequency is higher, a magnitude of hearing loss of the user is larger. Accordingly, the user may have difficulty hearing sounds of 4,000 Hz or higher among the sound source output from the display device 100. At this time, an inaudible frequency band of the user may include frequencies of 4,000 Hz or higher.

[0114] The inaudible frequency band may be a range of the inaudible frequency. Hereinafter, the description of the inaudible frequency may also be applied to the inaudible frequency band.

[0115] Meanwhile, in region A of FIG. 6, it can be confirmed that the audible magnitude (v2) is smaller than the output magnitude (v1) of the sound source. A region where the audible magnitude (v2) is smaller than the output magnitude (v1) of the sound source, such as region A, may be a region corresponding to the inaudible frequency.

[0116] When the user increases a volume of the display device 100 to hear the sound of the frequency corresponding to region A, output magnitudes of all frequencies constituting the sound source may increase. Accordingly, the sound of the inaudible frequency may be even less audible.

[0117] Therefore, the display device 100 according to an embodiment of the present disclosure intends to output a sound source by compensating for only the inaudible frequency among frequencies constituting the sound source.

[0118] FIG. 7 is a block diagram of a display device according to an embodiment of the present disclosure.

[0119] Referring to FIG. 7, the display device 100 may include a source input interface 310, a controller 170, an audible information module 320, and a speaker 185.

[0120] The source input interface 310 may receive content or various data related to content and transmit the same to the controller 170. The data related to content may include a content signal. The source input interface 310 may include at least a part of a tuner 131, a network interface unit 133, and an external device interface 135 of FIG. 1.

[0121] The audible information module 320 may receive audible information of the user. The audible information of the user may include hearing loss magnitudes according to each of a plurality of frequencies.

[0122] The audible information module 320 may store the received information in the memory 140 or transmit the same to the controller 170.

[0123] The audible information module 320 may exist outside the controller 170, but unlike what is illustrated, it may be included in the controller 170.

[0124] The controller 170 may process content or data related to content received from the source input interface 310.

[0125] The controller 170 may include at least a part of a signal processing interface 171, a frequency compensation interface 172, and a noise shaping interface 173.

[0126] The signal processing interface 171 may separate the content signal into an image signal and a sound signal. The signal processing interface 171 may acquire a frequency constituting the sound source based on the sound signal. In addition, the signal processing interface 171 may separate the sound signal into a voice signal and a non-voice signal, or synthesize the voice signal and the non-voice signal into the sound signal.

[0127] The frequency compensation interface 172 may compensate for at least a part of frequencies constituting the sound source. The frequency compensation interface 172 may compensate for at least a part of frequencies constituting the sound source based on the audible information received from the audible information module 320. A method in which the frequency compensation interface 172 compensates for a frequency will be described in detail later with reference to FIG. 8.

[0128] The noise shaping interface 173 may manage a quantization error occurring in a process of converting an analog signal into a digital signal. Accordingly, the noise shaping interface 173 may improve quality of the sound signal.

[0129] FIG. 8 is a flowchart for explaining a method in which a display device outputs a compensated sound source by compensating for an inaudible frequency according to an embodiment of the present disclosure.

[0130] The controller 170 may acquire information including a hearing loss magnitude of the user (S11).

[0131] In this regard, description will be provided with reference to FIG. 9.

[0132] FIG. 9 is a view for explaining an example of a method in which a display device acquires hearing information of a user according to an embodiment of the present disclosure.

[0133] The controller 170 may acquire information including a hearing loss magnitude of the user through an audio setting menu.

[0134] The controller 170 may display an audio setting menu for acquiring information including hearing loss magnitudes of each of a plurality of frequencies of the user. A name of the audio setting menu displayed by the controller 170 is illustrated as 'Customized Sound Setting', but may vary according to embodiments.

[0135] The controller 170 may display a plurality of frequencies on the audio setting menu and acquire information including hearing loss magnitudes according to each of the plurality of frequencies.

[0136] For example, the controller 170 may output a sample sound source corresponding to each of the plurality of frequencies to acquire hearing loss magnitudes for each of the sample sound sources. Specifically, when receiving an input for selecting a start icon 181, the controller 170 may sequentially output sample sound sources corresponding to each of the plurality of frequencies.

[0137] The controller 170 may output each of the sample sound sources while decreasing an output magnitude of each sample sound source step by step. Next, the controller 170 may receive an input of whether the sample sound source was heard. When an input of whether the sample sound source was heard is not received within a preset time from a point when the sample sound source is ended, the controller 170 may acquire a hearing loss magnitude based on the output magnitude of the sample sound source.

[0138] Alternatively, the controller 170 may output the sample sound source while increasing a magnitude of the sample sound source step by step. When an input of whether the sample sound source was heard is received within a preset time from a point when the sample sound source is ended, the controller 170 may acquire a hearing loss magnitude based on the output magnitude of the sample sound source.

[0139] To this end, the memory 140 may store data mapping the output magnitude of the sample sound source and the hearing loss magnitude. Alternatively, it may store an arithmetic expression for calculating a hearing loss magnitude according to the output magnitude of the sample sound source. However, a method in which the controller 170 acquires information including hearing loss magnitudes according to each of a plurality of frequencies of the user is not limited thereto.

[0140] As the controller 170 can receive the information including the hearing loss magnitude through the audio setting menu, the user can acquire hearing information of the user without the need to undergo a hearing test at a separate location.

[0141] Meanwhile, the controller 170 may acquire hearing information of the user by a method of receiving information including hearing loss magnitudes for each of a plurality of frequencies of the user from the outside.

[0142] For example, the controller 170 may receive a hearing test result of the user from an external server (not shown). The hearing test result of the user may include a hearing test result received by the user at a hospital. Accordingly, the display device 100 according to an embodiment of the present disclosure may acquire more accurate hearing information.

[0143] That is, the display device 100 according to an embodiment of the present disclosure may directly acquire the information including the hearing loss magnitude from the user, or may acquire the information including the hearing loss magnitude from an external server (not shown).

[0144] In addition, when there is pre-stored hearing information, the controller 170 may modify hearing information of a frequency selected by the user in the audio setting menu. Accordingly, there is an advantage that a change in hearing of the user can be reflected.

[0145] Referring back to FIG. 8.

[0146] The controller 170 may compare the hearing loss magnitude with a first reference magnitude (S13).

[0147] The controller 170 may acquire a frequency, of which a hearing loss magnitude is greater than or equal to the first reference magnitude, as an inaudible frequency (S15).

[0148] The first reference magnitude may be a magnitude preset in consideration of a minimum magnitude for a user to perceive sound or content of the sound. Alternatively, the first reference magnitude may be set to be equal to a magnitude that is a medical standard for determining hearing loss. For example, the first reference magnitude may be 25 dB, but is not limited thereto.

[0149] Next, the controller 170 may acquire a region including the inaudible frequency among the sound source as a frequency compensation region (S17).

[0150] To this end, the controller 170 may separate a content signal into an image signal and an audio signal. The controller 170 may acquire the frequency compensation region based on the audio signal.

[0151] The controller 170 may compensate for the inaudible frequency among frequencies constituting the sound source. The controller 170 may acquire a region corresponding to the inaudible frequency as the frequency compensation region.

[0152] FIG. 10 is a graph illustrating an example of a frequency compensation region of a sound source according to an embodiment of the present disclosure.

[0153] Referring to FIG. 10, the region acquired as the frequency compensation region by the controller 170 may be region B. In the following steps, the controller 170 may compensate for a frequency corresponding to region B among the frequencies constituting the sound source.

[0154] Referring back to FIG. 8.

[0155] The controller 170 may compensate for the inaudible frequency by amplification compensation or shifting compensation.

[0156] That is, the controller 170 may compensate for the inaudible frequency by amplifying an output magnitude of the inaudible frequency. Alternatively, the controller 170 may compensate for the inaudible frequency by shifting the inaudible frequency to another frequency.

[0157] The controller 170 may determine which of the amplification compensation and the shifting compensation is to be used to compensate for the inaudible frequency based on the hearing loss magnitude of the inaudible frequency.

[0158] The controller 170 may acquire whether the hearing loss magnitude of the inaudible frequency is less than a second reference magnitude (S19).

[0159] The second reference magnitude may be a magnitude preset for determining a frequency compensation method. The second reference magnitude may be a magnitude determined in consideration of a degree of distortion of a sound source occurring in a process of compensating for an output magnitude. Alternatively, the second reference magnitude may be a hearing loss magnitude that is a boundary between determination of mild hearing loss and moderate hearing loss. For example, the second reference magnitude may be 40 dB.

[0160] The controller 170 may compensate for the inaudible frequency by one of the amplification compensation and the shifting compensation based on whether the hearing loss magnitude is greater than or equal to the second reference magnitude.

[0161] This is because, when the hearing loss magnitude for a specific frequency is greater than or equal to a certain magnitude, shifting the corresponding frequency to another frequency may be more efficient than amplifying the output magnitude of the frequency.

[0162] The controller 170 may amplify an output magnitude of a frequency of which the hearing loss magnitude is less than the second reference magnitude (S21). In addition, the controller 170 may shift a frequency of which the hearing loss magnitude is less than the second reference magnitude to another frequency (S20).

[0163] That is, the controller 170 may amplify an output magnitude of a first inaudible frequency of which the hearing loss magnitude is a first magnitude, and output a compensated sound source by shifting a second inaudible frequency of which the hearing loss magnitude is a second magnitude, wherein the first magnitude is a magnitude less than the second reference magnitude, and the second magnitude is a magnitude greater than or equal to the second reference magnitude.

[0164] First, amplification compensation will be described with reference to FIGS. 11 and 12.

[0165] FIG. 11 is a view for explaining amplification compensation according to an embodiment of the present disclosure, and FIG. 12 is a view illustrating an audible magnitude after amplification compensation according to an embodiment of the present disclosure.

[0166] FIG. 11 may be a graph illustrating a hearing loss magnitude (d1) and a target hearing loss magnitude (d2) according to amplification compensation.

[0167] The controller 170 may amplify the output magnitude of the inaudible frequency based on the hearing loss magnitude of the inaudible frequency. For example, the controller 170 may amplify the output magnitude of the inaudible frequency to be greater than or equal to the hearing loss magnitude, as illustrated in FIG. 11.

[0168] Accordingly, as illustrated in FIG. 12, an audible magnitude (v3) after the amplification compensation may be larger than an audible magnitude (v2) before the amplification compensation.

[0169] Next, shifting compensation will be described with reference to FIGS. 13 to 16.

[0170] FIG. 13 is a view for explaining shifting compensation according to an embodiment of the present disclosure, and FIG. 14 is a view illustrating an audible magnitude after shifting compensation according to an embodiment of the present disclosure.

[0171] FIG. 13 may be a graph illustrating a hearing loss magnitude (d1) and a target hearing loss magnitude (d3) according to shifting compensation.

[0172] The controller 170 may compensate for the inaudible frequency by shifting the inaudible frequency to an audible frequency. The audible frequency may be a frequency of which a hearing loss magnitude is less than the first reference magnitude.

[0173] The controller 170 may filter the inaudible frequency and shift the filtered inaudible frequency to the audible frequency. For example, the controller 170 may shift the inaudible frequency to the audible frequency by using a frequency filter (not shown).

[0174] The controller 170 may shift the inaudible frequency to the audible frequency by shifting the inaudible frequency by a preset ratio. The preset ratio may be a ratio determined to shift inaudible frequencies of which the hearing loss magnitude is the second magnitude to be included within a frequency band where a hearing loss magnitude is smaller than the second magnitude.

[0175] For example, the controller 170 may compensate for the inaudible frequency by shifting the inaudible frequency of which the hearing loss magnitude is the second magnitude to the audible frequency.

[0176] Alternatively, the controller 170 may shift the inaudible frequency of which the hearing loss magnitude is the second magnitude to be included within a frequency band where a hearing loss magnitude is less than the first magnitude. Accordingly, as illustrated in FIG. 14, a maximum value of a frequency corresponding to an audible magnitude (v4) after the shifting compensation may be equal to a value of a frequency at which the audible magnitude (v2) before the shifting compensation sharply decreases.

[0177] FIG. 15 is a view illustrating an example of a waveform of a sound source before frequency compensation is performed according to an embodiment of the present disclosure, and FIG. 16 is a view illustrating an example of a waveform of a sound source after shifting compensation is performed according to an embodiment of the present disclosure.

[0178] Comparing the waveform of the sound source of FIG. 15 with the waveform of the sound source of FIG. 16, it can be confirmed that there are fewer high-frequency components in the waveform of FIG. 16.

[0179] Meanwhile, the controller 170 may adjust the inaudible frequency based on a user input for adjusting a degree to which the inaudible frequency is amplified or a degree to which the inaudible frequency is shifted. Accordingly, there is an advantage that the user can directly select an optimized compensation degree.

[0180] Referring back to FIG. 8.

[0181] The controller 170 may output the compensated sound source (S23).

[0182] The controller 170 may output the compensated sound source, in which the inaudible frequency among the frequencies constituting the sound source is compensated, to the speaker 185.

[0183] FIG. 17 is an example of an output magnitude according to a frequency of a compensated sound source output by a display device according to an embodiment of the present disclosure.

[0184] It can be confirmed that an output magnitude of region B of FIG. 17 is larger than an output magnitude of region B of FIG. 10. In addition, it can be confirmed that region B of FIG. 17 is a result of the graph of region B of FIG. 16 shifting to the left.

[0185] Meanwhile, the controller 170 may identify the user and output the compensated sound source. The controller 170 may identify the user based on an image captured through a camera (not shown), and output the compensated sound source based on hearing information of the identified user.

[0186] Accordingly, the display device 100 according to an embodiment of the present disclosure may automatically output a compensated sound source optimized for each user.

[0187] Meanwhile, the controller 170 may output the compensated sound source based on a user input for selecting whether to output the compensated sound source.

[0188] Accordingly, a user of the display device 100 according to an embodiment of the present disclosure has an advantage in use that the user can select whether to output an accurate sound source or to output a compensated sound source.

[0189] Summarizing FIG. 8, the display device 100 according to an embodiment of the present disclosure delivers a sound source to the speaker 185, receives information including a plurality of hearing loss magnitudes for each of a plurality of frequencies of a user, compares each of the plurality of hearing loss magnitudes with the first reference magnitude to acquire an inaudible frequency, from among the plurality of frequencies, of which a hearing loss magnitude is greater than or equal to the first reference magnitude, and outputs a compensated sound source, in which the inaudible frequency among frequencies constituting the sound source is compensated, to the speaker 185.

[0190] Accordingly, the display device 100 according to an embodiment of the present disclosure may provide a customized viewing environment to an individual by considering a degree of hearing loss experienced by each user.

[0191] Meanwhile, the display device 100 according to another embodiment of the present disclosure may output a compensated sound source by processing only a voice signal among sound signals.

[0192] In this regard, description will be provided with reference to FIG. 18.

[0193] FIG. 18 is a flowchart for explaining a method in which a display device outputs a compensated sound source according to an embodiment of the present disclosure.

[0194] FIG. 18 may be a flowchart for explaining another embodiment after step S15 of FIG. 8.

[0195] When the controller 170 acquires that the inaudible frequency is included in the sound source, the controller 170 may separate a voice signal and a non-voice signal of the sound source (S31).

[0196] As an example of the voice signal of the sound source including the inaudible frequency, a voice signal corresponding to a high-pitched female voice may be included.

[0197] The voice signal of the sound source including the inaudible frequency may have a waveform as shown in FIG. 19, but this is merely an example.

[0198] The controller 170 may acquire whether the inaudible frequency is included in the voice signal (S31).

[0199] When the controller 170 acquires that the inaudible frequency is not included in the voice signal, the controller 170 may output the sound source as it is (S34).

[0200] When the controller 170 acquires that the inaudible frequency is included in the voice signal, the controller 170 may generate a compensated sound source by synthesizing another voice signal and the non-voice signal (S35).

[0201] Another voice signal may be a voice signal that does not include the inaudible frequency. To this end, the memory 140 may store one or more voice signals.

[0202] As an example of another voice signal, a voice signal corresponding to a low-pitched male voice may be included.

[0203] Another voice signal may have a waveform as shown in FIG. 20. However, the waveform of FIG. 21 is merely an example, and waveforms of another voice signal may vary.

[0204] The controller 170 may output the compensated sound source (S34).

[0205] Summarizing FIG. 18, the display device 100 according to an embodiment of the present disclosure separates a voice signal and a non-voice signal included in a sound source to acquire whether an inaudible frequency is included in the voice signal, and when the inaudible frequency is included in the voice signal, synthesizes another voice signal not including the inaudible frequency and the non-voice signal to output a compensated sound source.

[0206] Accordingly, the display device 100 according to an embodiment of the present disclosure may output a compensated sound source in which sounds of all frequencies are heard as a voice of one person without a sense of difference.

[0207] Meanwhile, the controller 170 may transmit at least one of information including hearing loss magnitudes for each of a plurality of frequencies and information related to a compensated sound source to an external device (not shown). To this end, the display device 100 may include a wireless communication interface 173 for wireless communication with the external device.

[0208] The external device (not shown) may include various electronic devices connected to the display device 100 wirelessly or by wire, such as another display device, an external speaker, and an earphone.

[0209] Information transmitted to the external device (not shown) may be information for the external device (not shown) to output a compensated sound source. For example, the controller 170 may transmit information to the external device to cause the external device to output a compensated sound source when the external device outputs a sound source. At this time, the external device may be a device registered as a device of a specific user.

[0210] In addition, the controller 170 may transmit information to the external device to cause the external device to compensate for and output the inaudible frequency when the external device outputs an alarm or a warning sound.

[0211] In addition, the controller 170 may transmit information to the external device to cause the external device to output an alarm at frequencies excluding a frequency that the external device removes and the inaudible frequency. At this time, the external device may include an earphone having a noise-canceling function.

[0212] That is, the display device 100 according to an embodiment of the present disclosure may cause various electronic devices to output an alarm that is clearly heard by the user by utilizing the hearing information of the user.

[0213] The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains will be able to make various modifications and variations without departing from the essential characteristics of the present invention.

[0214] Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to explain it, and the scope of the technical idea of the present invention is not limited by these embodiments.

[0215] The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of rights of the present invention.

Claims

1. A display device, comprising: a speaker; and a controller configured to: provide a sound source to the speaker; receive information including a plurality of hearing loss magnitudes for each of a plurality of frequencies of a user; acquire an inaudible frequency, from among the plurality of frequencies, having a hearing loss magnitude greater than or equal to a first reference magnitude by comparing each of the plurality of hearing loss magnitudes with the first reference magnitude; and output a compensated sound source, in which the inaudible frequency among frequencies constituting the sound source is compensated, to the speaker.

2. The display device according to claim 1, wherein the controller is configured to compensate for the inaudible frequency by shifting the inaudible frequency to an audible frequency having a hearing loss magnitude less than the first reference magnitude.

3. The display device according to claim 2, wherein the controller is configured to filter the inaudible frequency and shift the filtered inaudible frequency to the audible frequency.

4. The display device according to claim 2, wherein the controller is configured to shift the inaudible frequency to the audible frequency by shifting the inaudible frequency by a preset ratio.

5. The display device according to claim 1, wherein the controller is configured to compensate for the inaudible frequency by amplifying an output magnitude of the inaudible frequency.

6. The display device according to claim 5, wherein the controller is configured to amplify the output magnitude of the inaudible frequency to be greater than or equal to the hearing loss magnitude.

7. The display device according to claim 5, wherein the controller is configured to amplify the output magnitude of the inaudible frequency based on the hearing loss magnitude of the inaudible frequency.

8. The display device according to claim 1, wherein the controller is configured to: output the compensated sound source by amplifying an output magnitude of a first inaudible frequency of which the hearing loss magnitude is a first magnitude and shifting a second inaudible frequency of which the hearing loss magnitude is a second magnitude, wherein the first magnitude is less than a second reference magnitude, and the second magnitude is greater than or equal to the second reference magnitude.

9. The display device according to claim 1, wherein the controller is configured to: separate a voice signal and a non-voice signal included in the sound source to acquire whether the inaudible frequency is included in the voice signal, and when the inaudible frequency is included in the voice signal, output the compensated sound source by synthesizing another voice signal not including the inaudible frequency with the non-voice signal.

10. The display device according to claim 1, further comprising a wireless communication interface for wireless communication with an external device, wherein the controller is configured to transmit, to the external device, at least one of the information including the plurality of hearing loss magnitudes for each of the plurality of frequencies and information related to the compensated sound source.

11. The display device according to claim 1, wherein the controller is configured to receive the information including the plurality of hearing loss magnitudes for each of the plurality of frequencies of the user from an external server.

12. The display device according to claim 1, wherein the controller is configured to display, on a display, an audio setting menu for acquiring the information including the plurality of hearing loss magnitudes for each of the plurality of frequencies of the user.

13. The display device according to claim 12, wherein the controller is configured to: output sample sound sources corresponding to each of the plurality of frequencies; and acquire a hearing loss magnitude for each of the sample sound sources.

14. The display device according to claim 1, further comprising a camera, wherein the controller is configured to: identify the user based on an image captured through the camera; and output the compensated sound source based on the information including the plurality of hearing loss magnitudes for each of the plurality of frequencies of the identified user.

15. The display device according to claim 1, wherein the controller is configured to output the compensated sound source based on a user input for selecting whether to output the compensated sound source.

Images