Speaker device having hearing aid function, audio / video device comprising speaker device, and acoustic signal output method for hearing loss users

Abstract

A speaker device having a hearing aid function, an audio / video device comprising the speaker device, and an acoustic signal output method for hearing loss users are disclosed. The disclosed speaker device having a hearing aid function comprises: a processor unit for extracting only an input voice signal from an input acoustic signal, automatically adjusting the volume of the input acoustic signal on the basis of a preset target volume, and extending and amplifying, on the basis of hearing loss information of a user, the input voice signal in the input acoustic signal of which the volume has been adjusted; and a speaker unit for outputting, to the user, an output acoustic signal including the extended and amplified input voice signal.

Description

A speaker device equipped with a hearing assistance function, an audio / video device including said speaker device, and a method for outputting an acoustic signal for a user with hearing loss.

[0001] Embodiments of the present invention relate to a speaker device having a hearing assistance function, an audio / video device including said speaker device, and a method for outputting an acoustic signal for a user with hearing loss.

[0002] Hearing loss refers to a condition in which there is difficulty hearing sounds of specific frequencies or intensities. To alleviate the discomfort experienced by users with hearing loss, individuals wear hearing aids to hear voice signals.

[0003] Figure 1 is a diagram illustrating the concept of a person with hearing loss wearing a hearing aid to compensate for hearing loss.

[0004] Referring to Fig. 1, when a speaker is actually speaking from 1 meter in front, the average volume of the shouting sound is 80 dBSPL, the average volume of the everyday conversation sound is 65 dBSPL, and the average volume of the whispering sound is 50 dBSPL.

[0005] At this time, referring to the upper diagram of Fig. 1, a normal user without hearing loss hears the sound produced by the speaker accurately without loss. That is, in the case of shouting conversation, a normal person hears a sound of 80 dBSPL, in the case of everyday conversation, a normal person hears a sound of 65 dBSPL, and in the case of whispering conversation, a normal person hears a sound of 50 dBSPL.

[0006] However, referring to the lower drawing of FIG. 1, a person with hearing loss cannot accurately hear the sound of a speaker located nearby. To solve this problem, a hearing aid with a Dynamic Range Compressor (DRC) set to correspond to the amount of hearing loss of the person with hearing loss is worn on the ear of the person with hearing loss, and the person with hearing loss hears the voice signal output from the hearing aid. As in the example shown in FIG. 1, assuming that the amount of hearing loss of the person with hearing loss is 20 dB, when the speaker speaks a shouting conversational voice signal (80 dBSPL), the hearing aid outputs a sound of 100 dBSPL to the eardrum of the person with hearing loss; when the speaker speaks an everyday conversational voice signal (65 dBSPL), the hearing aid outputs a sound of 90 dBSPL to the eardrum of the person with hearing loss; and when the speaker speaks a whispering conversational voice signal (50 dBSPL), the hearing aid outputs a sound of 80 dBSPL to the eardrum of the person with hearing loss.

[0007] However, wearing a hearing aid for a long time can cause excessive pressure on specific parts of the ear, which can cause discomfort to people with hearing loss.

[0008] Meanwhile, audio / video devices such as speakers and TVs already provide speech intelligibility enhancement features. Speech intelligibility enhancement is a function that amplifies the energy in the voice frequency band to make the voice clearer during playback. Some people with hearing loss listen to audio signals output from audio / video devices using speech intelligibility enhancement features without wearing hearing aids.

[0009] However, since voice signals output using the speech clarity enhancement function amplify all voice components, both loud and soft, this increases fatigue for hearing-impaired individuals who already hear loud sounds well but cannot hear soft sounds; further deteriorates hearing due to prolonged exposure to loud noises; and causes inter-floor noise due to the playback of loud sounds.

[0010]

[0011] The objective of the present invention is to propose a speaker device having a hearing assistance function that amplifies a small voice signal inaudible to a person with hearing loss (i.e., a hearing loss user) due to hearing impairment, converts it into an audible voice signal, and provides the amplified voice signal to a person with hearing loss who does not wear a hearing aid, an audio / video device including said speaker device, and a method for outputting an acoustic signal for a hearing loss user.

[0012] The objects of the present invention are not limited to those mentioned above, and other unmentioned objects and advantages of the present invention may be understood from the following description and will be more clearly understood by the embodiments of the present invention. Furthermore, it will be readily apparent that the objects and advantages of the present invention can be realized by the means and combinations thereof set forth in the claims.

[0013] A speaker device according to one embodiment of the present invention is a speaker device having a hearing assistance function, comprising: a processor unit that extracts only an input voice signal from an input acoustic signal, adjusts the volume of the input acoustic signal based on a preset target volume, and expands and amplifies the input voice signal within the volume-adjusted input acoustic signal based on information regarding a user's hearing loss; and a speaker unit that outputs an output acoustic signal including the expanded and amplified input voice signal to the user.

[0014] A method for outputting an acoustic signal according to an embodiment of the present invention is a method for outputting an acoustic signal for a user with hearing loss performed in a speaker device, comprising: a step of extracting only an input voice signal from an input acoustic signal; a step of adjusting the volume of the input acoustic signal based on a preset target volume; a step of extending and amplifying the input voice signal within the volume-adjusted input acoustic signal based on the user's hearing loss information; and a step of outputting an output acoustic signal including the extended and amplified input voice signal to the user.

[0015] According to the present invention, a hearing-impaired person who does not wear a hearing aid can be provided with the same clear voice signal as when wearing a hearing aid.

[0016] In addition, according to the present invention, fatigue of people with hearing loss due to prolonged wearing of a hearing aid can be reduced, and the problem of inter-floor noise caused by loud voice signal output can be resolved.

[0017] Furthermore, the effects of the present invention are not limited to the effects described above, and should be understood to include all effects that can be inferred from the configuration of the invention described in the detailed description or claims of the present invention.

[0018] Figure 1 is a diagram illustrating the concept of a person with hearing loss wearing a hearing aid to compensate for hearing loss.

[0019] FIG. 2 is a diagram illustrating the schematic configuration of an audio / video output system according to one embodiment of the present invention.

[0020] FIG. 3 is a diagram for establishing the operation concept of an audio / video output system according to one embodiment of the present invention.

[0021] Figure 4 is a diagram illustrating an example of a hearing graph for a type of hearing loss.

[0022] FIG. 5 is a diagram illustrating the approximate configuration of a speaker device according to one embodiment of the present invention.

[0023] FIG. 6 is a drawing for explaining the operation of a speaker device according to one embodiment of the present invention.

[0024] FIG. 7 is a diagram illustrating the overall flowchart of an acoustic signal output method for a person with hearing loss according to one embodiment of the present invention.

[0025] The present invention is susceptible to various modifications and may have various embodiments, and specific embodiments are illustrated in the drawings and described in detail. However, this is not intended to limit the invention to specific embodiments, and it should be understood that the invention includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the invention. Similar reference numerals have been used for similar components in the description of each drawing.

[0026] Terms such as "first," "second," etc., may be used to describe various components, but said components should not be limited by said terms. Such terms are used solely for the purpose of distinguishing one component from another. The term "and / or" includes a combination of multiple related described items or any of the multiple related described items.

[0027] When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

[0028] The terms used in this specification are used merely to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, terms such as “comprising” or “having” are intended to indicate the presence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0029] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application.

[0030] Hereinafter, embodiments according to the present invention will be described in detail with reference to the attached drawings.

[0031]

[0032] FIG. 2 is a diagram illustrating the schematic configuration of an audio / video output system (1) according to one embodiment of the present invention.

[0033] Referring to FIG. 2, the audio / video output system (1) is a system installed in a specific room (e.g., living room, bedroom, etc.) to output sound signals to a hearing-impaired person who does not wear a hearing aid, and may include an audio / video device (10), a speaker device (20), a terminal device (30), and a remote control device (40).

[0034] The audio / video device (10) may be a conventional device that provides an audio signal and / or video signal to the user.

[0035] According to an embodiment, the audio / video device (10) may include a TV (television), a PC (personal computer), a laptop, a smart device, or an immersive audio device. FIG. 2 illustrates an example in which the audio / video device (10) is a TV (10).

[0036] The audio / video device (10) can receive input content from a content provider device / server. In this case, if the audio / video device (10) is a device such as a TV as shown in FIG. 2, the input video signal included in the input content can be output through a display module included in the TV, and the sound signal included in the input content can be output after signal processing at a speaker device (20).

[0037] Meanwhile, if the audio / video device (10) is an audio device that outputs only an audio signal, the audio signal included in the input content may be output after signal processing at the speaker device (20). And, the input audio signal includes a voice signal, and the immersive audio device may transmit the audio signal of the voice signal channel to the speaker device (20).

[0038] The speaker device (20) can be connected to the audio / video device (10) via a wired or wireless connection to receive an input sound signal from the audio / video device (10), process the input sound signal to generate an output sound signal, and provide the generated output sound signal to a person with hearing loss (i.e., a user with hearing loss).

[0039] In particular, the speaker device (20) may be an audio output device equipped with a hearing aid function that provides a clear output voice signal to a hearing-impaired person located away from the audio / video device (10) and the speaker device (20). That is, the speaker device (20) can expand and amplify a voice signal of a small size that a hearing-impaired person cannot hear, and convert it into a voice signal of a size that a hearing-impaired person can hear.

[0040] The terminal device (30) may be a processor device including a smartphone owned by a person with hearing loss, and may be connected to a speaker device (20) for communication.

[0041] The terminal device (30) may be equipped with a built-in camera and a built-in microphone. As described below, the terminal device (30) can acquire an image of audiogram test information corresponding to the hearing loss information of a person with hearing loss through the built-in camera and then transmit it to the speaker device (20). Additionally, as described below, the terminal device (30) can receive an output acoustic signal output from the speaker device (20) through the built-in microphone, and can transmit the acoustic information of the output acoustic signal to the speaker device (20) after modifying it by reflecting spatial acoustic characteristics measured through an acoustic measurement algorithm within the terminal device (30).

[0042] The remote control device (40) may be a processor device that communicates with the speaker device (20) and controls the speaker device (20) remotely.

[0043] The remote control device (40) may be equipped with a microphone module and may also be equipped with a plurality of hearing aid mode buttons. As described below, the remote control device (40) may transmit selection information of a first hearing aid mode button among the plurality of hearing aid mode buttons to the speaker device (20). Additionally, as described below, the remote control device (40) may receive an output acoustic signal output from the speaker device (20) through the microphone module, and may transmit the acoustic information of the output acoustic signal to the speaker device (20) after modifying it by reflecting spatial acoustic characteristics measured through an acoustic measurement algorithm within the remote control device (40).

[0044] Meanwhile, the terminal device (30) or the remote control device (40) can receive a noise signal, a sine wave, or a swept sine wave, which is a spatial acoustic measurement signal output from the speaker device (20), and calculate spatial acoustic characteristic information including an impulse response through signal processing. At this time, as described below, the spatial acoustic characteristic information can be used to correct the volume of the voice signal, and accordingly, an accurate acoustic signal targeting the hearing loss can be output at the listening position of the hearing loss patient.

[0045] Hereinafter, with reference to FIG. 3, the concept of operation in which an audio / video output system (1) provides an acoustic signal including a clear voice signal to a person with hearing loss will be specifically explained.

[0046] FIG. 3 is a diagram illustrating the concept of operation of an audio / video output system (1) according to an embodiment of the present invention. At this time, the audio / video device (10) is assumed to be a TV (10).

[0047] First, the TV (10) can transmit an audio signal to the speaker device (20).

[0048] Next, the speaker device (20) can extract only the voice signal from the sound signal received from the TV (10).

[0049] That is, the speaker device (20) can extract only the input voice signal from an input acoustic signal including voice signals and non-voice signals. Known voice extraction algorithms may be used to extract the input voice signal.

[0050] Hereinafter, for convenience of explanation, the sound signal transmitted to the TV (10) is referred to as the "input sound signal," and the voice signal included in the sound signal transmitted to the TV (10) is referred to as the "input voice signal."

[0051] Additionally, the speaker device (20) can adjust the volume of the TV (10) by analyzing the energy of the input voice signal extracted over a preset time.

[0052] Specifically, as shown in Fig. 1, when a speaker located 1 meter in front of a person with hearing loss actually speaks, the average volume of the voice signal for shouting conversation is 80 dBSPL, the average volume of the voice signal for everyday conversation is 65 dBSPL, and the average volume of the voice signal for whispering conversation is 50 dBSPL.

[0053] However, since the voice signal output from the TV (10) is not the actual voice signal of the speaker, the volume of the input voice signal differs from the volume of the speaker's actual voice signal. That is, in the case of the input voice signal, the volume of the voice signal for shouting, everyday conversation, and whispering conversation may be smaller or larger than the aforementioned 80dBSPL, 65dBSPL, and 50dBSPL. For example, in the input voice signal, if the volume of shouting conversation is 70dBSPL, the volume of everyday conversation is 55dBSPL, and the volume of whispering conversation is 40dBSPL, a problem arises in that the hearing aid function provided by the speaker device (20) cannot be properly implemented.

[0054] Accordingly, to implement a situation similar to that of FIG. 1, the speaker device (20) can analyze the average energy of the input voice signal over a certain period of time and adjust the volume of the input voice signal so that the average volume of the input voice signal matches a preset target volume. At this time, the target volume may be a specific volume included in the volume range of the voice signal in everyday conversation, and the volume range of the voice signal may include 65 dBSPL. By matching the average volume of the input voice signal to the target volume, a situation identical to when a speaker speaks in a real environment can be implemented. That is, the volume of the TV (10) can be automatically controlled as if the speaker were actually speaking within the TV (10).

[0055] For example, it is assumed that the target volume is set to 65 dBSPL and the average volume of the input voice signal is calculated to be 55 dBSPL. In this case, the shouting conversation of the input voice signal has a volume of 70 dBSPL, the everyday conversation of the input voice signal has a volume of 55 dBSPL, and the whispering conversation of the input voice signal has a volume of 40 dBSPL. In this case, the speaker device (20) can adjust the volume of the input voice signal so that the average volume of the input voice signal becomes 65 dBSPL. Therefore, in the case of the volume-adjusted input voice signal, the shouting conversation has a volume of 80 dBSPL, the everyday conversation has a volume of 65 dBSPL, and the whispering conversation has a volume of 50 dBSPL.

[0056] Afterwards, the speaker device (20) can perform dynamic range compression (DRC) on the volume-controlled input voice signal by frequency band, and the volume of the target eardrum can be set through the performance of dynamic range compression.

[0057] Here, dynamic range compression reduces the volume difference between loud and soft parts of a speech signal; generally, it maintains loud voice components (e.g., vowel components) while amplifying soft voice components (e.g., consonant components). Additionally, input speech signals may be stretched and amplified differently across voice frequency bands based on individual hearing loss measurement data. As dynamic range compression is a known feature of hearing aids, a detailed explanation is omitted.

[0058] At this time, the speaker device (20) can perform dynamic range compression using hearing loss measurement data of a person with hearing loss. At this time, the individual hearing loss measurement data corresponds to the hearing loss information of the person with hearing loss and can be obtained based on information received from the terminal device (30) or the remote control device (40).

[0059] According to an embodiment, the speaker device (20) can receive audiogram test information of a person with hearing loss from the terminal device (30) and can obtain hearing loss measurement data based on the audiogram test information. Here, the audiogram test information may correspond to a hearing graph included in a result sheet for a hearing test typically performed at a hospital, etc.

[0060] Figure 4 is a diagram illustrating an example of a hearing graph for a type of hearing loss.

[0061] A hearing graph is a graph that correlates speech signal frequencies with the magnitude of hearing loss, and can correspond to the aforementioned hearing loss measurement data or hearing loss information.

[0062] Referring to Fig. 4, types of hearing loss include mild sloping hearing loss, moderate flat hearing loss, moderately severe rising hearing loss, and profound steeply sloping hearing loss above 2 kHz. Meanwhile, there are various other types of hearing loss that are not shown in Fig. 4.

[0063] Referring to the contents of FIG. 4, the terminal device (30) can acquire a hearing graph image through a built-in camera and transmit the acquired hearing graph to the speaker device (20). The speaker device (20) can analyze the hearing graph image to calculate hearing loss measurement data (i.e., hearing loss information) and can compress the dynamic range of an input voice signal with adjusted volume based on the calculated hearing loss measurement data.

[0064] For example, if the hearing loss type of a person with hearing loss is a 2 kHz steep slope deep hearing loss type, they cannot hear small voice signals, especially in frequency bands above 1 kHz. Therefore, the speaker device (20) can set frequency bands that the person with hearing loss cannot hear based on a graph of the 2 kHz steep slope deep hearing loss type, and can improve speech clarity by performing dynamic range compression for each frequency band. At this time, since the dynamic range compression for each frequency band is the same as the dynamic range compression for manufacturing a general hearing aid, a detailed explanation is omitted.

[0065] According to another embodiment, the speaker device (20) can receive selection information of a first hearing aid mode button among a plurality of hearing aid mode buttons provided in the remote control device (40) from the remote control device (40), and can obtain hearing loss measurement data based on the selection information of the first hearing aid mode button.

[0066] Specifically, to implement a hearing aid function of the speaker device (20), a plurality of hearing aid mode buttons corresponding to a plurality of hearing loss types (see FIG. 4) may be provided in the remote control device (40). At this time, the person with hearing loss may perform the act of pressing at least some of the plurality of hearing aid mode buttons. Afterward, the person with hearing loss may select a first hearing aid mode button among the plurality of hearing aid mode buttons, and the remote control device (40) may transmit the selection information of the first hearing aid mode button to the speaker device (20). Based on the selection information of the first hearing aid mode button, the speaker device (20) may calculate hearing loss measurement data (i.e., hearing loss information) corresponding to the type of hearing loss of the person with hearing loss, and based on the calculated hearing loss measurement data, may dynamic range compress an input voice signal with adjusted volume.

[0067] Again, referring to FIG. 3, the speaker device (20) can control the volume and frequency characteristics of an input voice signal in which dynamic range compression has been performed by using spatial acoustic characteristic information (i.e., spatial acoustic measurement data) at a representative listening point. Through this, the volume of the output voice signal at the representative listening point can match the volume of the output voice signal heard by the eardrum of a person with hearing loss.

[0068] Specifically, the speaker device (20) can provide an output acoustic signal containing an input voice signal to a person with hearing loss, wherein dynamic range compression has been performed. At this time, since the audio / video output system (1) is installed in a room, the output acoustic signal can reach the person with hearing loss through various acoustic paths. For example, some of the output acoustic signal may reach the person with hearing loss directly, while other parts of the output acoustic signal may reach the person with hearing loss after being reflected from a wall. Furthermore, the person with hearing loss may not be in a fixed position within the room and may change their position. For these reasons, the magnitude and frequency characteristics of the output voice signal included in the output acoustic signal may not match the magnitude and frequency characteristics of the voice signal that is accurately matched with the person with hearing loss information. Therefore, there is a possibility that the output voice signal included in the output acoustic signal may not be heard clearly by the person with hearing loss.

[0069] To solve these problems, the speaker device (20) can generate an output voice signal by performing volume and frequency response control on an input voice signal that has undergone dynamic range compression based on spatial acoustic characteristic information at a representative listening point of a person with hearing loss, and can provide an output acoustic signal including the output voice signal to the person with hearing loss.

[0070] According to the embodiment, spatial acoustic characteristic information at a representative listening point can be calculated based on information of an output acoustic signal transmitted from a terminal device (30) or a remote control device (40). Hereinafter, for convenience of explanation, the terminal device (30) or the remote control device (40) is referred to as the "first device (30 / 40)," and the built-in microphone of the terminal device (30) or the microphone module of the remote control device (40) is referred to as the "microphone."

[0071] Specifically, the first device (30 / 40) can receive an output acoustic signal played from the speaker device (20) through a microphone module. Here, since the first device (30 / 40) is located near the hearing-impaired person, i.e., at a representative listening point, the output acoustic signal received by the microphone of the first device (30 / 40) may be most similar to the output acoustic signal actually heard through the hearing-impaired person's eardrum.

[0072] At this time, the first device (30 / 40) can record the output acoustic signal it has received for a certain period and transmit it to the speaker device (20). The speaker device (20) can calculate spatial acoustic characteristic information by performing a comparison of the volume and frequency response between the recorded output acoustic signal and the volume of the target eardrum. Alternatively, the speaker device (20) can transmit the volume of the target eardrum to the first device (30 / 40) through a short-range communication module, calculate spatial acoustic characteristic information by performing a comparison of the volume and frequency response between the recorded output acoustic signal and the volume of the target eardrum, and transmit the calculated spatial acoustic characteristic information to the speaker device (20) through a short-range communication module.

[0073] Afterward, the speaker device (20) can calculate the average volume of the output voice signal using the calculated spatial acoustic characteristic information, and can calculate the difference volume between the average volume of the calculated output voice signal and the average volume of the input voice signal after dynamic range compression. Then, the speaker device (20) can correct the volume of the input voice signal after dynamic range compression based on the calculated difference volume, and can provide an output acoustic signal including an output voice signal corresponding to the input voice signal with the corrected volume to a person with hearing loss.

[0074] For example, if the type of hearing loss in a person with hearing loss is a 2 kHz steep slope type of profound hearing loss, through the process described above, the person with hearing loss can hear shouting sounds at a volume of 100 dBSPL, everyday conversation sounds at a volume of 90 dBSPL, and whispering conversation sounds at a volume of 80 dBSPL. Thus, the person with hearing loss can hear the output speech signal more clearly.

[0075] According to another embodiment, spatial acoustic characteristic information at a representative listening point can be calculated based on test acoustic signal information output from a speaker device (20). In this case, the test acoustic signal may be an acoustic signal output in advance by the speaker device (20) before outputting the output voice signal.

[0076] Specifically, the speaker device (20) can store a test acoustic signal (i.e., a signal tone) including at least one of a noise signal, a sine wave, a sweep sine wave, voice, and music in a storage unit and then output it to a room. And, a first device (30 / 40) located at a user's preset representative listening point can receive the test acoustic signal output from the speaker device (20) through a microphone.

[0077] At this time, the speaker device (20) can transmit a stored test acoustic signal to the first device (30 / 40) through a short-range communication module (e.g., a Bluetooth module), and the first device (30 / 40) can calculate impulse response information based on the stored test acoustic signal and the test acoustic signal received by the microphone and transmit it to the speaker device (20). Alternatively, the first device (30 / 40) can transmit the test acoustic signal itself received by the microphone to the speaker device (20) through a short-range communication module, and the speaker device (20) can calculate impulse response information based on the stored test acoustic signal and the test acoustic signal received by the microphone.

[0078] Afterwards, the speaker device (20) can correct the volume of an input voice signal for which dynamic range compression has been performed based on impulse response information and corresponding spatial acoustic characteristic information, and can provide an output acoustic signal including an output voice signal corresponding to the input voice signal with corrected volume to a person with hearing loss.

[0079] Hereinafter, the configuration and operation of a speaker device (20) that performs the above-described process, and a method for outputting an acoustic signal for a hearing-loss user performed by the speaker device (20) will be described.

[0080] FIG. 5 is a diagram illustrating the schematic configuration of a speaker device (20) according to one embodiment of the present invention.

[0081] Referring to FIG. 5, the speaker device (20) is equipped with a hearing aid function as described above and may include a communication unit (21), a processor unit (22), and a speaker unit (23).

[0082] The communication unit (21) can be connected to an audio / video device (10), a terminal device (30), and a remote control device (40).

[0083] Specifically, the communication unit (21) can receive an input sound signal by being connected to the audio / video device (10) via a wired or wireless connection. Additionally, the communication unit (21) can receive audiogram test information from the terminal device (30) or receive selection information for the first hearing aid mode button from the remote control device (40). Furthermore, the communication unit (21) can receive information on the output sound signal or the test sound signal from the first device (30 / 40). For example, the communication unit (21) may include a wired communication module or a short-range wireless communication module such as Bluetooth or WiFi.

[0084] The processor unit (22) may include one or more of a central processing unit, an application processor, or a communication processor. The processor unit (22) may perform operations or data processing regarding the control and / or communication of at least one other component of the speaker device (20). In particular, the processor unit (22) may execute instructions of a computer program / application for processing an input acoustic signal, i.e., signal processing, to generate an output acoustic signal including an output voice signal.

[0085] For signal processing of an input audio signal, the processor unit (22) may include a voice extraction module (221), a volume control module (222), a compressor module (223), and a volume correction module (224). Here, the term "module" may refer to a functional and structural combination of hardware for carrying out the technical concept of the present invention and software for driving said hardware. For example, said module may refer to a logical unit of a certain code and a hardware resource for executing said code, and it can be easily inferred by an average expert in the technical field of the present invention that it does not necessarily refer to physically connected code or a single type of hardware.

[0086] The speaker unit (23) can output an output acoustic signal to a hearing-impaired person located away from the speaker device (20). Here, the output acoustic signal may include the signal-processed input voice signal described above.

[0087] In addition to this, the speaker device (20) may further include a storage unit that stores various information used in the processing of the input voice signal.

[0088] FIG. 6 is a diagram illustrating the operation of a speaker device (20) according to one embodiment of the present invention, and FIG. 7 is a diagram illustrating an overall flowchart of an acoustic signal output method for a hearing-impaired person according to one embodiment of the present invention.

[0089] At this time, as illustrated in FIG. 2, it is assumed that the first device (30 / 40) is located near a person with hearing loss, and the audio / video device (10) transmits an input acoustic signal to the speaker device (20) in real time. Additionally, it is assumed that the input acoustic signal includes an input voice signal and an input non-voice signal.

[0090] Hereinafter, the process performed at each step of Fig. 7 will be explained in detail with reference to Fig. 6.

[0091] In step (S10), the voice extraction module (221) can extract only the input voice signal from the input acoustic signal. Here, the input acoustic signal can be received from the audio / video device (10) through the communication unit (21).

[0092] In step (S20), the volume control module (222) can adjust the volume of the input sound signal based on a preset target volume.

[0093] According to an embodiment, the volume control module (222) can adjust the volume of an input acoustic signal so that the average volume of the input voice signal matches the target volume. At this time, the target volume may correspond to a specific volume included in the volume range of the everyday conversation voice signal, and the volume range of the voice signal may include 65 dBSPL.

[0094] Refer to the description of Figure 3 for details of step (S20).

[0095] In step (S30), the compressor module (223) can extend and amplify the input voice signal within the input acoustic signal, the volume of which is adjusted based on the user's hearing loss information.

[0096] For example, the compressor module (223) can correspond to a dynamic range compressor, and the extension and amplification can correspond to dynamic range compression.

[0097] According to an embodiment, the compressor module (223) can calculate hearing loss information based on audiogram test information. At this time, the audiogram test information can be received from the terminal device (30) through the communication unit (21).

[0098] According to another embodiment, the compressor module (223) can calculate hearing loss information based on selection information of a first hearing aid mode button among a plurality of hearing aid mode buttons provided in the remote control device (40). At this time, the selection information of the first hearing aid mode button can be received from the remote control device (40) through the communication unit (21), and the plurality of hearing aid modes can correspond to each of a plurality of predefined hearing loss types.

[0099] Refer to the description of Figure 3 for details of step (S30).

[0100] In step (S40), the volume correction module (224) can generate an output voice signal by correcting the volume of the extended and amplified input voice signal based on information of the output voice signal or test voice signal information.

[0101] At this time, information on the output sound signal or the test sound signal can be received by a first device (30 / 40) located near the user through a communication unit (21). The first device (30 / 40) may be equipped with a microphone that receives the output sound signal or the test sound signal output from the speaker unit (23), and through this, can generate information on the output sound signal or the test sound signal and transmit it to the communication unit (21).

[0102] Refer to the description of Figure 3 for details of step (S40).

[0103] In step (S50), the speaker unit (23) can output an output acoustic signal containing an output voice signal to a person with hearing loss.

[0104] Here, the output acoustic signal may include an input non-speech signal along with the output speech signal.

[0105] Refer to the description of Figure 3 for details of step (S50).

[0106] In summary, an audio / video output system (1) according to one embodiment of the present invention can provide an acoustic signal including a clear voice signal to a person with hearing loss who does not wear a hearing aid. Accordingly, the fatigue of a person with hearing loss due to wearing a hearing aid can be reduced, and the problem of inter-floor noise generation during acoustic signal output can be resolved.

[0107] Meanwhile, according to another embodiment of the present invention, the speaker device (20) may be embedded in the audio / video device (10).

[0108] Furthermore, embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the present invention, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operation of one embodiment of the present invention, and vice versa.

[0109] As described above, the present invention has been explained by specific details such as specific components, limited embodiments, and drawings; however, this is provided merely to aid in the overall understanding of the invention, and the invention is not limited to the above embodiments. A person skilled in the art to which the invention pertains can make various modifications and variations from this description. Therefore, the scope of the invention should not be limited to the described embodiments, and all things equivalent to or having equivalent variations to the claims set forth below, as well as the claims themselves, shall be considered to fall within the scope of the concept of the invention.

Claims

1. In a speaker device equipped with a hearing assistance function, A processor unit that extracts only the input voice signal from the input acoustic signal, adjusts the volume of the input acoustic signal based on a preset target volume, and extends and amplifies the input voice signal within the volume-adjusted input acoustic signal based on the user's hearing loss information; and A speaker unit that outputs an output acoustic signal including the above-mentioned extended and amplified input voice signal to the user; Speaker device.

2. In Paragraph 1, The above processor unit is, A voice extraction module for extracting the above input voice signal; A volume control module for controlling the volume of the above-mentioned input audio signal; and A compressor module that extends and amplifies an input voice signal within an input audio signal with the above-mentioned volume adjusted; Speaker device.

3. In Paragraph 2, The above volume control module adjusts the volume of the input acoustic signal so that the average volume of the input voice signal matches the target volume, The above target volume corresponds to a specific volume included in the volume range of a voice signal of everyday conversation, and the volume range of the voice signal includes 65 dBSPL, Speaker device.

4. In Paragraph 2, The above processor unit is, A communication module that receives audiogram test information of the user from the user's terminal device; further comprising, The above compressor module calculates the hearing loss information based on the above audiogram information, Speaker device.

5. In Paragraph 2, The above processor unit is, A communication module that receives selection information of a first hearing aid mode button among a plurality of hearing aid mode buttons provided in a remote control device of the speaker device from the remote control device; further comprising The compressor module calculates the hearing loss information based on the selection information of the first hearing assistance mode button, and The above plurality of hearing assistance modes correspond to each of the predefined plurality of hearing loss types, Speaker device.

6. In Paragraph 2, The above processor unit is, A communication module that receives test acoustic signal information input into a microphone of a first device located at a preset representative listening point of the user from the first device; and A volume correction module that generates an output voice signal by correcting the volume of the extended and amplified input voice signal based on the above-mentioned test acoustic signal information; further comprising The above test acoustic signal is output from the speaker unit before the above output acoustic signal is output, Speaker device.

7. In Paragraph 2, The above processor unit is, A communication module that receives information of the output acoustic signal input into the microphone from a first device located near the user and equipped with a microphone; and A volume correction module that generates an output voice signal by correcting the volume of the extended and amplified input voice signal based on the information of the output acoustic signal; further comprising The above speaker unit outputs the output sound signal including the output voice signal to the user. Speaker device.

8. In Paragraph 2, The above processor unit is, A communication module that receives the input sound signal from an audio / video device; further comprising The above audio / video device includes a TV (television), PC (personal computer), laptop, smart device, and immersive audio device. Speaker device.

9. An audio / video device having a hearing assistance function, comprising the speaker device according to claim 1.

10. A method for outputting an acoustic signal for a hearing-loss user performed in a speaker device, A step of extracting only the input voice signal from the input acoustic signal; A step of adjusting the volume of the input sound signal based on a preset target volume; A step of extending and amplifying an input voice signal within an input acoustic signal with a volume adjusted based on the user's hearing loss information; and A step of outputting an output acoustic signal including the above-mentioned extended and amplified input voice signal to the user; Acoustic signal output method for hearing-impaired users.

11. A computer-readable recording medium storing a program for executing the method of paragraph 10 on a computer.

Images