Hearing aid with real-time danger detection for the hearing-impaired people

Abstract

The present invention relates to a hearing aid having a real-time danger detection function for a person with hearing loss. More specifically, the present invention relates to a hearing aid comprising an input unit that receives an audio signal, a frequency analysis unit that extracts frequency components of the input audio signal and analyzes amplitude based on the extracted frequency, and a control unit that detects danger and controls the hearing aid by analyzing the amount of change in amplitude based on the amplitude corresponding to the current time t and the amplitude corresponding to the previous time tn, wherein the frequency analysis unit includes at least one frequency block, and each of the at least one frequency block has a different unique frequency.

Description

Technology Field

[0001] The present invention relates to a hearing aid having a real-time risk detection function for people with hearing loss. Background Technology

[0003] Various types of hearing aids are known in this field that are fitted to the ears of people with hearing loss and function to improve hearing by amplifying the frequency band of hearing loss.

[0004] Generally, hearing aids function to assist hearing by amplifying signals received from the outside through a microphone or via wireless communication according to frequency bands.

[0005] However, conventional hearing aids use directional microphones to improve the hearing experience of the hearing-impaired, so they detect and amplify only sounds from the front corresponding to the conversation partner or the frontal gaze, and block ambient noise. Consequently, there is a problem in that sounds of vehicles, scooters, bicycles, etc., approaching from directions other than the front are blocked, making it difficult to react immediately to and take action against danger. The problem to be solved

[0007] The problem that the present invention aims to solve is to provide a hearing aid for a hearing-impaired person having a real-time danger detection function that can analyze ambient sounds entering from sources other than the front in real time and warn of danger.

[0008] Another problem that the present invention aims to solve is to provide a hearing aid for the hearing impaired that has a real-time danger detection function capable of analyzing frequencies outside the audible range and warning of danger.

[0009] The technical problems to be solved by the present invention are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which the present invention belongs from the description below. means of solving the problem

[0011] According to one aspect of the present invention for solving the above or other problems, the present invention may provide a hearing aid having a real-time risk detection function for a hearing-impaired person, comprising: an input unit that receives an audio signal; a frequency analysis unit that extracts frequency components of the input audio signal and analyzes the amplitude based on the extracted frequency; and a control unit that detects a risk by analyzing the amount of change in the amplitude based on the amplitude corresponding to the current time t and the amplitude corresponding to the previous time tn, wherein the frequency analysis unit includes at least one frequency block, and each of the at least one frequency block has a different unique frequency.

[0012] Here, the frequency analysis unit can analyze the amplitude of a frequency corresponding to a natural frequency by performing a convolution operation between the input audio signal and the Green function of a damped harmonic oscillator.

[0013] Here, the control unit can generate a control command that determines it to be dangerous and outputs a warning when the accumulated value of the change in amplitude exceeds a set value.

[0014] Here, the control unit can control the hearing aid differently when the user is indoors and outdoors.

[0015] Here, the at least one frequency block can be mapped to at least one group having natural frequencies belonging to the audible frequency range and at least one group having natural frequencies outside the audible frequency range. Effects of the invention

[0017] The present invention has the effect of being able to warn of danger by analyzing ambient sounds entering from sources other than the front in real time.

[0018] In addition, the present invention has the effect of being able to analyze frequencies outside the audible range and warn of danger.

[0019] The effects of the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the description below. Brief explanation of the drawing

[0021] FIG. 1 is a configuration diagram of a hearing aid having a real-time risk detection function for a hearing-impaired person according to an embodiment of the present invention. FIG. 2 is a diagram illustrating the operation of a frequency analysis unit according to an embodiment of the present invention. FIG. 3 is a configuration diagram of each frequency block (103-1 to 103-n) according to an embodiment of the present invention. FIG. 4 is a diagram illustrating the operation of a control unit according to an embodiment of the present invention. FIG. 5 is a diagram illustrating the operation of the control unit when a user is indoors and outdoors according to an embodiment of the present invention. Specific details for implementing the invention

[0022] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Identical or similar components regardless of drawing symbols will be assigned the same reference number, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not inherently possess distinct meanings or roles. Furthermore, in describing embodiments disclosed in this specification, if it is determined that a detailed description of related prior art could obscure the essence of the embodiments disclosed in this specification, such detailed description will be omitted. Additionally, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification; the technical concept disclosed in this specification is not limited by the attached drawings, and it should be understood that they include all modifications, equivalents, and substitutions that fall within the spirit and technical scope of the present invention.

[0023] Terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. These terms are used solely for the purpose of distinguishing one component from another.

[0024] When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.

[0025] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0026] In this application, terms such as “comprising” or “having” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0027] FIG. 1 is a configuration diagram of a hearing aid having a real-time risk detection function for a hearing-impaired person according to an embodiment of the present invention.

[0028] Referring to FIG. 1, a hearing aid (100) having a real-time danger detection function for a person with hearing loss includes an input unit (101), a buffer unit (102), a frequency analysis unit (103), and a control unit (104). The components shown in FIG. 1 are not essential for implementing the hearing aid (100) having a real-time danger detection function for a person with hearing loss, so the hearing aid (100) having a real-time danger detection function for a person with hearing loss described herein may have more or fewer components than the components listed above.

[0029] The input unit (101) receives an analog audio signal and converts it into a digital audio signal. The converted audio signal passes through the buffer unit (102) and is transmitted to the frequency analysis unit (103).

[0030] The buffer unit (102) is a storage space for temporarily storing a digital audio signal received from the input unit (101), and temporarily stores the audio signal in sample units for frequency analysis.

[0031] Specifically, when an audio signal is input, the buffer unit (102) divides the input audio signal into multiple parts by a predetermined unit time T[ms] (hereinafter referred to as the sample period), stores them in correspondence with a sample index, and updates them at a predetermined update period.

[0032] The frequency analysis unit (103) extracts the frequency components of the input audio signal and analyzes the amplitude based on the extracted frequencies.

[0033] Hereinafter, with reference to FIG. 2, the specific operation of the frequency analysis unit (103) will be explained.

[0034] FIG. 2 is a diagram illustrating the operation of a frequency analysis unit according to an embodiment of the present invention.

[0035] The frequency analysis unit (103) may include at least one frequency block (103-1 to 103-n) capable of analyzing the amplitude, that is, the strength of the amplitude, for each frequency component constituting the input audio signal. The frequency analysis unit (103) according to an embodiment of the present invention may analyze the absolute strength of the amplitude, but may also analyze the relative strength of the amplitude. That is, the strength of the amplitude for each frequency component may be normalized with respect to the entire frequency band and become a relative amplitude.

[0036] A frequency block (103-1 to 103-n) according to one embodiment of the present invention may be provided in software or hardware.

[0037] Each frequency block (103-1 to 103-n) is designed with a different natural frequency. A natural frequency refers to the frequency to be extracted from the input audio signal. For example, 1,000 H z The frequency block from which to extract is 1,000 H z is designed with a natural frequency. In one embodiment of the present invention, the frequency block is designed so that resonance occurs at the natural frequency in order to extract a specific natural frequency. In the preceding example, 1,000 H z The frequency block from which to extract is 1,000 H z It may be a damped oscillator model designed to cause resonance to occur.

[0038] These frequency blocks (103-1 to 103-n) are configurations that model each hair cell present in the human cochlea.

[0039] Each frequency block (103-1 to 103-n) analyzes the amplitude of a set natural frequency component among the frequency components present in the input audio signal and outputs the analyzed result. For example, the first frequency block (103-1) outputs A1, which is an amplitude value (absolute amplitude value) or amplitude level (amplitude level, relative amplitude value) corresponding to the first natural frequency in the input audio signal.

[0040] The frequency analysis resolution in the present invention is not limited to the examples used in the present invention and can be controlled according to the sampling rate, the interval and number of frequency blocks (103-1 to 103-n), the frequency level and the amplitude level represented by each frequency level, the number of frequency bands, and the frequency range represented by each frequency band.

[0041] A frequency band is defined as the entire frequency range used for analysis divided into specific frequency units. For example, the entire frequency range to be analyzed for an input audio signal is 0 to 8,000 H z Assuming that, 10 H z When divided into frequency units, there can be a total of 800 frequency bands.

[0042] A plurality of frequency blocks (103-1 to 103-n) according to one embodiment of the present invention may be set for each frequency band. And each frequency block may be set to a frequency belonging to the corresponding frequency band as its unique frequency.

[0043] Frequency blocks (103-1 to 103-n) are proposed to generate a Green function of a circuit modeled to vibrate a damped harmonic oscillator at its natural frequency, and to perform a convolution operation between the generated Green function and multiple audio samples to analyze the amplitude corresponding to the natural frequency among the frequencies included in the audio signal.

[0044] In the case of a damped harmonic oscillator, when the external force matches the natural frequency of the damped harmonic oscillator, the total energy of the damped oscillator becomes maximum due to the resonance phenomenon.

[0045] Damped harmonic oscillator The natural frequency of ω i It is called a damped harmonic oscillator S. i ω among the hair cells that constitute the hearing system i It is used to model the sound response of hair cells that are most sensitive to frequency sounds.

[0046] sound When input, damped harmonic oscillator S i Response to the sound It can be described by the second-order differential equation of the following mathematical equation 1.

[0047]

[0048] In mathematical formula 1, ζ represents the damping coefficient, and m represents the mass of the oscillator (weight) suspended from the damped harmonic oscillator.

[0049] In this invention, to find the solution to the second-order differential equation of Equation 1, it is proposed to use the Green's function (impulse response) of a damped harmonic oscillator.

[0050] Green's function is utilized as an important tool in mathematics and physics to find solutions to partial differential equations under given boundary conditions. Green's function is the Dirac delta function of external forces. When , it represents the solution to the differential equation. Rewriting Equation 1 using the Green function yields Equation 2 below.

[0051]

[0052] When performing a convolution operation between the Green's function of a damped harmonic oscillator and the input audio signal, the position of the damped harmonic oscillator due to the input audio signal You can find it. And the location When calculating, differentiate it to obtain the velocity You will be able to understand about it.

[0053] Also location Through this, the mechanical energy of the damped harmonic oscillator can be calculated, and the position and speed It can also be broken down into sine and cosine components.

[0054] And if a component corresponding to the natural frequency of a damped harmonic oscillator exists in the input, it will have maximum mechanical energy due to resonance; therefore, by observing this, it is possible to extract the amount of that frequency component in the input.

[0055] In order to convolve the impulse response and the audio signal, each frequency block (103-1 to 103-n) according to an embodiment of the present invention may be composed of a Green function generator and a convolution operator block for each natural frequency. The Green function generator outputs a Green function through vibration coefficients and damping coefficients corresponding to each natural frequency. By passing the output Green function and a plurality of audio samples through the convolution operator, the position You can find it. And the location Based on this, it is possible to extract only the amplitude corresponding to the natural frequency from the input audio signal. This is because the damped harmonic oscillator model, which is modeled to resonate at the natural frequency, has the largest amplitude value at the natural frequency where resonance occurs.

[0056] This structure will be explained in more detail below with reference to Fig. 3.

[0057] FIG. 3 is a configuration diagram of each frequency block (103-1 to 103-n) according to an embodiment of the present invention.

[0058] Each frequency block (103-1 to 103-n) has a different natural frequency, and the output of each frequency block (103-1 to 103-n) may be the amplitude of the frequency corresponding to the natural frequency among the composite frequencies of the input audio signal. That is, when an audio signal is received, each frequency block (103-1 to 103-n) outputs the amplitude of the frequency corresponding to its own natural frequency among the composite frequencies included in the audio signal. At this time, the input audio signal may be a sequential input of multiple audio samples that have passed through the buffer unit (102) described above.

[0059] A frequency block (103-1 to 103-n) according to one embodiment of the present invention is configured to include a Green function generator (301), a convolution operator (302), and an amplitude calculator (303). Since the components shown in FIG. 3 are not essential for implementing the frequency block (103-1 to 103-n), the frequency block (103-1 to 103-n) described herein may have more or fewer components than those listed above.

[0060] The Green function generator (301) generates a Green function corresponding to a specific natural frequency and provides it to the convolution operator (302). If the illustrated frequency blocks (103-1 to 103-n) have only a single natural frequency, the Green function generator (301) will output only the Green function corresponding to that single natural frequency.

[0061] If the illustrated frequency blocks (103-1 to 103-n) can cover multiple natural frequencies, the Green function generator (301) will be able to sequentially output multiple Green functions corresponding to multiple natural frequencies.

[0062] The convolution operator (302) performs a convolution operation on the input audio signal and the Green function generated from the Green function generator (301).

[0063] The amplitude calculator (303) calculates the amplitude using the result of the convolution operation. When an audio signal and a Green function are convolved, only the frequency corresponding to the natural frequency of the Green function among the complex frequencies included in the audio signal resonates, so the result of the convolution operation 'mainly' retains the natural frequency component. And, among the complex frequencies included in the audio signal, frequencies other than the natural frequency do not resonate, so the magnitude of the result of the convolution operation is inevitably relatively small.

[0064] Therefore, when calculating the amplitude of the output of the convolutional calculator (302) itself, it can be estimated as the amplitude of the natural frequency component of the audio signal.

[0065] That is, according to the configuration described above, when the Green function generator (301) generates and outputs a Green function corresponding to a predetermined natural frequency, the amplitude of the frequency corresponding to the predetermined natural frequency among the composite frequencies included in the input audio signal is analyzed through the convolution calculator (302) and the amplitude calculator (303).

[0066] Returning to FIG. 2, the frequency blocks (103-1 to 103-n) according to an embodiment of the present invention can be mapped to at least one group (201) having a unique frequency belonging to the audible frequency range and at least one group (202) having a unique frequency outside the audible frequency range. That is, the frequency blocks (103-1 to 103-n) according to an embodiment of the present invention analyze input audio sounds by dividing them into mapped frequency groups, thereby enabling the recognition of speech with the amplitude of at least one group (201) having a unique frequency belonging to the audible frequency range, and enabling the recognition of sounds that a person with hearing loss cannot easily detect with the amplitude of at least one group (202) having a unique frequency outside the audible frequency range.

[0067] In addition, at least one group (201) having a natural frequency belonging to an audible frequency according to one embodiment of the present invention may be divided into at least one other frequency unit and set in frequency blocks (103-1 to 103-n). For example, the range from 1 to 500 Hz may be divided into 1 Hz intervals, the range from 500 to 1000 Hz into 2 Hz intervals, the range from 1000 to 4000 Hz into 4 Hz intervals, and the range from 4000 to 8000 Hz into 8 Hz intervals; that is, the lower the frequency, the narrower the frequency unit may be divided.

[0068] In addition, at least one group (202) having a unique frequency outside the audible frequency range according to one embodiment of the present invention may also be divided into at least one other frequency unit and set in the frequency blocks (103-1 to 103-n). For example, for 8000 to 12000 Hz, it may be divided into 4 Hz intervals, and for 12000 to 22000 Hz, it may be divided into 10 Hz intervals, that is, the higher the frequency, the wider the frequency unit may be.

[0069] Here, although FIG. 2 describes mapping by dividing into at least one group (201) having a natural frequency belonging to the audible frequency range and at least one group (202) having a natural frequency outside the audible frequency range, the user can set at least one mapping corresponding to the target frequency, and although FIG. 2 describes the frequency analysis unit (103) analyzing vibrations for all frequency blocks (103-1 to 130-n), the frequency analysis unit (103) can analyze vibrations only for the frequency blocks included in the mapping set by the user.

[0070] The control unit (104) detects danger and controls the hearing aid by analyzing the amount of change in amplitude based on the amplitude corresponding to the current time t and the amplitude corresponding to the previous time tn analyzed by the frequency analysis unit (103) for the input audio signal.

[0071] Hereinafter, the specific operation of the control unit (104) will be explained with reference to FIG. 4.

[0072] FIG. 4 is a diagram illustrating the operation of a control unit according to an embodiment of the present invention.

[0073] The control unit (104) analyzes the amount of change in amplitude (403) based on the amplitude (401) corresponding to the current time t and the amplitude (402) corresponding to the previous time t-1 for the input audio signal analyzed by the frequency analysis unit (103), and based on this, if the cumulative value (404) of the change in amplitude corresponding to the previous time tn and the current time t exceeds a set value (407) set by the user, it can generate a control command to determine it as a danger and output a warning.

[0074] For example, the control unit (104) determines that the distance between object A (405) and the user is getting closer as the accumulated value (404) of the change in amplitude corresponding to the frequency of object A (405) increases, and if the accumulated value (404) of the change in amplitude exceeds the set value (407) set by the user, there is a risk of collision between object A and the user, so it can generate a control command to output a warning and notify the user of the danger through the hearing aid.

[0075] Additionally, the control unit (104) determines that the distance between object B (406) and the user increases as the accumulated value (404) of the change in amplitude corresponding to the frequency of object B (406) decreases.

[0076] The control unit (104) can amplify audio signals corresponding to at least one group (201) having a unique frequency belonging to the audible frequency range, and not amplify audio signals corresponding to at least one group (202) having a unique frequency outside the audible frequency range, thereby preventing confusion in speech.

[0077] The control unit (104) can control the hearing aid differently when the user is indoors and outdoors.

[0078] The specific operation will be explained below with reference to FIG. 5.

[0079] FIG. 5 is a diagram illustrating the operation of a control unit when a user is indoors and outdoors according to an embodiment of the present invention. FIG. 5(a) shows when the user is indoors, and FIG. 5(b) shows when the user is outdoors.

[0080] A control unit (104) according to one embodiment of the present invention controls both the left hearing aid (501) and the right hearing aid (502) to operate only the frequency blocks (103-1 to 103-n) corresponding to at least one group (201) having a unique frequency belonging to the audible frequency among the frequency blocks (103-1 to 103-n) when the user is indoors, so as to analyze only the audible frequency of the input audio signal, and controls the amplification based on the analyzed result value to output to the user.

[0081] When the user is outdoors, the control unit (104) can control the left hearing aid (501) to operate only the frequency blocks (103-1 to 103-n) corresponding to at least one group (201) that has a unique frequency belonging to the audible frequency among the frequency blocks (103-1 to 103-n), analyze only the audible frequency of the input audio signal, amplify based on the analyzed result, and transmit the analyzed result to the right hearing aid (502) so that both sides output audio signals corresponding to the audible frequency to the user.

[0082] Additionally, the control unit (104) can control the right hearing aid (502) to operate only the frequency blocks (103-1 to 103-n) corresponding to at least one group (202) that has a unique frequency outside the audible frequency range among the frequency blocks (103-1 to 103-n), thereby analyzing only the frequencies outside the audible frequency range of the input audio signal, and detect danger by analyzing the amount of change in amplitude based on the analyzed result, and if it is determined to be a danger, transmit an alarm situation to the left hearing aid (501) so that both sides can be controlled to output a warning to the user.

[0083] Although embodiments of a high-resolution frequency component extraction device and a control method thereof according to the present invention have been described above, they are described as at least one embodiment, and the technical concept, configuration, and operation of the present invention are not limited thereby. Furthermore, the scope of the technical concept of the present invention is not limited or restricted by the drawings or the description with reference to the drawings. In addition, the concept and embodiments of the invention presented in this invention may be used by those skilled in the art as a basis for modifying or designing other structures to perform the same purpose of the present invention. An equivalent structure modified or changed by those skilled in the art is bound by the technical scope of the present invention as described in the claims, and various changes, substitutions, and modifications are possible within the limits of not departing from the concept or scope of the invention as described in the claims. Explanation of the symbols

[0085] 101 : Input section 102 : Buffer section 103: Frequency analysis unit 104: Control unit

Claims

Claim 1 A hearing aid having a real-time danger detection function for a hearing-impaired person, comprising: an input unit that receives an audio signal; a frequency analysis unit that extracts frequency components of the input audio signal and analyzes the amplitude based on the extracted frequency; and a control unit that detects danger and controls the hearing aid by analyzing the amount of change in the amplitude based on the amplitude corresponding to the current time t and the amplitude corresponding to the previous time tn, wherein the frequency analysis unit includes at least one frequency block, and each of the at least one frequency block has a different unique frequency; and the control unit, when the user is outdoors, controls the left hearing aid to operate only the frequency block corresponding to at least one group having a unique frequency belonging to the audible frequency to analyze the audible frequency, and controls the right hearing aid to operate only the frequency block corresponding to at least one group having a unique frequency outside the audible frequency to analyze the amount of change in the amplitude, and if it is determined to be dangerous, transmits an alarm to the left hearing aid to output a warning to both sides. Claim 2 In claim 1, the frequency analysis unit analyzes the amplitude of a frequency corresponding to a natural frequency by convolutional operation of the input audio signal and the Green function of a damped harmonic oscillator, a hearing aid having a real-time risk detection function for a hearing-impaired person. Claim 3 In claim 1, the control unit has a real-time risk detection function for a hearing-impaired person, wherein if the accumulated value of the change in amplitude exceeds a set value, the control unit determines it to be dangerous and generates a control command to output a warning. Claim 4 A hearing aid for a hearing-impaired person having a real-time risk detection function, wherein the control unit amplifies at least one audio signal having a unique frequency belonging to the audible frequency range and does not amplify at least one audio signal having a unique frequency outside the audible frequency range. Claim 5 A hearing aid having a real-time risk detection function for a hearing-impaired person, wherein the at least one frequency block is mapped to at least one group having a unique frequency belonging to the audible frequency and at least one group having a unique frequency outside the audible frequency.

Images