Method and apparatus for automatically setting microphone directivity based on estimation of the position of a user or object using a hearing aid

Abstract

Provided are a method and an apparatus for automatically setting a microphone directivity based on the estimation of the position of a user or an object using a hearing aid. 【Solution means】In one embodiment, a method for automatically setting a microphone directivity based on the estimation of the position of a user or an object using a hearing aid includes estimating the direction or position of the user by a sensor unit of the hearing aid worn by the user, or estimating the direction or position of an object conversing with the user, and automatically changing beamforming for the microphone directivity according to the position of the user or the object.

Description

Technical Field

[0001] The following embodiments relate to a method and apparatus for automatically setting microphone directivity by estimating the position of a user or an object using a hearing aid. More specifically, the present invention relates to a method and apparatus for automatically setting microphone directivity according to the position or number of a user or an object using a hearing aid, which automatically sets microphone directivity according to the position of a user or an object.

Background Art

[0002] Due to the remarkable development of medical engineering technology in recent years, patients who could not feel a high effect even when wearing a hearing aid can now feel excellent hearing improvement by selecting and wearing an appropriate hearing aid. A hearing aid, which is always worn on the body, is one of the most advanced medical devices, requires continuous maintenance according to changes in hearing, and must receive after-sales service if it is damaged by moisture or foreign substances in the ear. Conventional hearing aids were in the form of a horn-shaped sound collector, but in recent years, electric hearing aids that support amplification of normal sounds have been used. In addition, there are bone conduction types that are worn on the mastoid process, but most are air conduction types, which receive sound waves with a microphone, convert them into electrical vibrations, amplify them, and then convert them back into sound waves with earphones so that they can be heard by the ear.

[0003] The "directivity" of the microphone of a hearing aid enables the user of the hearing aid to hear sounds more clearly. Generally, a hearing aid uses two microphones with omnidirectional characteristics to calculate a microphone directivity signal. In such a case, the directivity once set cannot actively respond according to the situation. Furthermore, when changing or modifying the directivity setting, a cumbersome procedure must be followed.

[0004] FIG. 1 is a diagram for explaining the directivity setting of a general hearing aid. As shown in FIG. 1, a general hearing aid measures the direction from which sound is heard with the user at the center, and the user has to change their orientation in the direction from which the sound is heard. That is, the directivity index is fixed according to the direction of the user wearing the hearing aid.

[0005] FIG. 2 is a diagram for explaining the directivity change of a general hearing aid. As shown in FIG. 2(a), in the case of a general hearing aid, the directivity of the microphone is changed in the direction from which the sound source (e.g., a voice) is heard. However, in reality, the direction of the sound source continues to change, and it is extremely troublesome to change the directivity each time. In order to change the directivity of the microphone of the hearing aid, the hearing aid has to be connected to a terminal or the like before the change can be implemented. For example, the hearing aid has to be connected to a PC to change the directivity of the hearing aid, or the hearing aid has to be connected to a smartphone to change the directivity of the hearing aid. Alternatively, it is also possible to connect a remote control to the hearing aid to change the directivity of the hearing aid. As shown in FIG. 2(b), it is also possible to provide an omnidirectional state by rotating the axis of beamforming.

[0006] Korean Registered Patent No. 10-2004460 relates to a digital hearing device using such a Bluetooth (registered trademark) circuit and digital signal processing, and describes a technology for a digital hearing device that can utilize the limited resources of the Bluetooth (registered trademark) module to provide the most suitable hearing function for the user's hearing profile and the hearing aid wearing environment.

Prior Art Documents

Patent Documents

[0007]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0008] Embodiments relate to a method and apparatus for automatically setting microphone directivity by estimating the position of a user or an object using a hearing aid. More specifically, according to the position or number of the user or the object, the microphone directivity (beamforming) suitable for the situation and environment is automatically set to provide a technology for improving the performance of the hearing aid.

[0009] Embodiments provide a method and apparatus for automatically setting microphone directivity by estimating the position of a user or an object using a hearing aid, which automatically changes beamforming for microphone directivity according to the direction or position of the user or the object by estimating the direction or position of the user or estimating the direction or position of an object that converses with the user at a sensor unit of the hearing aid, thereby improving the performance of the hearing aid while making it easier for the user to hear.

Means for Solving the Problem

[0010] A method for automatically setting microphone directivity by estimating the position of a user or an object using a hearing aid in one embodiment may include estimating the direction or position of the user or estimating the direction or position of an object that converses with the user at a sensor unit of the hearing aid worn by the user, and automatically changing beamforming for microphone directivity according to the position of the user or the object. The method may further include sensing and mapping the position of the user or the object according to the estimated direction or position, and automatically changing beamforming for microphone directivity according to the mapped position of the user or the object.

[0011] The sensor unit may be at least one or more of an acceleration sensor, a proximity sensor, a lidar sensor, a heat sensing sensor, a motion sensor, an infrared emitter, and an optical sensor.

[0012] The step of estimating the direction or position may set a beamforming setting value to match the position and direction of the user by recognizing the direction of the user's movement at the sensor unit of the hearing aid. The step of estimating the direction or position may set the beamforming setting value to match the direction or position of the object by estimating the direction or position of the object at the sensor unit of the hearing aid when the distance between the user and the object is within a predetermined distance.

[0013] The step of estimating the direction or position may set the beamforming setting value to match the direction or position where the sound is generated by recognizing the direction or position where the sound is generated. The step of estimating the direction or position is to grasp the number of objects within a predetermined distance from the user, estimate the direction or position of each object, and the step of automatically changing the beamforming according to the number of objects may change to a multi-beamforming setting according to the number of objects. The step of estimating the direction or position may recognize the object by the infrared rays emitted using an infrared emitter, recognize the object by the light reflected using a light sensor, and then recognize that the object exists in the overlapping part of the part recognized by the infrared emitter and the part recognized by the light sensor.

[0014] The apparatus for automatically setting the microphone directivity by estimating the position of the user or the object using a hearing aid in other embodiments is configured in the hearing aid worn by the user, and includes a sensor unit for estimating the direction or position of the user or the direction or position of the object that converses with the user, and a beamforming setting unit for automatically changing the beamforming for the microphone directivity according to the position of the user or the object.

[0015] It may further include a position mapping unit that senses the user or the object according to the estimated direction or position and maps the position, and automatically changes the beamforming for the microphone directivity according to the mapped position of the user or the object.

[0016] The sensor unit may be at least one or more of an acceleration sensor, a proximity sensor, a lidar sensor, a heat sensing sensor, a motion sensor, an infrared emitter, and a light sensor. The sensor unit may recognize the direction of the user's movement, and the beamforming setting unit may set beamforming setting values according to the position and direction of the user. When the distance between the sensor unit and the object is within a predetermined distance, the beamforming setting unit may set beamforming setting values according to the direction or position of the object by estimating the direction or position of the object.

[0017] The sensor unit may recognize the direction or position where the sound is generated, and the beamforming setting unit may set beamforming setting values according to the direction or position where the sound is generated. The sensor unit may grasp the number of objects within a predetermined distance from the user, estimate the direction or position of each object, and the beamforming setting unit may change to multi-beamforming setting according to the number of objects. The sensor unit may recognize an object by infrared rays emitted using an infrared emitter and recognize the object by light reflected using a photosensor, and then recognize that the object exists in a portion where the portion recognized by the infrared emitter and the portion recognized by the photosensor overlap.

Effect of the Invention

[0018] According to the embodiment, in the sensor unit of the hearing aid, by estimating the direction or position of the user or the direction or position of the object that converses with the user, the beamforming for the microphone directivity is automatically changed according to the direction or position of the user or the object, and a method and apparatus for automatically setting the microphone directivity by estimating the position of the user or the object using the hearing aid, which improve the performance of the hearing aid while making the user's hearing better, can be provided.

Brief Description of the Drawings

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Embodiments for Carrying Out the Invention

[0020] Hereinafter, embodiments will be described with reference to the accompanying drawings. Since the described embodiments can be modified into various other forms, the scope of the present invention should not be limited by the embodiments described below. Also, various embodiments are provided to more fully explain the present invention to those with ordinary knowledge in the art. In the drawings, the shapes and sizes of elements may be exaggerated for clearer explanation.

[0021] Conventional hearing aids cannot actively convert the directivity of a microphone once set according to the situation. Furthermore, even if a conventional hearing aid could convert the directivity of the microphone, system changes would have to be implemented every time it is corrected, which is difficult for the user to handle directly. On the other hand, in the embodiment, by attaching a sensor to the hearing aid, the position of the user or the position of the object (e.g., the other party) with whom the user is conversing is grasped, and the set value is automatically converted according to the grasped position of the user or the position of the object with whom the user is conversing, so that the user's hearing can be improved according to various situations.

[0022] The following embodiments relate to a method and apparatus for automatically setting the microphone directivity by estimating the position of a user or an object using a hearing aid. By automatically setting the microphone directivity (beamforming) suitable for each situation and environment according to the position of the user, or the position and number of objects, the audibility of sound can be improved more efficiently than the performance of conventional hearing aids. The embodiments can additionally consider not only the estimation of the position of the object, but also the user's hearing state, ambient noise, mode set by the user, and the like.

[0023] In one embodiment, an apparatus for automatically setting microphone directivity based on the estimation of the position of a user or an object using a hearing aid is a hearing aid that supports sound perception for a hearing-impaired person suffering from hearing loss and can amplify sound in a desired direction. Further, in one embodiment, an apparatus for automatically setting microphone directivity based on the estimation of the position of a user or an object using a hearing aid compensates for hearing, converts sound energy into a digital signal by electrical amplification and amplifies it, and converts the amplified energy back into sound energy in a desired direction, thereby assisting the hearing of a hearing-impaired person.

[0024] Thereby, in one embodiment, an apparatus for automatically setting microphone directivity based on the estimation of the position of a user or an object using a hearing aid can analyze sound according to the movement of the user or the position of an object to be spoken to by an algorithm and automatically provide an optimal set value suitable for each situation.

[0025] FIG. 3 is a diagram showing an example of a hearing aid in one embodiment. As shown in FIG. 3, a hearing aid 100 according to one embodiment may be configured to be worn on a user's ear and may include a microphone, a speaker, and a sensor unit 110. Further, the hearing aid 100 according to the embodiment may further include a wireless communication unit, a control unit, and a power supply unit. The main body of the hearing aid 100 is attached or worn on the user's ear and may include a wireless communication unit, a control unit, a power supply unit, etc. inside.

[0026] At least one or more microphones are configured on the main body, and sounds such as voices may be input. The microphone may process an external acoustic signal as electrical voice data. At this time, the microphone may be arranged at a distance of a predetermined distance or more from the speaker, and may be configured to reduce the constraint of howling and facilitate amplification. For example, two microphones may be configured, and depending on the embodiment, it is also possible to be configured with one or three or more. The speaker is configured on the main body and may amplify the sound received from the microphone and transmit it to the user.

[0027] The sensor unit 110 may be configured in the main body to estimate the position or direction of the user wearing the hearing aid 100 or to estimate the position or direction of an object with which the user is conversing and automatically set the microphone directivity. At this time, the setting of the microphone directivity may be executed by the control unit. For example, the sensor unit 110 may be composed of a proximity sensor or a lidar sensor. By the proximity sensor or the lidar sensor grasping the position of the person with whom the user is conversing, the control unit may change the set value of the microphone. Here, the sensor unit 110 may include not only a proximity sensor or a lidar sensor but also various sensors such as a thermal sensor and a motion sensor capable of estimating the direction or position of the user or the direction or position of the object.

[0028] The hearing aid 100 according to the embodiment may further include a wireless communication unit, a control unit, and a power supply unit. The wireless communication unit is configured to be built into the main body and connect to a user terminal by wireless communication. That is, the wireless communication unit may be configured to transmit and receive wireless signals to and from a user terminal via a communication network using wireless Internet technology.

[0029] Examples of wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (registered trademark) (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc. The wireless communication unit may transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

[0030] On the other hand, the wireless communication unit can also perform short-range communication. As short-range communication technologies, at least one of Bluetooth (registered trademark), RFID (Radio Frequency Identification), infrared communication (Infrared Data Association: IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, Wireless USB (Wireless Universal Serial Bus) technology may be used. However, it is not limited to this, and the wireless communication unit may receive data from the mobile terminal according to short-range communication technologies not listed above. In this way, by connecting to the user terminal through short-range communication, the wireless communication unit can configure or change the settings of the hearing aid 100 while using the user terminal.

[0031] The control unit may be configured to be built into the main body and may be realized to control the overall operation of the components. The control unit may amplify the sound received from a plurality of microphones and transmit it to the user. In particular, the control unit may automatically set the microphone directivity by estimating the direction or position of the user or the direction or position of the object. Further, the control unit may be connected to the user terminal via the wireless communication unit and change the settings of the hearing aid 100 such as the amplification rate of the input sound. For example, after the user installs an application on the user terminal and runs the application to set the amplification rate of the microphone, the control unit may receive such a control signal and set the amplification rate of the microphone.

[0032] When an external power source or an internal power source is applied according to the control of the control unit, the power supply unit supplies the power required for the operation of each component. The power supply unit may include a battery, and the battery may be a built-in battery configured to be rechargeable. However, it should not be limited to this.

[0033] FIG. 4 is a diagram for explaining a method of automatically setting the microphone directivity by estimating the position of the user using the hearing aid in one embodiment. Referring to FIG. 4, the microphone directivity may be automatically set according to the position of the user 210 wearing the hearing aid 100 by using the sensor unit 110 configured in the hearing aid 100. This may be executed by an apparatus for automatically setting the microphone directivity by estimating the position of the user 210 using the hearing aid 100 in one embodiment. The apparatus for automatically setting the microphone directivity by estimating the position of the user 210 using the hearing aid 100 in one embodiment may be referred to as an apparatus for automatically setting the microphone directivity.

[0034] For example, in a device that automatically sets the microphone directivity, the acceleration sensor of the hearing aid 100 may change the microphone directivity (beamforming) according to the direction of movement of the user 210 wearing the hearing aid 100, and set a set value so as to match the position and angle of the user 210. Thereafter, when the user 210 rotates horizontally, the device that automatically sets the microphone directivity may have the sensor unit 110 recognize this and automatically convert the microphone directivity (beamforming) only in the moved direction. At this time, the user 210 may rotate the whole body or only the direction of the face.

[0035] Here, if the microphone value is set based on 0 degrees in the device that automatically sets the microphone directivity, the directivity with respect to the moved angle is analyzed by an algorithm, and the most suitable value for the user's environment can be applied by automatically converting the corresponding value.

[0036] FIG. 5 is a diagram for explaining a method of automatically setting the microphone directivity by estimating the position of an object using a hearing aid in one embodiment. Referring to FIG. 5, in one embodiment, the microphone directivity is automatically set by estimating the position of the object 220 using a hearing aid, and the position of a person who is talking to the user 210 is grasped by a proximity sensor or a lidar sensor, and the set value of the microphone may be changed. For example, in a device that automatically sets the microphone directivity, when the IR and the proximity sensor or the lidar sensor detect that the object 220 approaches the user 210, the beamforming value is set to match the direction, so that the most suitable efficiency in the direction can be applied.

[0037] At this time, the device that automatically sets the microphone directivity may recognize the number of people around the user 210 by a sensor mounted on the hearing aid. That is, the sensor of the hearing aid recognizes whether the object 220 is one person or a plurality of people. The device for automatically setting the microphone directivity can automatically convert the microphone directivity (beamforming) according to the direction of the object 220 in conversation by applying a system algorithm to suit the recognized environment.

[0038] FIG. 6 is a diagram for explaining a method of grasping the sound of an object using a hearing aid and automatically setting the microphone directivity according to the direction of the sound in one embodiment. Referring to FIG. 6, the sound of the object 220 speaking in the basic direction may be grasped by an algorithm, and the setting value most suitable for the direction of the sound may be automatically changed. For example, the device for automatically setting the microphone directivity may distinguish sounds coming from multiple directions by applying a circular form to three or more microphones.

[0039] Thereafter, the device for automatically setting the microphone directivity can recognize the direction and number of sounds by deep learning, and apply the optimal setting value by setting the microphone directivity (beamforming) accordingly. In addition, the device for automatically setting the microphone directivity can analyze the sounds for things and humans by an algorithm, and automatically change the microphone directivity (beamforming) to suit the user 210 environment.

[0040] FIG. 7 is a flowchart showing an algorithm for automatically setting the microphone directivity by estimating the position of a user or an object using a hearing aid in one embodiment. Referring to FIG. 7, the algorithm for automatically setting the microphone directivity by estimating the position of the user 210 or the object 220 using a hearing aid in one embodiment may be executed by a device for automatically setting the microphone directivity by estimating the position of the user 210 or the object 220 using a hearing aid in one embodiment.

[0041] A sensor or a camera module may be mounted (S710), and may sense and map (S720) the object 220. At this time, the position or direction of the object 220 may be sensed and mapped. Accordingly, the beamforming setting value may be automatically changed (S740) according to the position or direction mapped with the basic beamforming value (S730), and the beamforming setting change may be terminated (S750).

[0042] FIG. 8 is a flowchart showing a method for automatically setting the microphone directivity by estimating the position of a user or an object using a hearing aid in one embodiment. Referring to FIG. 8, a method for automatically setting the microphone directivity by estimating the position of a user or an object using a hearing aid in one embodiment may include a step (S810) of estimating the direction or position of the user or the direction or position of an object that converses with the user by a sensor unit of a hearing aid worn by the user, and a step (S830) of automatically changing beamforming for the microphone directivity according to the position of the user or the object.

[0043] Furthermore, it may further include a step (S820) of sensing and mapping the position of the user or the object according to the estimated direction or position, and automatically changing the beamforming for the microphone directivity according to the mapped position of the user or the object.

[0044] Hereinafter, a method for automatically setting the microphone directivity by estimating the position of a user or an object using a hearing aid in one embodiment will be described in more detail. A method for automatically setting the microphone directivity by estimating the position of a user or an object using a hearing aid in one embodiment will be described by taking as an example an apparatus for automatically setting the microphone directivity by estimating the position of a user or an object using a hearing aid in one embodiment.

[0045] FIG. 9 is a block diagram showing an apparatus for automatically setting the microphone directivity by estimating the position of a user or an object using a hearing aid in one embodiment. Referring to FIG. 9, an apparatus 900 for automatically setting microphone directivity based on the estimated position of a user or an object using a hearing aid in one embodiment may include a sensor unit 910 and a beamforming setting unit 930. According to an embodiment, it may further include a position mapping unit 920. On the other hand, the sensor unit 910 may include or be included in the sensor unit 910 described in FIG. 3, and the beamforming setting unit 930 and the position mapping unit 920 may include or be included in the control unit described in FIG. 3.

[0046] In step 810, the sensor unit 910, which is the sensor unit 910 of the hearing aid worn by the user, may estimate the direction or position of the user or the direction or position of an object that is talking to the user. Here, the sensor unit 910 may be at least one or more of an acceleration sensor, a proximity sensor, a lidar sensor, a thermal sensing sensor, a motion sensor, a camera, an infrared emitter, and an optical sensor.

[0047] For example, the sensor unit 910 may include an acceleration sensor and a proximity sensor. The sensor unit 910 may change the microphone directivity (beamforming) according to the direction of movement of the user wearing the hearing aid by the acceleration sensor. Also, the sensor unit 910 may set the beamforming value to match the direction when an object approaches the user by the IR and proximity sensor or lidar sensor.

[0048] As another example, the sensor unit 910 may recognize an object by the infrared light emitted using an infrared emitter and recognize the object by the light reflected using an optical sensor, and then recognize that the object exists in the overlapping part of the part recognized by the infrared emitter and the part recognized by the optical sensor. In step 820, the position mapping unit 920 may detect the user or the object according to the estimated direction or position and map the position. In step 830, the beamforming setting unit 930 may automatically change the beamforming for the microphone directivity according to the estimated or mapped position of the user or the object.

[0049] As an example, the sensor unit 910 may recognize the direction of the user's movement, and the beamforming setting unit 930 may set a beamforming setting value according to the position and direction of the user. As another example, when the distance between the user and the object is within a predetermined distance, the sensor unit 910 may estimate the direction or position of the object, and the beamforming setting unit 930 may set a beamforming setting value according to the direction or position of the object.

[0050] As still another example, the sensor unit 910 may recognize the direction or position where the sound is generated, and the beamforming setting unit 930 may set a beamforming setting value according to the direction or position where the sound is generated. Further, the sensor unit 910 may grasp the number of objects within a predetermined distance from the user, estimate the direction or position of each object, and the beamforming setting unit 930 may change to a multi-beamforming setting according to the number of objects.

[0051] With reference to FIGS. 10 to 12, a method for automatically setting the microphone directivity by estimating the position of the user 210 or the object 220 using a hearing aid in an embodiment will be described. Here, the case where the number of objects 220 talking to the user 210 is one will be described. FIG. 10 is a diagram for explaining the estimation of the position of an object using a sensor in an embodiment. As shown in FIG. 10, the position of the object 220 may be estimated by the sensor unit of the hearing aid worn by the user 210. At this time, a proximity sensor, a heat sensing sensor, a motion sensor, etc. may be used as the sensor unit.

[0052] FIG. 11 is a diagram for explaining human perception and mapping in an embodiment. As shown in FIG. 11, by estimating the position of the object 220 with the sensor unit of the hearing aid worn by the user 210, a human, that is, the object 220 may be perceived, and its position may be mapped by the position mapping unit. FIG. 12 is a diagram for explaining beamforming change in one embodiment. Referring to FIG. 12, the beamforming setting unit may change the beamforming setting according to the mapped human position in the basic beamforming state.

[0053] With reference to FIGS. 13 to 15, a method for automatically setting the microphone directivity based on the position estimation of the user 210 or the object 220 using a hearing aid in one embodiment will be described. Here, the case where the number of objects 220 talking to the user 210 is two will be described. The number of objects 220 may be two or more. FIG. 13 is a diagram for explaining the position estimation of a plurality of objects using a sensor in one embodiment. As shown in FIG. 13, the sensor unit of the hearing aid worn by the user 210 may estimate the positions of two objects 220. At this time, a proximity sensor, a heat sensing sensor, a motion sensor, etc. may be used as the sensor unit.

[0054] FIG. 14 is a diagram for explaining the sensing and mapping of multiple humans in one embodiment. As shown in FIG. 14, by estimating the positions of two objects 220 with the sensor unit of the hearing aid worn by the user 210, humans, that is, two objects 220, may be sensed, and the positions may be mapped by the position mapping unit. FIG. 15 is a diagram for explaining multi-beamforming in one embodiment. Referring to FIG. 15, the beamforming setting unit may change to a multi-beamforming setting according to the number of mapped people in the basic beamforming state. When a plurality of objects 220 are sensed, the beamforming setting unit may change the beamforming program so as to achieve a desired beamforming.

[0055] FIG. 16 is a diagram for explaining object recognition in one embodiment. Referring to FIG. 16, the object 220, i.e., a human, may be recognized by the infrared rays emitted using an infrared emitter. Also, the object 220 may be recognized by the light reflected using a light sensor. Further, the object 220 may be recognized using both the infrared emitter and the light sensor. At this time, it may be recognized that the object 220 exists in a portion where the portion recognized by the infrared emitter and the portion recognized by the light sensor overlap.

[0056] As described above, according to the embodiment, in the sensor unit of the hearing aid, the direction or position of the user 210 is estimated, or the direction or position of the object 220 that converses with the user 210 is estimated, and the beamforming for the microphone directivity is automatically changed according to the direction or position of the user 210 or the object 220, thereby improving the performance of the hearing aid while making it easier for the user to hear.

[0057] In the above description, when a certain component is described as being "connected to" or "connected with" another component, it should be understood that it may be directly connected to or connected with the other component, but there may also be other components in between. On the contrary, when a certain component is described as being "directly connected to" or "directly connected with" another component, it should be understood that there are no other components in between.

[0058] The terms used in this specification are only used to describe specific embodiments and are not intended to limit the present invention. Singular expressions also include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "including" or "having" are used to specify the existence of the features, numbers, steps, operations, components, parts, or combinations thereof described in this specification, and it should not be understood as precluding the possibility of the existence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0059] Terms such as "first," "second," etc. are used to describe various components, and the components should not be limited by these terms. These terms are only used for the purpose of distinguishing one component from another. Also, terms such as "··· part" and "··· module" described in the specification mean a unit that processes at least one function or operation, and this may be realized by hardware, software, or a combination of hardware and software.

[0060] In addition, the components of the embodiments described with reference to each drawing are not limitedly applied only to the corresponding embodiments, and may be realized so as to be included in other embodiments within the scope where the technical idea of the present invention is maintained. Also, even if individual descriptions are omitted, it is natural that a plurality of embodiments can be realized as one integrated embodiment. Furthermore, in the description with reference to the accompanying drawings, regardless of the reference signs in the drawings, the same components are given the same or related reference signs, and duplicate descriptions thereof are omitted. In the description of the present invention, when it is determined that the specific description of related known technologies makes the gist of the present invention unnecessarily unclear, the detailed description thereof is omitted.

[0061] As described above, the embodiments have been described based on the limited embodiments and drawings, but those skilled in the art will be able to make various modifications and variations from the above description. For example, even if the described technology is executed in an order different from the described method, and / or the components such as the described system, structure, device, circuit, etc. are combined or assembled in a form different from the described method, or are opposed or replaced by other components or equivalents, appropriate results can be achieved. Therefore, even if they are different embodiments, as long as they are equivalent to the claims, they belong to the appended claims.

Claims

1. A method for automatically setting microphone directivity by estimating the position of a user or an object using a hearing aid, comprising: estimating the direction or position of the user or the direction or position of an object conversing with the user by a sensor unit of a hearing aid worn by the user; and automatically changing beamforming for the microphone directivity according to the position of the user or the object. A method for automatically setting microphone directivity, comprising the above steps.

2. further comprising sensing the user or the object according to the estimated direction or position and mapping the position, and automatically changing beamforming for the microphone directivity according to the mapped position of the user or the object. The method for automatically setting microphone directivity according to claim 1.

3. The sensor unit is at least one or more of an acceleration sensor, a proximity sensor, a lidar sensor, a heat sensing sensor, a motion sensor, an infrared emitter, and an optical sensor. The method for automatically setting microphone directivity according to claim 1, characterized by the above.

4. The step of estimating the direction or position is setting a beamforming setting value to match the position and direction of the user by recognizing the direction of movement of the user with a sensor unit of the hearing aid. The method for automatically setting microphone directivity according to claim 1, characterized by the above.

5. The step of estimating the direction or position is setting a beamforming setting value to match the direction or position of the object by estimating the direction or position of the object when the distance between the user and the object is within a predetermined distance with a sensor unit of the hearing aid. The method for automatically setting microphone directivity according to claim 1, characterized by the above.

6. The step of estimating the direction or position is setting a beamforming setting value to match the direction or position where the sound is generated by recognizing the direction or position where the sound is generated. The method for automatically setting microphone directivity according to claim 1, characterized by the above.

7. The step of estimating the direction or position is grasping the number of objects within a predetermined distance from the user and estimating the direction or position of each object, and the step of automatically changing the beamforming is changing to a multi-beamforming setting according to the number of the objects. ​ The method for automatically setting the microphone directivity according to claim 1, characterized in that...

8. The step of estimating the direction or position... recognizes an object by infrared rays emitted using an infrared emitter, recognizes the object by light reflected using an optical sensor, and then recognizes that an object exists in the overlapping part of the part recognized by the infrared emitter and the part recognized by the optical sensor The method for automatically setting the microphone directivity according to claim 1, characterized in that...

9. An apparatus for automatically setting microphone directivity by estimating the position of a user or an object using a hearing aid, comprising: a sensor unit configured in a hearing aid worn by a user, for estimating the direction or position of the user or the direction or position of an object conversing with the user; and a beamforming setting unit that automatically changes beamforming for the microphone directivity according to the position of the user or the object An apparatus for automatically setting microphone directivity.

10. A position mapping unit that detects and maps the position of the user or the object according to the estimated direction or position further comprising: automatically changing beamforming for the microphone directivity according to the mapped position of the user or the object The apparatus for automatically setting microphone directivity according to claim 9.

11. The sensor unit... is at least one or more of an acceleration sensor, a proximity sensor, a lidar sensor, a thermal sensor, a motion sensor, an infrared emitter, and an optical sensor The apparatus for automatically setting microphone directivity according to claim 9, characterized in that...

12. The sensor unit recognizes the direction of movement of the user, whereby the beamforming setting unit sets a beamforming setting value to match the position and direction of the user The apparatus for automatically setting microphone directivity according to claim 9, characterized in that...

13. The sensor unit estimates the direction or position of the object when the distance between the user and the object is within a predetermined distance, whereby the beamforming setting unit sets a beamforming setting value to match the direction or position of the object The apparatus for automatically setting microphone directivity according to claim 9, characterized in that...

14. The sensor unit recognizes the direction or position where the sound is generated, and based on this, the beamforming setting unit sets the beamforming setting value to match the direction or position where the sound is generated. The apparatus for automatically setting the microphone directivity according to claim 9, characterized in that.

15. The sensor unit is configured to determine the number of the objects within a predetermined distance from the user, estimate the direction or position of each of the objects, and the beamforming setting unit is configured to change to a multi-beamforming setting according to the number of the objects. The apparatus for automatically setting the microphone directivity according to claim 9, characterized in that.

16. The sensor unit is configured to recognize an object by infrared light emitted using an infrared emitter and by reflected light using an optical sensor, and then recognize that an object exists in the overlapping portion of the portion recognized by the infrared emitter and the portion recognized by the optical sensor. The apparatus for automatically setting the microphone directivity according to claim 9, characterized in that.

Images