Active sound device utilizing audio recognition

Abstract

To provide an active sound device utilizing audio recognition.SOLUTION: An active sound device includes: an ear cap 10 at least a portion of which is inserted into a user's ear; a data input unit 120 to which audio data is input from an external terminal; an output unit 110 configured to output the input audio data; an audio detection unit 130 configured to detect an externally generated audio signal; a determination unit 140 configured to determine at least one of a class and volume of the audio signal by analyzing the audio signal detected by the audio detection unit; and a control unit 160 configured to control output of the audio data input from the data input unit 120 on the basis of information determined by the determination unit 140.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an active audio device utilizing audio recognition, and more particularly to an audio device capable of active sound adjustment through audio recognition using an artificial intelligence algorithm. [Background technology]

[0002] Conventional earphones and headphones have a problem in that external noise can disrupt a user's hearing while listening to audio. To address this issue, users can manually control the earphones by adjusting the volume and turning the noise canceling function on and off. However, conventional volume adjustment and noise canceling functions have the drawback of being cumbersome, as users must manually adjust them as needed depending on the situation. Furthermore, if the noise canceling function is intentionally enabled by the user, the user may not be able to recognize dangerous situations. Therefore, to address these issues, the present invention proposes an active audio device that utilizes external audio recognition and an artificial intelligence algorithm. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Republic of Korea Patent No. 10-1357935 (registered on January 24, 2014) Summary of the Invention [Problem to be solved by the invention]

[0004] SUMMARY OF THE INVENTION In order to solve the above problems, the present invention aims to provide an active acoustic device using an artificial intelligence algorithm.

[0005] Another object of the present invention is to provide an active acoustic device that recognizes the surrounding environment and automatically turns on and off the sound adjustment or noise canceling function.

[0006] Another object of the present invention is to provide an active acoustic device that automatically suspends its noise canceling function when a danger signal is generated. [Means for solving the problem]

[0007] An active acoustic device comprising: an ear cap that is at least partially inserted into a user's ear; a data input unit that inputs audio data from an external terminal; an output unit that outputs the input audio data; an audio detection unit that detects an externally generated audio signal; a determination unit that analyzes the audio signal detected by the audio detection unit and determines the class and volume of the audio signal; and a control unit that controls the output of the audio data input by the data input unit based on information determined by the determination unit. [Effects of the Invention]

[0008] According to the present invention, an audio device can be provided that can determine the user's pattern and the type and volume of external noise and turn on / off active audio adjustment or noise canceling using an artificial intelligence algorithm.

[0009] Ultimately, the sound or noise canceling function is adjusted without the user's manual operation, and the artificial intelligence algorithm that has been trained according to the surrounding conditions can automatically adjust the sound. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a schematic diagram showing a system of audio equipment according to an embodiment of the present invention; [Figure 2] 1 is a diagram illustrating an audio device according to an embodiment of the present invention. [Figure 3] 1 is a block diagram showing the configuration of an acoustic device according to an embodiment of the present invention; [Figure 4] 1 is a schematic diagram showing a system of acoustic equipment according to a first embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] an ear cap 10 to be inserted at least partially into the user's ear; a data input unit 120 for inputting audio data from an external terminal; an output unit 110 that outputs the input audio data; an audio detector 130 for detecting an externally generated audio signal; a determination unit 140 that analyzes the audio signal detected by the audio detection unit and determines at least one of the class and volume of the audio signal; and and a control unit (160) that controls the output of the audio data inputted by the data input unit (120) based on the information determined by the determination unit (140).

[0012] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. However, the present invention may be embodied in various different forms and is not limited to the drawings and embodiments disclosed below. Furthermore, in order to clearly explain the present invention in the drawings, parts that are not related to the present invention are omitted, and the same or similar reference numerals in the drawings indicate the same or similar components.

[0013] The objectives and effects of the present invention will be naturally understood or will become clearer through the following description, and detailed explanations will be omitted if it is determined that such explanations may unnecessarily obscure the gist of the present invention. Therefore, the objectives and effects of the present invention are not limited to the following description.

[0014] The invention will now be described in more detail with reference to the drawings.

[0015] FIG. 1 is a schematic diagram showing an audio equipment system according to an embodiment of the present invention.

[0016] Briefly describing one embodiment of the present invention with reference to FIG. 1, the present invention relates to an audio device such as an earphone or a headset that outputs audio data input from an external terminal, and the audio device actively adjusts the class and volume of the audio signal that the user can hear by using an artificial intelligence algorithm of a determination unit 140 to determine an audio signal including externally generated noise.

[0017] Each component will be described in more detail below with reference to Figures 2 and 3. Figure 2 is a diagram showing an audio device according to an embodiment of the present invention, and Figure 3 is a block diagram showing the system configuration of the audio device according to an embodiment of the present invention.

[0018] Referring to FIG. 2 and FIG. 3, one embodiment of the present invention may be configured to include an ear cap 10, an output unit 110, a data input unit 120, an audio sensing unit 130, a determination unit 140, a position recognition unit 150, and a control unit 160.

[0019] First, the ear cap 10 is configured to be at least partially inserted into the user's ear and to guide the audio data outputted through the output unit 110 toward the inside of the user's ear. This may be any one of various types of earphone inserts, and does not necessarily have to be inserted into the inside of the user's ear, but may be provided in the form of a headset so as to contact the user's earlobe.

[0020] The output unit 110 is configured to output input audio data, and the data input unit 120 is configured to input audio data from an external terminal. Specifically, the output unit 110 is configured to output audio data that can be heard by the user's ears, and the user can ultimately hear the audio information output from the output unit 110. The data input unit 120 is configured to input audio data that the user wishes to output through the output unit 110, and may be any one of electronic devices that can provide audio data, such as a mobile phone, laptop, MP3, or desktop. That is, the external terminal that can input the audio data that the user wishes to listen to may be any one of devices that can transmit audio data via wired or wireless communication, such as the user's wired or wireless earphones, a Bluetooth speaker, or a wearable device equipped with a speaker.

[0021] Hereinafter, the active acoustic device of the present invention may be any one of a user's wired or wireless earphones, a headset, etc., and for convenience of explanation, one embodiment will be described based on a wireless earphone.

[0022] The audio sensor 130 is configured to detect an externally generated audio signal. Specifically, it can detect an audio signal generated by a sound other than that from the output unit 110 that is directly transmitted through the user's earphone. Specifically, the audio sensor 130 according to one embodiment can detect an audio signal through a microphone formed on the outside of the user's earphone. At this time, the detected audio signal may include external noise, sounds of people talking nearby, various environmental sounds, etc.

[0023] The audio signal detected by the audio detection unit 130 may be transmitted to the determination unit 140. The determination unit 140 is configured to determine the detected audio signal and may determine one or more of the volume, class, importance, etc. of the audio signal. Specifically, the determination unit 140 may analyze the audio signal detected by the audio detection unit 130 to determine one or more of the class and volume of the audio signal, and may also determine the importance of the corresponding audio signal. Here, the class is a classification previously designated by a user, and the determination unit 140 may classify the audio signal into one of the classifications previously designated by the user. Specifically, the user-defined class may be classified according to the user's convenience to include one or more of human voice, hazard warning signal, music, everyday sounds, other noises, etc. More specifically, the determination unit 140 may analyze the audio signal using a pre-installed artificial intelligence algorithm, which may learn from a user's manual audio adjustment and determine whether the active audio device according to an embodiment of the present invention can automatically adjust the audio. The determination unit 140 preferably analyzes and determines the external audio signal detected by the audio detection unit 130, and can also determine the location recognized by the location recognition unit 150 and transmit the overall determination result of the audio signal and location to the control unit 160.

[0024] The position recognition unit 150 recognizes the position of the output unit 110. The position information recognized by the position recognition unit 150 is transmitted to the determination unit 140, which can determine the type and volume of an audio signal based on the transmitted position information. Specifically, the position recognition unit 150 can recognize whether the user is outdoors or indoors and can determine the location's conditions, such as whether the location is an office, classroom, library, public transportation, or public facility. More specifically, the position recognition unit 150 recognizes the location using GPS coordinates and various distance sensors and transmits the recognized position information to the determination unit 140. The determination unit 140 uses an artificial intelligence algorithm to determine the location information based on pre-learning results, thereby accurately determining whether the location is outdoors or indoors and the location's conditions. Therefore, the determination unit 140 can determine the class and volume of an externally sensed audio signal based on the position information transmitted from the position recognition unit 150. In the above-described embodiment, the user's location is determined by determining location information from the location recognition unit 150. However, in another embodiment, even without a separate location recognition unit 150, the location may be determined by tracking audio signals detected by the audio detection unit 130, analyzing the tracked audio signals, and using the AI ​​algorithm of the determination unit 140 to detect information related to the location where the user's audio signal was detected. In particular, as described above, the determination unit 140 can analyze the detected audio signals and determine the audio signal class, and can determine the location based on the resulting value of the determined class. Specifically, if the determination unit 140 classifies the audio signals detected by the audio detection unit 130 into a class such as automobile sound, the user's location can be determined to be on the road or outdoors. If the determination unit 140 recognizes an audio signal classified into a class such as public transportation announcements, the user's location can be determined to be public transportation. Furthermore, if the sound of a TV or the sound of water boiling is recognized, the user can be determined to be indoors. With increased precision, it may be possible to determine whether the user is in a home or an office.In this way, the location can be determined using more accurate coordinate values ​​through the location recognition unit 150, but the location of the user can also be recognized through tracking of the audio signal, and the output of audio data can be controlled according to the corresponding location.

[0025] The determination unit 140 may comprehensively determine the external audio signal detected by the audio detection unit 130 and the location information recognized by the location recognition unit 150, and transmit a control command based on the determination result to the control unit 160. The control unit 160 is configured to control the output of audio data input from the data input unit 120 based on the information determined by the determination unit 140. Specifically, the control unit 160 may adjust the sound of the audio data input from the data input unit 120 based on the determination result of the determination unit 140 and output the adjusted sound to the output unit 110. That is, the control unit 160 may adjust the sound of the output unit 110 based on the determination result of the determination unit 140 without manual operation by the user. At this time, the adjusted sound may include the volume and reverberation of the audio data output from the output unit 110. Specifically, the active audio device of the present invention may automatically turn on / off the noise canceling function of the output unit 110 and automatically adjust the sound, such as the volume and reverberation, based on the user's location, the class of the external audio signal, and the input volume, thereby providing a user-customized sound adjustment system. In addition, a transparent mode may be turned on or off. In detail, the transparent mode is a function of detecting an external audio signal by the audio detection unit 130 and outputting it to the user's ear through the output unit 110. In some cases, when an audio signal classified as a danger signal that the user must hear is detected, the audio signal is output through the output unit 110, allowing the user to hear the important audio signal.

[0026] Hereinafter, a first embodiment and an additional modified embodiment of the active acoustic device of the present invention will be described in detail with reference to Fig. 4. Fig. 4 is a schematic diagram showing a system of an acoustic device according to the first embodiment of the present invention.

[0027] Referring to FIG. 4, the determination unit 140 simultaneously analyzes and determines the audio signal detected by the audio detection unit 130 and the audio data input from the data input unit 120 using a pre-installed artificial intelligence algorithm, and then issues an instruction to the control unit 160, thereby controlling the output of the final audio data. In particular, the artificial intelligence algorithm installed in the determination unit 140 can monitor and record a user's manual operation based on the determination result value of the externally input audio signal. Thereafter, active sound adjustment can be learned based on the recorded user's manual operation. Specifically, according to one embodiment, when the audio detection unit 130 detects an external audio signal of Noise1, if the user manually adjusts the sound of the audio data output and listened to through the output unit 110, the artificial intelligence algorithm of the determination unit 140 can learn by monitoring and recording the user's adjustment result. Thereafter, when an external audio signal classified into the same class is detected, the control unit can control the sound to be adjusted actively, reflecting the previous sound adjustment result of the user. Here, the term "adjusted sound" refers to one or more of volume, sound quality, and sound effects, and sound adjustment may include not only volume adjustment but also noise canceling on / off adjustment function.

[0028] According to another embodiment, when the external audio signals detected by the audio detection unit 130 are recognized as two signals, Noise1 and Noise2, as shown in Figure 4, the determination unit 140 can determine the type and status of Noise1 and the type and status of Noise2 by determining each audio signal. If Noise1 is determined to be an unwanted noise signal, it can be blocked to prevent it from being output to the output unit 110 that the user is listening to. If Noise2 is a conversation sound calling the user or a warning sound notifying a dangerous situation, it can be output to the output unit 110 so that it can be heard by the user. More specifically, the determination unit 140 can block all audio signals determined to be general external noise from being output to the output unit 110 through noise canceling, but if it is determined to be a danger warning sound (such as a disaster notification or a car horn) or a conversation sound between a user and the user, it can be output to the output unit 110 together with the audio data. In some cases, the conversation sound may be controlled to be output from the output unit 110 along with the input audio data. However, if a danger warning sound is recognized, the output of the audio data may be stopped and only the danger warning sound may be output from the output unit 110, prioritizing the user's safety. When audio data and conversation sound are simultaneously output, the output volume and sound of the audio data and conversation sound may be automatically adjusted based on the results of learning the user's usual patterns. Furthermore, if the location is determined to be a library, for example, by the location recognition unit 150 or through audio signal analysis, the noise canceling function may be automatically turned on. If the location is determined to be outdoors, the noise canceling function may be turned on / off or the volume may be adjusted based on the user's usual patterns. Even if the noise canceling function is on, if a danger warning sound or the like is detected externally through the audio detection unit 130, the noise canceling function may be immediately turned off and a danger warning sound may be transmitted to the user. Furthermore, if the artificial intelligence algorithm of the determination unit 140 detects an external audio signal with an intensity above a certain volume, the corresponding audio signal may be transmitted to the user.In addition, when an announcement is made about the name of a station where the user periodically moves based on the user's behavior in public transportation, the noise canceling function may be turned off to notify the user that they have arrived at a transfer station or a stop. As described above, when an audio signal classified as an important class based on the user's class settings, such as a warning sound or a volume above a certain level, is detected, the noise canceling function may simply be turned off, but in another embodiment, a transparent mode may be turned on to allow the user to more accurately and quickly recognize important audio signals.

[0029] In this way, the active acoustic device of the present invention has the advantage of automatically providing a user-customized sound without any additional operation by the user, and also has the advantage of informing the user of dangerous situations.

[0030] The present invention relates to one embodiment, which is merely an example, and those skilled in the art will recognize that various modifications and equivalent embodiments may be possible. Therefore, the scope of the present invention is not limited to the above example and the accompanying drawings. [Industrial Applicability]

[0031] According to the present invention, an audio device can be provided that can determine the user's pattern and the type and volume of external noise and turn on / off active audio adjustment or noise canceling using an artificial intelligence algorithm.

[0032] Ultimately, the sound or noise canceling function is adjusted without the user's manual operation, and the artificial intelligence algorithm that has been trained according to the surrounding conditions can automatically adjust the sound.

Claims

1. an ear cap (10) for insertion at least partially into a user's ear; A data input unit (120) for inputting audio data from an external terminal; an output unit (110) that outputs the input audio data; an audio detector (130) for detecting an externally generated audio signal; A determination unit (140) for determining at least one of a class and a volume of the audio signal by analyzing the audio signal detected by the audio detection unit; and a control unit (160) for controlling output of the audio data inputted through the data input unit (120) based on the information determined by the determination unit (140).

2. The determination unit (140) Analyzing the audio signal with pre-installed artificial intelligence algorithms; The artificial intelligence algorithm comprises:

2. The active acoustic device according to claim 1, further comprising: a step of monitoring and recording a manual operation of a user according to a result value of the audio signal determined by the determining unit (140).

3. The artificial intelligence algorithm comprises:

3. The active acoustic device according to claim 2, further comprising: a learning unit for learning acoustic adjustments based on the recorded manual operations of the user.

4. The determination unit (140) 4. The active acoustic device according to claim 3, further comprising: detecting information related to a location where the audio signal is sensed based on the determined class of the audio signal.

5. The control unit (160) 5. The active acoustic device according to claim 3, wherein the audio data input from the data input unit (120) is adjusted in sound according to the judgment result of the judgment unit (140) and output to the output unit (110).

6. The artificial intelligence algorithm comprises: analyzing a sensed audio signal to determine at least one of a class and a volume of the audio signal; 6. The active acoustic device of claim 5, further comprising: learning the audio signal according to a user's feedback on the determined result value.

7. A position recognition unit (150) that recognizes the position of the output unit (110); 7. The active acoustic device of claim 6, wherein the position information recognized by the position recognition unit (150) is transmitted to the determination unit (140), and the determination unit (140) determines the class and volume of the audio signal taking into account the transmitted position information.

8. The class of audio signals is 5. The active acoustic device according to claim 1, wherein the active acoustic device is classified into one of the categories that are designated and set in advance by a user.

Images