Electronic device and control method thereof

Abstract

A control method of an electronic device capable of generating anti-noise for acoustic noise cancellation (ANC) is disclosed. The control method of the electronic device comprises the following steps: acquiring audio data and metadata of the audio data; classifying the audio data into a plurality of audio clusters based on features of the audio data and features of the metadata; detecting whether the plurality of audio clusters are respectively included in a plurality of pre-stored noise clusters; and adding information on audio clusters not included in the plurality of noise clusters among the plurality of audio clusters to the information on the plurality of noise clusters.

Description

Technical Field

[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device and a control method thereof that selectively cancels noise around the electronic device while outputting audio. Background Art

[0002] Audio devices such as headphones or earplugs can use various noise cancellation technologies. For example, the audio device can obtain the audio around the audio device through a microphone connected to a noise cancellation circuit, and cancel the noise included in the audio around the audio device, thereby outputting an audio signal with improved quality to the user.

[0003] Audio equipment may use active noise cancellation (ANC) technology to determine the surrounding noise environment and actively cancel the noise. Audio equipment using ANC technology may be designed to actively cancel the noise by using the surrounding noise environment, thereby canceling the surrounding noise when providing an audio signal from the electronic device to the user. Summary of the invention

[0004]

Technical solution

[0005] According to an embodiment of the present disclosure, a control method for an electronic device capable of generating anti-noise for acoustic noise cancellation (ANC) is provided, the control method comprising: acquiring audio data and metadata of the audio data. The control method comprises: classifying the audio data into a plurality of audio clusters based on features of the audio data or features of the metadata. The control method comprises: detecting whether each of the plurality of audio clusters is included in a plurality of pre-stored noise clusters. The control method comprises: adding information about an audio cluster among the plurality of audio clusters that is not included in the plurality of noise clusters to information about the plurality of noise clusters.

[0006] According to an embodiment of the present disclosure, an electronic device capable of generating anti-noise for acoustic noise cancellation (ANC) is provided, the electronic device comprising: a sensor; a microphone; a speaker; a memory storing information about a plurality of noise clusters and at least one instruction; and a processor connected to the memory and configured to control the electronic device, wherein the processor is configured to: execute at least one instruction to obtain audio data and metadata of the audio data through the microphone and the sensor. The processor is configured to: classify the audio data into a plurality of audio clusters based on features of the audio data or features of the metadata. The processor is configured to: detect whether each audio cluster of the plurality of audio clusters is included in a plurality of noise clusters. The processor is configured to: add information about an audio cluster among the plurality of audio clusters that is not included in the plurality of noise clusters to the information about the plurality of noise clusters.

[0007] According to an embodiment of the present disclosure, there is provided a non-transitory computer-readable recording medium including a program for executing a control method of an electronic device.

[0008] The control method includes: acquiring audio data and metadata of the audio data; classifying the audio data into multiple audio clusters based on features of the audio data or features of the metadata; detecting whether each audio cluster in the multiple audio clusters is included in a plurality of pre-stored noise clusters; and adding information about audio clusters among the multiple audio clusters that are not included in the multiple noise clusters to information about the multiple noise clusters. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a block diagram for describing a configuration of an electronic device according to an embodiment of the present disclosure.

[0010] Figure 2 is a flowchart for describing a method for clustering audio data of an electronic device according to an embodiment of the present disclosure.

[0011] Figure 3 is a flowchart for describing a method of an electronic device for detecting whether an audio cluster is included in a pre-stored noise cluster according to an embodiment of the present disclosure.

[0012] Figure 4 is a flowchart for describing a method of an electronic device for receiving information about an audio cluster from an external server and updating information about a noise cluster according to an embodiment of the present disclosure.

[0013] Figure 5 is a flowchart for describing a method of an electronic device for updating information about noise clusters based on user feedback according to an embodiment of the present disclosure.

[0014] Figure 6 is a sequence diagram for describing a method of the electronic apparatus for updating information about a plurality of noise clusters stored in an external device according to an embodiment of the present disclosure.

[0015] Figure 7 is a flowchart for describing a method of an electronic device for updating information about a plurality of noise clusters by using information about audio clusters included in the plurality of noise clusters according to an embodiment of the present disclosure.

[0016] Figure 8 is a flowchart for describing a method of an electronic device for updating information about noise clusters stored in a memory of the electronic device according to an embodiment of the present disclosure.

[0017] Fig. 9is a sequence diagram for describing a method of an electronic device for updating information about noise clusters stored in a memory of an external server according to an embodiment of the present disclosure.

[0018] Fig.10 is a flowchart for describing a control method of an electronic device according to an embodiment of the present disclosure.

[0019] Fig.11 and Fig.12 is a flowchart for describing the operation of the electronic device according to an embodiment of the present disclosure.

[0020] Fig.13 is a flowchart for describing the operation of an external server according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0021] The present disclosure may be variously modified and have several embodiments, so specific embodiments of the present disclosure are shown in the drawings and described in detail in the specific description. However, it should be understood that the scope of the present disclosure is not limited to the specific embodiments, and includes various modifications, equivalents and / or substitutions according to the embodiments of the present disclosure. Throughout the drawings, similar components are represented by similar reference numerals.

[0022] In describing the present disclosure, where it is considered that a detailed description of a known function or configuration related to the present disclosure may unnecessarily obscure the gist of the present disclosure, the detailed description is omitted.

[0023] In addition, the following embodiments may be modified in several different forms, and the scope and spirit of the present disclosure are not limited to the following embodiments. Instead, these embodiments are provided to make the present disclosure comprehensive and complete, and to fully convey the spirit of the present disclosure to those skilled in the art.

[0024] The terms used in the present disclosure are only used to describe specific embodiments and are not intended to limit the scope of the present disclosure.Herein, unless clearly explained otherwise in the context, a singular term includes its plural number.

[0025] In the present disclosure, expressions such as “having”, “may have”, “including”, “may include”, etc. indicate the existence of corresponding features (eg, values, functions, operations, or components such as parts), and do not exclude the existence of additional features.

[0026] In the present disclosure, expressions such as "A or B", "at least one of A and / or B", "one or more of A and / or B", etc. may include all possible combinations of items listed together. For example, "A or B", "at least one of A and B", or "at least one of A or B" may include all of the following: 1) including at least one A, 2) including at least one B, or 3) including both at least one A and at least one B.

[0027] The expressions "first", "second", etc. used in the present disclosure may indicate various components regardless of the order and / or importance of the components. These expressions are only used to distinguish one component from another component and do not limit the corresponding components.

[0028] If it is mentioned that any component (e.g., a first component) is "(operably or communicatively) coupled to" or "connected to" another component (e.g., a second component), it should be understood that any component may be directly coupled to the other component or may be coupled to the other component through another component (e.g., a third component).

[0029] On the other hand, if it is mentioned that any component (eg, a first component) is “directly coupled” or “directly connected to” another component (eg, a second component), it should be understood that there is no other component (eg, a third component) between the any component and the other component.

[0030] The expression "configured (or arranged) to" used in the present disclosure may be replaced with the expression "suitable for", "capable of", "designed for", "suitable for", "made to", or "capable of" depending on the context. The expression "configured (or arranged) to" may not necessarily mean "specially designed to" in terms of hardware.

[0031] On the contrary, the expression "a device is configured to" may in some cases mean that the device can "perform" together with another device or component. For example, "a processor is configured (or set) to perform A, B, and C" may mean a dedicated processor (e.g., an embedded processor) for performing the corresponding operations or a general-purpose processor (e.g., a central processing unit (CPU) or an application processor) that can perform the corresponding operations by executing one or more software programs stored in a storage device.

[0032] In an embodiment, a "module" or "device" may perform at least one function or operation, and may be implemented by hardware or software, or may be implemented by a combination of hardware and software. In addition, in addition to a "module" or "device" that needs to be implemented with specific hardware, multiple "modules" or multiple "devices" may be integrated with each other in at least one module and implemented by at least one processor.

[0033] Meanwhile, the various elements and regions in the drawings are schematically shown. Therefore, the spirit of the present disclosure is not limited by the relative sizes or intervals shown in the drawings.

[0034] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present disclosure pertains can easily practice the present disclosure.

[0035] Figure 1 is a block diagram for describing a configuration of an electronic device according to an embodiment of the present disclosure.

[0036] The electronic device 100 may include a memory 110, a communication interface 120, a user interface 130, a microphone 140, a speaker 150, a display 160, a sensor 170, and a processor 180. The electronic device 100 may omit some of the above components and may further include other components.

[0037] In addition, the electronic device 100 can be implemented as an audio device such as headphones or headphones, which is only an embodiment, and can be implemented in any of various forms such as a smartphone, a tablet personal computer (PC), a PC, a server, a smart television (TV), a mobile phone, a personal digital assistant (PDA), a laptop computer, a media player, an e-book terminal, a digital broadcast terminal, a navigation, a self-service terminal, an MP3 player, a digital camera, a wearable device, a home appliance, and other mobile or non-mobile computing devices.

[0038] Here, if the electronic apparatus 100 is implemented as a device other than earphones or headphones, the electronic apparatus 100 may be connected to the earphones or headphones through the communication interface 120, perform communication with the earphones or headphones, and may control the earphones or headphones.

[0039] The memory 110 may store at least one instruction regarding the electronic device 100. The memory 110 may store an operating system (O / S) for driving the electronic device 100. In addition, according to various embodiments of the present disclosure, the memory 110 may store various software programs or applications for operating the electronic device 100. In addition, the memory 110 may include a semiconductor memory (such as a flash memory) or a magnetic storage medium (such as a hard disk).

[0040] Specifically, the memory 110 may store various software modules for operating the electronic device 100 according to various embodiments of the present disclosure, and the processor 180 may execute the various software modules stored in the memory 110 to control the operation of the electronic device 100. That is, the memory 110 may be accessed by the processor 180, and the processor 180 may read, record, correct, delete, update, etc., the data therein.

[0041] Meanwhile, in the present disclosure, the term “memory 110 ” may include the memory 110 , a read-only memory (ROM) or a random access memory (RAM) in the processor 180 , or a memory card (not shown, for example, a micro secure digital (SD) card or a memory stick) installed in the electronic device 100 .

[0042] The communication interface 120 may be a component that includes a circuit and communicates with an external device or server. The communication interface 120 may communicate with an external device or server by using a wired or wireless communication method. In this case, the communication interface 120 may include a Bluetooth module (not shown), a wireless fidelity (Wi-Fi) module (not shown), an infrared (IR) module, a local area network (LAN) module, an Ethernet module, etc. Here, each communication module may be implemented in the form of at least one hardware chip. In addition to the above-mentioned communication method, the wireless communication module may also include at least one communication chip that performs communication based on various wireless communication standards (such as zigbee, universal serial bus (USB), mobile industry processor interface camera serial interface (MIPI CSI), third generation (3G), third generation partnership project (3GPP), long term evolution (LTE), LTE advanced (LTE-A), fourth generation (4G) and fifth generation (5G)). However, this configuration is only an embodiment, and the communication interface 120 may use at least one communication module among various communication modules.

[0043] The user interface 130 may be a component for receiving user commands to control the electronic device 100. The user interface 130 may be implemented as a device such as a button, a touch pad, a mouse, or a keyboard, or may be implemented as a touch screen capable of performing an operation input function in addition to a display function. Here, the button may be any of various types such as a mechanical button, a touch pad, or a scroll wheel, which is provided in any area such as a front surface portion, a side surface portion, or a rear surface portion of the body appearance of the electronic device 100. The electronic device 100 may obtain various user inputs through the user interface 130.

[0044] The microphone 140 may be integrated on the top, front, or side of the electronic device 100. The microphone 140 may include various components such as a microphone that collects a user voice in an analog form, an amplifier circuit that amplifies the collected user voice, an analog-to-digital (A / D) conversion circuit that samples the amplified user voice and converts it into a digital signal, a filter circuit that eliminates noise components from the converted digital signal, etc.

[0045] In addition, the microphone 140 may acquire audio data. Here, the audio data may be data about audio around the electronic device 100. In addition, the audio around the electronic device 100 may include noise.

[0046] In addition, the microphone 140 can obtain user voice input.

[0047] The speaker 150 may output an audio signal. For example, the speaker 150 may output an analog signal by converting the audio signal into a physical vibration signal that the user may auditorily perceive.

[0048] Here, the speaker 150 may output a noise cancellation signal to cancel noise included in audio around the electronic device 100. That is, the speaker 150 may output the audio signal and the noise cancellation signal together.

[0049] Meanwhile, the speaker 150 may output a noise cancellation signal of a different level for each of the plurality of noises. That is, the speaker 150 may output a plurality of noise cancellation signals of different anti-noise levels for each of the plurality of noises.

[0050] Here, the anti-noise level may indicate the noise cancellation level. Specifically, the anti-noise level may indicate the amplitude, frequency or power of the noise cancellation signal corresponding to the inverted signal of the noise signal. For example, the speaker 150 may completely eliminate the first noise by outputting a noise cancellation signal of a first level (e.g., 100%) for the first noise. In addition, the speaker 150 may eliminate 50% of the second noise by outputting a noise cancellation signal of a second level (e.g., 50%) for the second noise. In addition, the speaker 150 may not eliminate the third noise by outputting a noise cancellation signal of a third level (e.g., 0%) for the third noise. Here, the third noise may be sent to the user through the hear-through mode or the pass-through mode without being eliminated by the noise cancellation signal.

[0051] The display 160 may be implemented as a display including a self-luminous element or a display including a non-self-luminous element and a backlight. For example, the display 160 may be implemented as any of various types such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a light emitting diode (LED) display, a micro light emitting diode (micro LED) display, a mini LED display, a plasma display panel (PDP), a quantum dot (QD) display, or a quantum dot light emitting diode (QLED) display. The display 160 may also include a driving circuit, a backlight unit, etc., which may be implemented in the form of a-si thin film transistor (TFT), a low temperature polysilicon (LTPS) TFT, or an organic TFT (OTFT).

[0052] The sensor 170 may detect the electronic device 100 and the surrounding environment of the electronic device 100. For example, the sensor 170 may include at least one of a global positioning system (GPS) sensor, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a temperature sensor, a humidity sensor, or an illumination sensor. For example, the GPS sensor may acquire location information of a location where audio data is acquired.

[0053] The processor 180 may control the overall operation and function of the electronic device 100. Specifically, the processor 180 may be connected to the configuration of the electronic device including the memory 110, and execute at least one instruction stored in the memory 110 as described above, thereby controlling the overall operation of the electronic device 100.

[0054] The processor 180 may be implemented in various ways. For example, the processor 180 may be implemented as at least one of an application specific integrated circuit (ASIC), an embedded processor, a microprocessor, a hardware control logic, a hardware finite state machine (FSM), or a digital signal processor (DSP). Meanwhile, in the present disclosure, the term "processor 180" may be used to include a central processing unit (CPU), a graphics processing unit (GPU), a main processing unit (MPU), etc.

[0055] The operations of the processor 180 for implementing various embodiments of the present disclosure may be implemented using a plurality of modules.

[0056] Specifically, data for multiple modules according to the present disclosure can be stored in the memory 110, and the processor 180 can access the memory 110 to load the data for multiple modules into the internal memory or buffer of the processor 180, and then use the multiple modules, thereby implementing various embodiments according to the present disclosure.

[0057] However, at least one module among the plurality of modules according to the present disclosure may be implemented as hardware and included in the processor 180 in the form of a system on chip.

[0058] The processor 180 may acquire audio data. Here, the audio data may refer to data converted into digital signals by receiving analog audio source signals around the electronic device 100. Specifically, the processor 180 may acquire audio data of the audio around the electronic device 100 through the microphone 140. Here, the audio around the electronic device 100 may include at least one noise. That is, the audio data may include audio signals acquired from multiple audio sources. For example, the audio data may include vehicle noise, alarm sounds, collision sounds, human conversation sounds, etc.

[0059] Meanwhile, the processor 180 may acquire audio data through the microphone 140 , but is not limited thereto, and may also acquire audio data from an external device through the communication interface 120 .

[0060] At the same time, the processor 180 may acquire metadata of the audio data. Here, the metadata of the audio data may include context information of the audio data. The context information of the audio data may indicate information about the environment in which the audio is acquired.

[0061] Specifically, the processor 180 may acquire context information of the audio data through the sensor 170. Specifically, the context information of the audio data may include at least one of the following information: an operating state of the electronic device 100 when the audio data is acquired (active noise cancellation (ANC) mode or hear-through mode), a user state when the audio data is acquired (e.g., exercise), a location (e.g., latitude, longitude, or region) of a place where the audio data is acquired, a direction of an audio source, weather of a place where the audio data is acquired, temperature of a place where the audio data is acquired, or humidity of a place where the audio data is acquired.

[0062] Here, the direction of the audio source may indicate a direction in which the audio source is located based on a specific direction toward which the electronic device 100 is facing. For example, if the specific direction toward which the electronic device 100 is facing is the front, the information about the direction in which the audio data is generated may be the front of the electronic device 100, a direction 90 degrees to the right from the front of the electronic device 100, or the rear based on the front of the electronic device 100.

[0063] Specifically, the sensor 170 may include a plurality of microphones 140. Here, the processor 180 may identify the direction in which the audio signal is generated by comparing the components of the audio signal input through the plurality of microphones 140. Specifically, the processor 180 may use the plurality of microphones 140 to determine the direction in which the audio signal is output based on the electronic device 100 (e.g., the front, side, or rear of the electronic device 100) based on audio components such as a time difference occurring when the same audio signal is input to each of the plurality of microphones 140, an amplitude difference of the audio signal, or a phase difference of the frequency of the audio signal.

[0064] Alternatively, the processor 180 may acquire the location information of the place where the audio data is acquired through a GPS sensor.

[0065] Meanwhile, the processor 180 may acquire context information of the audio data through the sensor 170 , which is merely an embodiment, and the processor 180 may acquire the context information of the audio data from an external device including a sensor through the communication interface 120 .

[0066] In addition, the processor 180 may classify the audio data into a plurality of audio clusters based on at least one of the characteristics of the audio data or the characteristics of the metadata of the audio data.

[0067] Reference Figure 2 , the processor 180 may acquire audio data and metadata of the audio data (S210). In addition, the processor 180 may acquire features of the audio data (S220). Here, the processor 180 may classify the audio data into a plurality of audio clusters based on the features of the audio data (S230).

[0068] Specifically, the processor 180 can obtain multiple audio segments by dividing the audio data into time or frequency units, and obtain features from the multiple audio segments. In addition, the processor 180 can classify the multiple audio segments into multiple audio clusters based on information about similarities between the features obtained from the multiple audio segments.

[0069] Here, the acquired features may be features of the audio signal, such as its energy, Mel-frequency cepstral coefficients (MFCC), centroid, volume, power, subband energy, low short-time energy ratio, zero crossing rate, frequency centroid, frequency bandwidth, spectral flux, cepstral flux or loudness.

[0070] Alternatively, the processor 180 may acquire feature information of the audio data obtained by coupling features of an audio signal included in the audio data with features included in metadata of the audio data, and classify a plurality of audio data into a plurality of audio clusters based on information about similarities between the acquired feature information.

[0071] In addition, the acquired features may be in the form of embedded feature vectors (embedded vectors). Here, the processor 180 may classify the plurality of audio segments into a plurality of audio clusters based on the distance between the feature vectors in the embedded space. That is, in the embedded space, the more similar the first feature vector is to the second feature vector, the closer the distance between the vectors may be set, and the more dissimilar the vectors are, the farther the distance between the vectors may be set. Here, the processor 180 may classify the audio segments clustered within a threshold distance in the embedded space into one audio cluster.

[0072] Accordingly, the processor 180 may classify the audio data into a plurality of audio clusters based on the type of audio. For example, the processor 180 may classify the audio data into a first audio cluster, a second audio cluster, a third audio cluster, and a fourth audio cluster. Here, the first audio cluster may be the audio of an impact sound (e.g., a vehicle collision sound). The second audio cluster may be the audio of a siren. The third audio cluster may be the audio of a sound generated from the front of the electronic device. The fourth audio cluster may be the audio of a sound generated from the back of the electronic device.

[0073] Alternatively, the first audio cluster may be audio of a crash sound generated in Seoul. The second audio cluster may be audio of a siren sound generated in Seoul. The third audio cluster may be audio of traffic noise occurring in Seoul.

[0074] Furthermore, the processor 180 may detect whether each of the plurality of audio clusters is included in the pre-stored plurality of noise clusters ( S320 ).

[0075] Specifically, the memory 110 may include information about a plurality of noise clusters. Here, the information about the plurality of noise clusters may include information about each noise, and the information about each noise may include at least one of identification information of the noise, characteristics of the noise signal, metadata of the noise, and an anti-noise level corresponding to the noise.

[0076] Here, the metadata of the noise may include at least one of tag information defining the noise, context information of the noise (e.g., location information or temperature information), data information of the noise being acquired, time information of the noise being acquired, or direction information of the noise source.

[0077] Here, if noise is acquired, the context information of the noise may indicate context information of a device acquiring the noise and a surrounding environment of the device.

[0078] Here, the anti-noise level may indicate the noise elimination level. Specifically, the anti-noise level may indicate the amplitude, frequency or power of the noise elimination signal corresponding to the inverted signal of the noise signal. For example, if the anti-noise level corresponding to the noise is 100%, the processor 180 may generate anti-noise data that can eliminate 100% of the noise. Alternatively, if the anti-noise level corresponding to the noise is 50%, the processor 180 may generate anti-noise data that can eliminate 50% of the noise. Alternatively, if the anti-noise level corresponding to the noise is 0%, the processor 180 may not generate anti-noise data that can eliminate the noise.

[0079] Here, the electronic device 100 may output an anti-noise signal through the speaker 150 using the generated anti-noise data, which is only an embodiment, and the electronic device 100 may send the anti-noise data to an external device (eg, earphones) including a speaker and control the external device to output the anti-noise signal.

[0080] Specifically, the processor 180 may detect whether each of the multiple audio clusters is included in the multiple noise clusters based on a similarity value between feature information of each of the multiple audio clusters and feature information of each of the multiple noise clusters.

[0081] Specifically, the processor 180 may identify whether each of the plurality of audio clusters matches one of the plurality of pre-stored noise clusters. If there is no noise cluster matching the first audio cluster, the processor 180 may identify the first audio cluster as not included in the plurality of noise clusters. In addition, if there is a noise cluster matching the second audio cluster, the processor 180 may identify the second audio cluster as included in the plurality of noise clusters.

[0082] Here, the processor 180 may identify whether each of the plurality of audio clusters matches one of the plurality of noise clusters based on a similarity value between each of the plurality of audio clusters and each of the plurality of noise clusters.

[0083] Specifically, the processor 180 may obtain a similarity value between one of the multiple audio clusters and one of the multiple noise clusters. Here, the processor 180 may identify one of the multiple noise clusters as a noise cluster matching one of the multiple audio clusters based on the similarity value being at least a predetermined value.

[0084] That is, the processor 180 may identify a noise cluster having a similarity value of at least a predetermined value among the plurality of noise clusters as a noise cluster matching one of the plurality of audio clusters.

[0085] Here, if there are multiple noise clusters, each having a similarity value greater than or equal to a predetermined value, the processor 180 may identify a noise cluster with a highest similarity value as a noise cluster that matches one of the multiple audio clusters.

[0086] Alternatively, the processor 180 may detect whether each of the plurality of audio clusters is included in the plurality of noise clusters by comparing metadata of each of the plurality of audio clusters with metadata of the plurality of noise clusters.

[0087] Specifically, the processor 180 may compare metadata of one audio cluster among the plurality of audio clusters with metadata of one noise cluster among the plurality of noise clusters to identify whether corresponding clusters match each other.

[0088] For example, if metadata of one of the multiple audio clusters matches metadata of one of the multiple noise clusters, the processor 180 may identify one of the multiple audio clusters as matching one of the multiple noise clusters. Here, the metadata may be at least one of tag information, context information of a location where data is acquired, date information of the data being acquired, time information of the data being acquired, or direction information of the data.

[0089] That is to say, referring to Figure 3, if the audio data is classified into a plurality of audio clusters ( S310 ), the processor 180 may detect whether one audio cluster among the plurality of audio clusters is included in a plurality of noise clusters ( S320 ).

[0090] Here, if the audio cluster is included in a plurality of noise clusters (S320-Y), the processor 180 may generate anti-noise data for the audio cluster based on the anti-noise level included in the information about the noise cluster matching the audio cluster (S330). In addition, the processor 180 may output an anti-noise signal through the speaker 150 or transmit it to an external device including a speaker based on the generated anti-noise data, and control the external device to output the anti-noise signal.

[0091] At the same time, the noise not included in the information about the noise clusters pre-stored in the memory 110 cannot be eliminated to the anti-noise level optimized for the user. That is, the noise may be noise that needs to be eliminated, noise that does not need to be eliminated, or noise that needs to be eliminated to a certain level, depending on the type of noise. However, the processor 180 cannot eliminate the noise not included in the pre-stored noise clusters to the anti-noise level optimized for the user.

[0092] Accordingly, the electronic device 100 of the present disclosure may update information about noise clusters pre-stored in the memory 110 by using information about audio clusters not included in a plurality of noise clusters, and provide an optimized acoustic noise cancellation (ANC) environment for a user.

[0093] Therefore, if the audio cluster is not included in the plurality of noise clusters (S320-N), the processor 180 may add information about the audio cluster not included in the plurality of noise clusters to the information about the plurality of noise clusters (S340). That is, the processor 180 may add information about the audio cluster not included in the pre-stored plurality of noise clusters among the plurality of audio clusters to the information about the plurality of noise clusters.

[0094] According to an embodiment of the present disclosure, the electronic device 100 may update information on a plurality of noise clusters stored in the memory 110 by using information acquired from an external server.

[0095] Specifically, refer to Figure 4 If one of the plurality of audio clusters is identified as not included in the plurality of noise clusters (S410), the processor 180 may acquire, from the external server, a user input of whether information on the audio cluster not included in the plurality of noise clusters is received from the external server (S420).

[0096] Specifically, the processor 180 may output information asking whether to receive information about an audio cluster not included in a plurality of noise clusters from an external server. For example, the processor 180 may output a voice asking whether to receive information about an audio cluster not included in a plurality of noise clusters from an external server through the speaker 150, or display a screen asking whether to receive information about an audio cluster not included in a plurality of noise clusters from an external server through the display 160.

[0097] Furthermore, if a user input of receiving information about an audio cluster not included in the plurality of noise clusters from an external server is acquired, the processor 180 may receive the information about the audio cluster from the external server (S430).

[0098] Here, the information about the audio cluster received from the external server may include feature information of the audio cluster, metadata of the audio cluster, and an anti-noise level corresponding to the audio cluster.

[0099] Furthermore, the processor 180 may store information about audio clusters received from the external server in the memory 110 (S440) to update information about multiple noise clusters stored in the memory 110. That is, the processor 180 may add information about audio clusters not included in the multiple noise clusters to the information about the multiple noise clusters.

[0100] Meanwhile, according to an embodiment of the present disclosure, the electronic device 100 may update the information about the plurality of noise clusters stored in the memory 110 based on user feedback.

[0101] Specifically, refer to Figure 5 If the audio cluster is identified as not included in the plurality of noise clusters, the processor 180 may output information asking whether to add the audio cluster to the plurality of noise clusters (S510).

[0102] Specifically, the processor 180 may output a voice asking whether to add an audio cluster to the plurality of noise clusters through the speaker 150 , or display a screen asking whether to add an audio cluster to the plurality of noise clusters through the display 160 .

[0103] Furthermore, the processor 180 may acquire a user input of whether to add information on an audio cluster not included in the plurality of noise clusters to the memory 110 ( S520 ).

[0104] For example, the processor 180 may output audio, such as “Do you want to add information about the current noise around the electronic device?” through the speaker 150 . In addition, the processor 180 may acquire a user voice input, such as “Yes”, through the microphone 140 .

[0105] Furthermore, the processor 180 may output information inquiring about information about an audio cluster not included in the plurality of noise clusters based on acquiring a user input for adding information about the audio cluster to the memory 110 .

[0106] Specifically, the processor 180 may output a voice inquiring about information on an audio cluster not included in the plurality of noise clusters through the speaker 150 or display a screen inquiring about information on an audio cluster not included in the plurality of noise clusters through the display 160 .

[0107] In addition, the processor 180 may acquire information about the audio cluster from the user input (S530). Here, the information about the audio cluster acquired from the user input may include metadata of the audio cluster, such as tag information defining the audio cluster, and an anti-noise level corresponding to the audio cluster.

[0108] For example, the processor 180 may output an audio message asking for label information of the audio message, such as “What do you want to label the current audio message as?” through the speaker 150. In addition, the processor 180 may obtain a user voice input, such as “office noise”, through the microphone 140.

[0109] In addition, the processor 180 may output audio, such as “What is the anti-noise level of the current audio?” In addition, the processor 180 may acquire a user voice input, such as “100%”, “50%”, or “0%”.

[0110] In addition, the processor 180 may store the information about the audio cluster in the memory 110 based on the acquired user input (S540), and add it to the information about the plurality of noise clusters stored in the memory 110. Here, the information added to the information about the plurality of noise clusters may include feature information of the audio cluster, metadata of the audio cluster, and an anti-noise level corresponding to the audio cluster.

[0111] At the same time, the processor 180 may update the information about the multiple noise clusters stored in the external server. That is, the processor 180 may send the acquired information about the audio clusters to the external server to update the information about the multiple noise clusters stored in the external server.

[0112] For example, the external server may not store noise information about office noise. Here, the electronic device 100 may send the acquired characteristic information of office noise, metadata of office noise, or an anti-noise level corresponding to office noise to the external server, thereby updating the information about multiple noise clusters stored in the external server.

[0113] Alternatively, the external server may not store the noise information acquired in New York. Here, the electronic device 100 may acquire information about the noise acquired in New York, and transmit the acquired information to the external server to update the information about the plurality of noise clusters stored in the external server.

[0114] Specifically, refer to Figure 6 , the electronic device 100 may identify the audio cluster as not included in a plurality of noise clusters pre-stored in the memory 110 or the external server 200 (S610).

[0115] Here, the electronic device 100 may acquire information about an audio cluster not included in the plurality of noise clusters through the communication interface 120, the user interface 130, or the microphone 140 (S620). If information about an audio cluster not included in the plurality of noise clusters is acquired, the electronic device 100 may transmit the acquired information about the audio cluster to the external server 200 (S630).

[0116] Accordingly, the external server 200 may store the received information about the audio cluster in the memory of the external server 200 to update the information about the plurality of noise clusters stored in the memory of the external server 200 .

[0117] That is, the electronic device 100 may transmit the acquired information about the audio cluster to the external server 200 and control the external server 200 to update the information about the plurality of noise clusters.

[0118] At the same time, even if the type of noise is the same, it may be necessary to store information about noise clusters differently depending on the user. For example, even if information about a specific noise (such as "office noise") is stored in the memory 110, the characteristic information of the specific noise may be different depending on the user. That is, the office noise of the first user and the office noise of the second user may be different from each other. The information about the office noise cluster stored in the memory 110 may be optimized for the office noise of the first user, and may not be optimized for the office noise of the second user.

[0119] Meanwhile, the external server 200 may store information about a plurality of audio clusters differently for each user account of the electronic device 100, and the electronic device 100 may update information about a plurality of noise clusters corresponding to the user account. Accordingly, the user of the electronic device 100 may use the same ANC environment through an external device by using information about a plurality of noise clusters pre-stored in the user account.

[0120] According to an embodiment of the present disclosure, the electronic device 100 may update information about a plurality of noise clusters by using information about audio clusters included in the plurality of noise clusters.

[0121] That is, even if an audio cluster is included in a plurality of noise clusters, the processor 180 may update information about the plurality of noise clusters using information about the audio cluster.

[0122] Specifically, refer to Figure 7 , the processor 180 may acquire audio data and classify the audio data into a plurality of audio clusters ( S710 ).

[0123] Furthermore, the processor 180 may identify one audio cluster among the plurality of audio clusters as included in the plurality of noise clusters ( S720 ).

[0124] For example, the acquired audio cluster may be an “office noise” cluster, and one of the plurality of noise clusters may be an “office noise” cluster.

[0125] Here, the processor 180 may update information included in the pre-stored noise cluster using information about the audio cluster (S730). Here, the information about the audio cluster may include feature information of the audio cluster, metadata of the audio cluster, or an anti-noise level corresponding to the audio cluster.

[0126] For example, the processor 180 may update the pre-stored information about the noise cluster "office noise" using the characteristic information of the audio cluster "office noise". That is, the processor 180 may replace the characteristic information included in the pre-stored noise cluster "office noise" with the characteristic information of the audio cluster "office noise". Alternatively, the processor 180 may add the characteristic information about the audio cluster "office noise" to the characteristic information included in the pre-stored noise cluster "office noise".

[0127] Alternatively, the processor 180 may acquire information about the audio cluster "office noise" through the communication interface 120, the user interface 130, or the microphone 140. Here, the information about the audio cluster "office noise" may include an anti-noise level of the audio cluster "office noise".

[0128] Accordingly, the processor 180 may replace the anti-noise level included in the information on the noise cluster “office noise” with the anti-noise level of the audio cluster “office noise”.

[0129] Specifically, the processor 180 may add the acquired audio features of the office noise cluster to the pre-stored audio features of the office noise cluster. Alternatively, the processor 180 may replace the pre-stored audio features of the office noise cluster with the acquired audio features of the office noise cluster.

[0130] As described above, even if the acquired audio cluster is included in a plurality of noise clusters pre-stored in the memory 110, the electronic device 100 according to the present disclosure may provide an optimized ANC environment to the user by updating information on the plurality of noise clusters.

[0131] Meanwhile, the processor 180 according to an embodiment of the present disclosure may update the information about the noise cluster stored in the memory 110 based on a predetermined update cycle. Alternatively, if a user input for updating the information about the noise cluster stored in the memory 110 is obtained, the processor 180 may update the information about the noise cluster stored in the memory 110.

[0132] Specifically, refer to Figure 8 , if a predetermined update cycle is reached or a user input for updating information on a pre-stored noise cluster is acquired, the processor 180 may acquire metadata of the audio cluster (S810).

[0133] In addition, the processor 180 may send the metadata of the acquired audio cluster to the external server (S820). Here, if the metadata of the audio cluster is received, the external server may acquire feature data of the metadata and compare it with feature data of the noise cluster stored in the external server to identify whether information about the noise cluster matching the audio cluster is stored in the memory of the external server.

[0134] Accordingly, if the information about the noise cluster matching the audio cluster is identified as being stored in the memory of the external server, the processor 180 may acquire the information about the noise cluster matching the audio cluster from the external server (S830). Here, the acquired information about the noise cluster may include feature information of the noise cluster, metadata of the noise cluster, or an anti-noise level corresponding to the noise cluster. Here, the metadata included in the acquired information about the noise cluster may indicate tag information defining the noise cluster.

[0135] Furthermore, the processor 180 may update the information about the noise cluster stored in the memory 110 using the information about the noise cluster acquired from the external server ( S840 ).

[0136] According to an embodiment of the present disclosure, the electronic device 100 may transmit the acquired audio data and context information of the audio data to an external server to update the information about the noise cluster stored in the external server.

[0137] Specifically, refer to Fig. 9 , the electronic device 100 may acquire an audio cluster and metadata of the audio cluster ( S910 ).

[0138] Furthermore, the electronic device 100 may transmit information about the audio cluster to the external server 200 (S920). Here, the information about the audio cluster may include metadata of the audio cluster.

[0139] In addition, the external server 200 may acquire feature information of the audio cluster (S930). Here, the feature information of the audio cluster may be feature information coupled with features of an audio signal included in the audio cluster and features included in metadata of the audio cluster.

[0140] In addition, the external server 200 can identify whether a noise cluster matching the audio cluster is stored in the memory of the external server 200 by comparing the characteristics of the audio cluster with the characteristic information of the noise cluster stored in the memory of the external server 200. That is, the external server 200 can detect whether the audio cluster is included in the plurality of noise clusters stored in the memory of the external server 200.

[0141] Here, the external server 200 may determine whether features of the audio cluster and features of the noise cluster exist within a threshold distance in the embedding space, and identify the noise cluster located within the threshold distance as a noise cluster matching the audio cluster.

[0142] If a noise cluster matching the audio cluster is identified (S940), the external server 200 may update the information about the noise cluster stored in the memory of the external server 200 by merging the information about the audio cluster with the information about the noise cluster stored in the memory of the external server 200 or by segmenting the information about the audio cluster into the information about the noise cluster stored in the memory of the external server 200 (S950).

[0143] If a noise cluster matching the audio cluster is not identified, the external server 200 may define the audio cluster as a new noise cluster and add information about the new noise cluster to information about the noise cluster stored in a memory of the external server 200 .

[0144] Fig.10 is a flowchart for describing a control method of the electronic device 100 according to an embodiment of the present disclosure.

[0145] The electronic device 100 may acquire audio data (S1010).

[0146] Furthermore, the electronic device 100 may classify the audio data into a plurality of audio clusters ( S1020 ).

[0147] Furthermore, the electronic device 100 may detect whether each of the plurality of audio clusters is included in the pre-stored plurality of noise clusters ( S1030 ).

[0148] Furthermore, the electronic device 100 may add information about an audio cluster not included in the plurality of noise clusters among the plurality of audio clusters to the information about the plurality of noise clusters (S1040).

[0149] Fig.11 is a diagram for describing the operation of the electronic device 100 according to an embodiment of the present disclosure.

[0150] The processor 180 may acquire audio data and metadata of the audio data (S1100). Here, the metadata of the audio data may include location information of the audio data being acquired.

[0151] In addition, the processor 180 may classify the audio data into a plurality of audio clusters based on the features of the audio data and the features included in the metadata of the audio data (S1110). For example, the processor 180 may classify the audio data into a first audio cluster and a second audio cluster. Here, the first audio cluster may be audio of an impact sound acquired in New York, and the second audio cluster may be an alarm sound acquired in New York.

[0152] Furthermore, the processor 180 may identify whether each of the plurality of audio clusters is included in the noise cluster stored in the memory ( S1120 ).

[0153] If the audio cluster is identified as included in a plurality of noise clusters (S1120-Y), the processor 180 may acquire information about a noise cluster corresponding to the audio cluster (S1130). For example, the memory may store information about an impact sound cluster acquired in New York.

[0154] Furthermore, the processor 180 may generate anti-noise data for the audio cluster by using the settings that are stored and matched with the noise cluster ( S1140 ).

[0155] If the audio cluster is identified as not included in the plurality of noise clusters (S1120-N), the processor 180 may identify whether to search for information about the audio cluster in an external server (S1150).

[0156] Here, the processor 180 may provide the user with information asking whether to search the external server for information about the audio cluster. In addition, the processor 180 may determine whether to search the external server for information about the audio cluster based on a user input of whether to search for information about the audio cluster.

[0157] Specifically, the processor 180 may provide the user with information asking whether to search for information about the audio cluster in the external server. Here, the processor 180 may control the speaker 150 to output a voice asking whether to search for information about the audio cluster in the external server. Alternatively, the processor 180 may control the display 160 to display a screen including a text asking whether to search for information about the audio cluster in the external server. Alternatively, the processor 180 may send a control signal to the user terminal device to display information asking whether to search for information about the audio cluster in the external server.

[0158] For example, the processor 180 may control the speaker 150 to output a voice such as “Do you want to search an external server for information about a currently acquired audio cluster?” or “Do you want to search the cloud for information about a currently acquired audio cluster?”.

[0159] Alternatively, the processor 180 may provide a user interface (UI) including text such as “Do you want to search an external server for information about a currently acquired audio cluster?” or “Do you want to search a cloud for information about a currently acquired audio cluster?” through the display 160 .

[0160] Alternatively, the processor 180 may send a control signal to the user terminal device for displaying a UI including text such as “Do you want to search an external server for information about the currently acquired audio cluster?” or “Do you want to search the cloud for information about the currently acquired audio cluster?”.

[0161] In addition, the processor 180 may obtain a user input of whether to add an audio cluster to a noise cluster through the communication interface 120 , the user interface 130 , or the microphone 140 .

[0162] If a user input not to search for information on an audio cluster is acquired (S1150-N), the processor 180 may delete data on the audio cluster from the memory (S1160).

[0163] In addition, if a user input for searching for information about an audio cluster is obtained (S1150-Y), the processor 180 may transmit the information about the audio cluster to an external server (S1170). Here, the information about the audio cluster may include at least one of a feature of the audio data, metadata of the audio data, and a tag of the audio data.

[0164] In addition, the processor 180 may receive information corresponding to a noise cluster corresponding to the transmitted audio cluster (1180). Here, the information corresponding to the noise cluster may include at least one of a feature of the noise cluster, metadata, tag information, or an anti-noise level.

[0165] Furthermore, the processor 180 may add the acquired information about the noise cluster to the information about the plurality of noise clusters stored in the memory (S1190). Accordingly, the processor 180 may generate anti-noise data of a noise level corresponding to the acquired noise cluster for the audio cluster.

[0166] That is, according to an embodiment of the present disclosure, even if the environment (e.g., location) changes, the user of the electronic device 100 can update the information about the multiple noise clusters stored in the memory by using the information received from the external server to optimize it to adapt to the changed environment (e.g., from Seoul to New York). In addition, the user of the electronic device 100 can experience a noise cancellation environment optimized for the user even in a changing environment.

[0167] Fig.12 is a diagram for describing an operation of an electronic device according to an embodiment of the present disclosure.

[0168] Reference Fig.12 If the audio cluster is identified as not included in the pre-stored plurality of noise clusters (S1120-N), the processor 180 may acquire a user input of whether to add the audio cluster to the plurality of noise clusters.

[0169] Specifically, the processor 180 may provide the user with information asking whether to add the audio cluster to the multiple noise clusters. Specifically, the processor 180 may control the speaker 150 to output a voice asking whether to add the audio cluster to the multiple noise clusters. Alternatively, the processor 180 may control the display 160 to display a screen including text asking whether to add the audio cluster to the multiple noise clusters.

[0170] For example, the processor 180 may control the speaker 150 to output a voice message such as “Do you want to add the currently acquired audio cluster to the noise cluster?” or “Do you want to add the currently acquired audio cluster to the cloud?”.

[0171] Alternatively, the processor 180 may provide a UI including text (such as “Do you want to add the currently acquired audio cluster to the noise cluster?” or “Do you want to add the currently acquired audio cluster to the cloud?”) through the display 160 .

[0172] Alternatively, the processor 180 may send information for displaying a UI to the user terminal device, the UI including text such as “Do you want to add the currently acquired audio cluster to the noise cluster?” or “Do you want to add the currently acquired audio cluster to the cloud?”.

[0173] In addition, the processor 180 may obtain a user input of whether to add an audio cluster to a noise cluster through the communication interface 120 , the user interface 130 , or the microphone 140 .

[0174] If a user input not to add the audio cluster to the plurality of noise clusters is acquired (S1210-N), the processor 180 may delete the information about the audio cluster stored in the memory.

[0175] If a user input of adding an audio cluster to a plurality of noise clusters is acquired ( S1210 -Y), the processor 180 may acquire label information of the audio cluster ( S1230 ).

[0176] Specifically, the processor 180 may obtain the label information of the audio cluster through the communication interface 120, the user interface 130, or the microphone 140. Here, the label may be text information defining the audio cluster. Specifically, the label of the audio data may be text information defining the type of the audio cluster. For example, the label of the audio data may be "office noise", "alarm sound", "music sound", "lecture sound", "sound heard in front of the electronic device 100", "sound heard from the side of the electronic device", "sound heard from the back of the electronic device 100", etc.

[0177] Here, the processor 180 may provide the user with information for inquiring about the label of the audio cluster to obtain the label information of the audio cluster. Specifically, the processor 180 may output a voice for inquiring about the label of the audio cluster through the speaker 150. Alternatively, the processor 180 may display a screen including text for inquiring about the label of the audio cluster through the display 160.

[0178] For example, the processor 180 may output a voice message through the speaker 150, such as "Please define the currently acquired audio," "What is the type of the currently acquired audio?" or "Please enter a label for the currently acquired audio cluster."

[0179] Alternatively, the processor 180 may provide a UI including text (such as “Please define the currently acquired audio,” “What is the type of the currently acquired audio?” or “Please enter a label for the currently acquired audio cluster”) through the display 160 .

[0180] Here, the processor 180 may acquire a user voice input for inputting a label of an audio cluster through the microphone 140 .

[0181] Alternatively, the processor 180 may acquire a user input for inputting a label of the audio cluster through the user interface 130. Here, the processor 180 may acquire a user input for inputting a label of the audio cluster through a UI provided by the display 160.

[0182] Alternatively, the processor 180 may acquire information about the label of the audio cluster through the communication interface 120 .

[0183] In addition, the processor 180 can obtain a user input for setting the anti-noise level of the audio cluster. Here, the processor 180 can provide the user with information for inquiring the anti-noise level of the audio cluster to obtain the anti-noise level of the audio cluster. Specifically, the processor 180 can output a voice for inquiring the anti-noise level of the audio cluster through the speaker 150. Alternatively, the processor 180 can display a screen including text for inquiring the anti-noise level of the audio cluster through the display 160.

[0184] Furthermore, the processor 180 may add the information about the audio cluster to the information about the plurality of noise clusters stored in the memory and transmit the information about the audio cluster to the external server 200 .

[0185] Accordingly, the external server 200 may update the information about the plurality of noise clusters stored in the external server 200 using the received information about the audio cluster.

[0186] Fig.13 is a flowchart for describing a method for updating information about noise clusters of a server according to an embodiment of the present disclosure.

[0187] The server 200 may acquire information about the audio cluster from the electronic device 100 (S1310). Here, the information about the audio cluster acquired from the electronic device 100 may include at least one of a feature of an audio signal, metadata, or tag information.

[0188] In addition, the server 200 may acquire features of the audio cluster based on the acquired information about the audio cluster (S1320). Specifically, the server 200 may acquire features of at least one of features of the audio signal, features of metadata, or features of tag information, and acquire a feature vector thereof.

[0189] In addition, the server 200 may identify whether there is a noise cluster corresponding to the audio cluster acquired from the information about the plurality of noise clusters stored in the server 200 (S1330). That is, the server 200 may identify whether the acquired information about the noise cluster matching the audio cluster is stored in the server 200.

[0190] Accordingly, if there is no noise cluster corresponding to the audio cluster (S1330-N), the server 200 may add the acquired information about the audio cluster to the information about the plurality of noise clusters.

[0191] Accordingly, the server 200 may continuously update the information about the noise clusters stored in the server 200 by using the information about the audio clusters acquired from the user.

[0192] Here, the server 200 may store information about a plurality of noise clusters for a user account of the electronic device 100. Accordingly, the information about a plurality of noise clusters corresponding to the user account and stored in the server 200 may be continuously updated to be optimized for the user.

[0193] In addition, if there is a noise cluster corresponding to the audio cluster (S1330-Y), the server 200 may update the noise cluster corresponding to the audio cluster. That is, the server 200 may merge the acquired information about the audio cluster and the information about the noise cluster corresponding to the audio cluster. Alternatively, the server 200 may separate the acquired information about the noise cluster and the information about the noise cluster corresponding to the audio cluster from each other and store them in the memory of the server 200.

[0194] Meanwhile, the term "device" or "module" used in the present disclosure may include a unit including hardware, software or firmware, and may be used interchangeably with terms such as logic, logic block, component or circuit. A "device" or "module" may be an integrally formed component, or a minimum unit or part that performs one or more functions. For example, a module may include an application specific integrated circuit (ASIC).

[0195] Various embodiments of the present disclosure may be implemented as software including instructions stored on a machine-readable storage medium (e.g., a computer-readable storage medium). A machine may be a device that calls stored instructions from a storage medium, may operate based on the called instructions, and may include the electronic device 100 in the disclosed embodiment. If the instruction is executed by a processor, the processor may directly execute the function corresponding to the instruction, or other components may execute the function corresponding to the instruction under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory" means that the storage medium is physical and does not include signals, and does not distinguish whether the data is stored semi-permanently or temporarily in the storage medium.

[0196] According to an embodiment, the method according to various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be downloaded through an application store (e.g., PlayStore). TM ) Online distribution. In the case of online distribution, at least a part of the computer program product may be at least temporarily stored or temporarily arranged in a storage medium, such as a memory of a manufacturer's server, an application store's server or a relay server.

[0197] Each component (e.g., module or program) according to various embodiments may include one entity or multiple entities, and some of the corresponding subcomponents described above may be omitted, or other subcomponents may be included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into one entity, and the functions performed by the respective corresponding components before integration may be performed in the same or similar manner. The operations performed by the modules, programs or other components according to various embodiments may be performed in a sequential manner, in a parallel manner, in an iterative manner or in a heuristic manner, and at least some operations may be performed in a different order or omitted, or other operations may be added.

Claims

1. A control method of an electronic device capable of generating anti-noise for acoustic noise cancellation (ANC), the control method comprising: Acquire audio data and metadata of the audio data; Classifying the audio data into a plurality of audio clusters based on features of the audio data or features of the metadata; detecting whether each of the plurality of audio clusters is included in a plurality of pre-stored noise clusters; as well as Information about an audio cluster not included in the plurality of noise clusters among the plurality of audio clusters is added to information about the plurality of noise clusters.

2. The control method according to claim 1, wherein: When detecting whether each of the plurality of audio clusters is included in the plurality of pre-stored noise clusters, Based on the presence of a noise cluster matching one of the plurality of audio clusters in the plurality of noise clusters, the one of the plurality of audio clusters is detected as being included in the plurality of noise clusters.

3. The control method according to claim 2, wherein: When detecting whether each of the plurality of audio clusters is included in the plurality of pre-stored noise clusters, obtaining a similarity value between the one audio cluster among the multiple audio clusters and a noise cluster among the multiple noise clusters, and Based on the similarity value being greater than or equal to a predetermined value, the one of the plurality of noise clusters is identified as a noise cluster that matches the one of the plurality of audio clusters.

4. The control method according to claim 1, wherein: When adding information about an audio cluster not included in the plurality of noise clusters among the plurality of audio clusters to information about the plurality of noise clusters, receiving information about an audio cluster not included in the plurality of noise clusters from an external server, and Information about an audio cluster not included in the plurality of noise clusters is added to information about the plurality of noise clusters.

5. The control method according to claim 1, wherein: When adding information about an audio cluster not included in the plurality of noise clusters among the plurality of audio clusters to information about the plurality of noise clusters, obtaining a user input for inputting identification information of an audio cluster not included in the plurality of noise clusters, and The information about the audio cluster including the identification information is added to the information about the plurality of noise clusters.

6. The control method according to claim 5, wherein: When adding information about an audio cluster not included in the plurality of noise clusters among the plurality of audio clusters to information about the plurality of noise clusters, outputting a sound asking whether to add the information about the audio cluster to the information about the plurality of noise clusters, and Based on acquiring a user voice for adding information about the audio cluster to information about the plurality of noise clusters, a user input for inputting identification information of an audio cluster not included in the plurality of noise clusters is acquired.

7. The control method according to claim 1, further comprising: For each audio cluster included in the plurality of noise clusters among the plurality of audio clusters, anti-noise data of a level corresponding to a noise cluster matching the audio cluster is generated.

8. The control method according to claim 7, wherein: The plurality of audio clusters include a first audio cluster and a second audio cluster, and Wherein, when generating the anti-noise data, generating first anti-noise data of a first level for the first audio cluster, the first level corresponding to a first noise cluster among the plurality of noise clusters that matches the first audio cluster, and Second anti-noise data of a second level is generated for the second audio cluster, the second level corresponding to a second noise cluster among the plurality of noise clusters that matches the second audio cluster.

9. The control method according to claim 1, wherein: When classifying the audio data into the plurality of audio clusters, Acquire multiple audio segments by segmenting the audio data, Acquire a plurality of feature data by extracting features of the plurality of audio segments, and Based on the plurality of feature data, the plurality of audio segments are classified into a plurality of audio clusters.

10. The control method according to claim 1, wherein: The metadata of the audio data includes location information of a location where the audio data is acquired.

11. An electronic device capable of generating anti-noise for acoustic noise cancellation (ANC), the electronic device comprising: sensor; microphone; speaker; a memory storing information about a plurality of noise clusters and at least one instruction; as well as a processor connected to the memory and configured to control the electronic device, The processor is configured to execute the at least one instruction to perform the following operations: Acquire audio data and metadata of the audio data through the microphone and the sensor, Based on the characteristics of the audio data or the characteristics of the metadata, the audio data is classified into a plurality of audio clusters, detecting whether each of the plurality of audio clusters is included in the plurality of noise clusters, and Information about an audio cluster not included in the plurality of noise clusters among the plurality of audio clusters is added to information about the plurality of noise clusters.

12. The electronic device according to claim 11, wherein: The processor is configured to detect one of the plurality of audio clusters as being included in the plurality of noise clusters based on the presence of a noise cluster matching the one of the plurality of audio clusters among the plurality of noise clusters.

13. The electronic device according to claim 12, wherein: The processor is configured to: obtaining a similarity value between the one audio cluster among the multiple audio clusters and a noise cluster among the multiple noise clusters, and Based on the similarity value being greater than or equal to a predetermined value, the one of the plurality of noise clusters is identified as a noise cluster that matches the one of the plurality of audio clusters.

14. The electronic device according to claim 11, wherein: The processor is configured to: receiving information about an audio cluster not included in the plurality of noise clusters from an external server, and Information about an audio cluster not included in the plurality of noise clusters is added to information about the plurality of noise clusters.

15. The electronic device according to claim 11, wherein: The processor is configured to: obtaining a user input for inputting identification information of an audio cluster not included in the plurality of noise clusters, and The information about the audio cluster including the identification information is added to the information about the plurality of noise clusters.

Images