Electronic device and electronic device control method
The electronic device addresses the limitations of existing crossover filters by dynamically adjusting the slope of the crossover filter based on music content properties and user preferences, resulting in improved sound quality and user experience.
Patent Information
- Application Number
- PCT/KR2024/019375
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-01
- Filing Date
- 2024-11-29
- Publication Date
- 2025-06-05
AI Technical Summary
Existing crossover filters in multi-way speaker technology have limited functionality and only provide adaptive balance of frequency response or crossover frequency, failing to accommodate various user tastes and music content properties effectively.
An electronic device equipped with a processor that adjusts the slope of a crossover filter based on the properties of music content and user preferences, allowing for dynamic filtering of audio signals across different frequency bands.
The solution enables more tailored sound output that better suits individual user tastes and the characteristics of different music content, enhancing sound quality and user experience.
Smart Images

Figure KR2024019375_05062025_PF_FP_ABST
Abstract
Description
Electronic devices and methods of controlling electronic devices
[0001] The present disclosure relates to an electronic device and a method for controlling the electronic device, and more particularly, to an electronic device capable of controlling a crossover filter and a method for controlling the same.
[0002] Speaker technology is constantly evolving, moving towards higher resolution, higher sound quality, wireless and smart features, smaller size, and more efficient energy use.
[0003] In particular, in multi-way speaker technology that can reproduce sounds of different frequency bands using multiple speaker units, the performance of the crossover filter that enables each speaker unit to operate in the optimal frequency range is an important issue.
[0004] However, the commonly used crossover filters have limited functions considering various user tastes and requirements, and only provide adaptive balance of frequency response or crossover frequency, while fixing the slope of the crossover filter to a constant value.
[0005] Therefore, there is a need for technology that can provide sound more suitable for the various properties of music content and play music content that better suits the tastes of individual users.
[0006] The present disclosure is made in response to the aforementioned necessity, and the purpose of the present disclosure is to provide an electronic device and a control method thereof capable of controlling a crossover filter according to the properties of music content and the user's taste.
[0007] According to one or more embodiments for achieving the above-described object, an electronic device includes a crossover filter for separating an input audio signal into a plurality of different frequency bands, a speaker including a plurality of speaker units corresponding to each of the plurality of frequency bands, a memory for storing data on music content, and a processor for controlling the crossover filter to adjust a slope related to a range in which the crossover filter filters audio signals of each of the plurality of frequency bands based on at least one of a property of the music content and a user's taste for sound, and to filter an audio signal corresponding to the music content according to the adjusted slope while the music content is output through the speaker.
[0008] Meanwhile, the data includes metadata indicating properties of the music content, and the processor can identify properties of the music content based on the metadata.
[0009] Meanwhile, the electronic device further includes an input unit, and the processor can adjust the inclination based on at least one of the user's taste and the properties of the music content when a user input for selecting the user's taste is received through the input unit.
[0010] Meanwhile, the processor can identify an attribute of the music content based on at least one of the genre of the music content, the performer of the music content, and the type of instrument used in the music content included in the metadata.
[0011] Meanwhile, the plurality of speaker units may include a woofer that outputs sound in a low-frequency band and a tweeter that outputs sound in a frequency band higher than the low-frequency band.
[0012] Meanwhile, if the property of the music content is a first property that includes a transient characteristic above a preset threshold level, the processor can adjust the slope to correspond to a first filter, and if the property of the music content is a second property that includes the transient characteristic below the threshold level, the processor can adjust the slope to correspond to a second filter that has a higher slope than the first filter.
[0013] Meanwhile, the electronic device further includes a sensor unit including at least one sensor, and the processor obtains information on a user's listening height through the sensor unit, and if a difference between the user's listening height and a preset reference height is greater than a threshold value, the processor can control the speaker to output the music content by compensating for a delay caused by the difference between the listening height and the reference height.
[0014] Meanwhile, the processor obtains information about the location of at least one user through the sensor unit, and if the location of the at least one user is identified as being outside a preset threshold range based on the information about the location of the user, the processor can adjust the slope to correspond to a third filter having a higher slope than the second filter.
[0015] Meanwhile, the processor may control the crossover filter to identify properties of the music content for each section of the music content based on a pattern of an audio signal corresponding to the music content while the music content is output through the speaker, adjust the slope for each section based on the properties of the music content identified for each section, and filter the audio signal corresponding to the music content according to the slope adjusted for each section.
[0016] Meanwhile, the electronic device further includes an output unit, and the processor can control the output unit to output information for guiding the type of filter corresponding to the adjusted slope while the music content is output through the speaker.
[0017] Meanwhile, the processor can identify the properties of the music content by inputting the metadata into a neural network model trained to output information on the properties of the music content.
[0018] According to one or more embodiments for achieving the above-described object, a method for controlling an electronic device includes a step of adjusting a slope related to a range in which a crossover filter included in a speaker and dividing an input audio signal into a plurality of different frequency bands filters an audio signal of each of the plurality of frequency bands based on at least one of a property of the music content and a user's taste for sound, and a step of controlling the crossover filter to filter an audio signal corresponding to the music content according to the adjusted slope while the music content is output.
[0019] Meanwhile, the control method of the electronic device may further include a step of identifying properties of the music content based on metadata indicating properties of the music content.
[0020] Meanwhile, the step of adjusting the slope may include a step of adjusting the slope based on at least one of the user's taste and the properties of the music content when a user input for selecting the user's taste is received.
[0021] Meanwhile, the step of identifying the property of the music content may include a step of identifying the property of the music content based on at least one of the genre of the music content, the performer of the music content, and the type of instrument used in the music content included in the metadata.
[0022] Meanwhile, the plurality of speaker units may include a woofer that outputs sound in a low-frequency band and a tweeter that outputs sound in a frequency band higher than the low-frequency band.
[0023] Meanwhile, the step of adjusting the slope may include a step of adjusting the slope to correspond to a first filter if the property of the music content is a first property that includes a transient characteristic above a preset threshold level, and a step of adjusting the slope to correspond to a second filter having a higher slope than the first filter if the property of the music content is a second property that includes the transient characteristic below the threshold level.
[0024] Meanwhile, the control method of the electronic device may further include a step of obtaining information on a user's listening height, and a step of outputting the music content by compensating for a delay caused by a difference between the user's listening height and the preset reference height if the difference between the user's listening height and the preset reference height is greater than a threshold value.
[0025] Meanwhile, the control method of the electronic device may further include a step of obtaining information on the location of at least one user, and a step of adjusting the slope to correspond to a third filter having a higher slope than the second filter, if the location of the at least one user is identified as being outside a preset threshold range based on the information on the location of the user.
[0026] According to one or more embodiments for achieving the above-described purpose, in a non-transitory computer-readable recording medium including a program for executing a method for controlling an electronic device, the method for controlling the electronic device may include a method as described in the above aspect.
[0027] According to the present disclosure, a device and method as described in the attached independent claim are provided. Other features of the present disclosure will become apparent from the dependent claims and the description that follows.
[0028] FIG. 1 is a block diagram briefly showing the configuration of an electronic device according to an embodiment of the present disclosure;
[0029] Figure 2 is a drawing for explaining the slope of the first filter;
[0030] Figure 3 is a drawing for explaining the slope of the second filter.
[0031] FIG. 4 is a block diagram showing in detail the configuration of an electronic device according to an embodiment of the present disclosure;
[0032] Figures 5 and 6 are drawings for explaining controlling the speaker according to the user's listening height.
[0033] Figure 7 is a drawing for explaining controlling the speaker according to the user's position.
[0034] FIG. 8 is a flowchart showing a control method of an electronic device according to an embodiment of the present disclosure, and
[0035] FIG. 9 is a sequence diagram illustrating the operation of an electronic device and an audio output device according to an embodiment of the present disclosure.
[0036] The present embodiments may be subject to various modifications and may include multiple embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, it should be understood that various modifications, equivalents, and / or alternatives are possible. In connection with the description of the drawings, similar reference numerals may be used for similar components.
[0037] Detailed descriptions of related notification functions or configurations are omitted to avoid unnecessarily obscuring the gist of the present disclosure.
[0038] In addition, the following examples may be modified in various ways. These examples are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.
[0039] The terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.
[0040] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.
[0041] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.
[0042] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.
[0043] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).
[0044] On the other hand, when it is said that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component), it can be understood that no other component (e.g., a third component) exists between said component and said other component.
[0045] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.
[0046] Instead, in some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.
[0047] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.
[0048] Meanwhile, the various elements and areas in the drawings are schematically drawn. The technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.
[0049] Hereinafter, with reference to the attached drawings, embodiments according to the present disclosure will be described in detail so that a person having ordinary knowledge in the technical field to which the present disclosure pertains can easily implement the present disclosure.
[0050] FIG. 1 is a block diagram briefly illustrating the configuration of an electronic device (100) according to an embodiment of the present disclosure, FIG. 2 is a drawing for explaining the slope of a first filter, and FIG. 3 is a drawing for explaining the slope of a second filter. Hereinafter, descriptions will be made with reference to FIGS. 1 to 3 together.
[0051] As illustrated in FIG. 1, an electronic device (100) according to the present disclosure includes a speaker (110), a memory (130), and a processor (140).
[0052] The term "electronic device (100)" refers to a device operable to control a crossover filter (120). For example, the electronic device (100) may be a speaker (110) device, an audio output device (200), headphones, earphones, etc., and may also be implemented as various types of devices such as a smartphone, a tablet PC, a TV, etc. There is no particular limitation to the types of other electronic devices (100) in the present disclosure.
[0053] A speaker (110) refers to a configuration capable of outputting sound. Specifically, the speaker (110) can be capable of outputting music content. The speaker (110) may include a plurality of speaker units (111).
[0054] The term "multiple speaker units (111)" refers to a configuration capable of outputting sound across multiple different frequency bands. Each of the multiple individual speaker units (111) can be implemented to suit a specific frequency band. There is no particular limitation on the number of multiple speaker units (111).
[0055] Meanwhile, a speaker (110) including a plurality of speaker units (111) may be referred to as a 'multi-way speaker', and in particular, a speaker (110) including only two speaker units (111) may be referred to as a 'two-way speaker'. Similarly, a 'three-way speaker' may be understood to refer to a speaker (110) including only three speaker units.
[0056] For example, when the speaker (110) is implemented as a two-way speaker, the plurality of speaker units (111) include a 'woofer' that outputs sound in a low-frequency band and a 'tweeter' that outputs sound in a frequency band higher than the low-frequency band output by the woofer. The low-frequency band and the frequency band higher than the low-frequency band may or may not overlap to some extent. For another example, when the speaker (110) is implemented as a three-way speaker, the plurality of speaker units (111) may include a woofer that outputs sound in a low-frequency band, a 'mid-range unit' that outputs sound in a mid-range band that is a higher frequency band than the low-frequency band output by the woofer, and a tweeter that outputs sound in a high-frequency band that is a higher frequency band than the mid-range band output by the mid-range unit. Speaker unit configurations other than the examples described above, such as 2.5 way and 4 way, are also possible. The “x.5” configuration refers to an example in which one of the speaker units (111) outputs sound across two frequency ranges. As another example, if the speaker (110) is implemented as a 2.5-way speaker, three speaker units (111) may be provided, including one woofer that outputs sound in the low-frequency band, a tweeter that outputs sound in the high-frequency band, and an additional woofer that outputs sound in the low-frequency band and mid-range.
[0057] A 'crossover filter (120)' refers to a filter that can separate an input audio signal into multiple different frequency bands. Specifically, the crossover filter (120) can be configured to filter an input audio signal for each of the multiple frequency bands. The crossover filter (120) is characterized by its influence on audio signals of different frequency ranges according to the crossover frequency and slope for the different frequency ranges. The crossover filter (120) can be installed inside an amplifier (e.g., 150 of FIG. 4) or can be included inside a processor (140) in the form of a separate DSP (Digital Signal Processor) block.
[0058] The crossover filter (120) can be implemented as a digital filter or an analog filter. In addition, the crossover filter can be implemented as various filters such as an IIR filter (infinite impulse response filter) and an FIR filter (finite impulse response filter). An IIR filter is a filter whose output is calculated as a combination of the current input signal and the previous output signal and has a theoretically infinite impulse response, and refers to a filter whose output is calculated as a linear combination of the current input signal and the values of several previous input signals.
[0059] In the present disclosure, the 'slope' of the crossover filter (120) refers to a parameter representing the attenuation characteristics of the filter in a range in which audio signals of each of a plurality of frequency bands are filtered. Specifically, the slope of the crossover filter (120) may represent the degree to which the crossover filter (120) blocks signals of a specific range of frequency bands. The term 'slope' of the crossover filter (120) may be simply referred to as 'slope', and may also be replaced with terms such as 'order', 'parameter', 'factor', etc.
[0060] Slope can be expressed in dB / octave (decibels per octave) or dB / decade (decibels per decade), where an "octave" represents doubling the frequency range, and a "decade" represents ten times the frequency range. For example, a first-order high-pass filter and low-pass filter would have a slope of 6 dB / octave, meaning that they attenuate the signal by 6 dB per octave.
[0061] By adjusting the slope of the crossover filter (120), the crossover filter (120) can operate as one of various types of filters depending on the adjusted slope. Specifically, a crossover filter (120) having a slope of 6 dB / octave can be referred to as a 'first order filter', and a crossover filter (120) having a slope of 12 dB / octave can be referred to as a 'second order filter'. Furthermore, a crossover filter (120) having a slope of 6n dB / octave (where n is a natural number) can be referred to as an 'n-order filter'. Meanwhile, in the present disclosure, the term 'adjust' can be replaced with terms such as 'transform', 'change (alter)', or 'modulate'.
[0062] Fig. 2 shows the slope (dotted line in Fig. 2) when the crossover filter (120) of the three-way speaker operates as a first-order filter, and Fig. 3 shows the slope (dotted line in Fig. 3) when the crossover filter (120) operates as a fourth-order filter.
[0063] As illustrated in FIG. 2, if the slope of the crossover filter (120) is gently adjusted to correspond to the characteristics of the first-order filter, the crossover filter (120) can block signals at a reduced speed near the frequency division point. Specifically, the crossover filter (120) can mix signals in the crossover band while minimizing group delay near the frequency division point. Therefore, in this case, the frequency band corresponding to each of the plurality of speaker units (111) can be gradually changed. Therefore, when the slope is steep, the signals output from the crossover filter (120) to the individual speaker units (111) of the plurality of speaker units (111) can overlap relatively more between the plurality of speaker units (111).
[0064] If the slope of the crossover filter (120) is gently adjusted to correspond to a first-order filter, a lot of overlap occurs between signals output from the crossover filter (120) to individual speaker units (111) of the plurality of speaker units (111), so while the expressiveness of music content with emphasized transient characteristics is excellent, it may be disadvantageous in terms of vertical / horizontal directivity.
[0065] On the other hand, if the slope of the crossover filter (120) is steeply adjusted to correspond to the characteristics of a 4th-order filter as illustrated in FIG. 3, the crossover filter (120) can block signals at a relatively faster rate near the frequency division point. Specifically, the crossover filter (120) can minimize mixing of signals near the frequency division point (i.e., crossover band) compared to the 1st-order filter. Therefore, in this case, the frequency bands corresponding to each of the plurality of speaker units (111) can be clearly distinguished, and accordingly, the overlap between signals output from the crossover filter (120) to the plurality of speaker units (111) can be reduced.
[0066] If the slope of the crossover filter (120) is steeply adjusted to correspond to the characteristics of a 4th-order filter, the overlap between signals output from the crossover filter (120) to multiple speaker units (111) can be minimized, so that it is relatively superior to a 1st-order filter in terms of uniformity of vertical / horizontal directivity, but the steep slope causes more group delay compared to the 1st-order filter, and it is disadvantageous in terms of accurate time domain alignment between units. The more accurate the time alignment is in a wide frequency range, the closer the music content can be to the sound that the listener perceives as an actual performance. Therefore, when the crossover filter (120) is configured with the characteristics of a 4th-order filter, the expressive power for music content with emphasized transient characteristics may be relatively disadvantageous compared to when it is configured with the characteristics of a 1st-order filter.
[0067] Meanwhile, in the above, an example of configuring a crossover filter (120) having the characteristics of a first-order filter and a fourth-order filter has been described by comparison, but this is only for the convenience of explanation, and the characteristics of each of the first-order filter and the fourth-order filter described above and the differences between the two can also be applied to a crossover filter (120) having a high slope and a low slope.
[0068] Meanwhile, in the present disclosure, adjusting the slope of the crossover filter (120) to correspond to an n-th order filter does not mean adjusting the slope of the crossover filter (120) itself to an n-th order, but may mean adjusting the slope of the crossover filter (120) so that the sound output as a result through the crossover filter (120) and the speaker (110) including a plurality of speaker units (111) becomes acoustically an n-th order.
[0069] The memory (130) may store at least one instruction regarding the electronic device (100). In addition, the memory (130) may store an O / S (Operating System) for driving the electronic device (100). In addition, the memory (130) may store various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure. The memory (130) may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.
[0070] Specifically, the memory (130) may store various software modules for operating the electronic device (100) according to various embodiments of the present disclosure, and the processor (140) may control the operation of the electronic device (100) by executing the various software modules stored in the memory (130). That is, the memory (130) is accessed by the processor (140), and data reading / recording / modifying / deleting / updating, etc. may be performed by the processor (140).
[0071] Meanwhile, in the present disclosure, the term memory (130) may be used to mean a memory (130), a ROM, a RAM in a processor (140), or a memory card (e.g., a micro SD card, a memory stick) mounted in an electronic device (100).
[0072] In particular, in one or more embodiments, the memory (130) may store data regarding music content. Here, the music content may be stored in the form of digitally encoded samples, and the data for the music content may further include metadata regarding the music content. That is, the data for the music content may include both data that can be decoded into a form suitable for listening and a description of the audible content itself or metadata related thereto.
[0073] In addition, the memory (130) may store various information, such as information corresponding to one or more parameters including the slope of the crossover filter (120), information for identifying one or more properties of music content, information for classifying properties of music content, information related to a slope to be used for the corresponding property of music content, information about the user's listening height, information about the user's location, information for guiding the selection or operation of a type of filter corresponding to the adjusted slope, etc.
[0074] In addition, various information necessary within the scope of achieving the purpose of the present disclosure may be stored in the memory (130), and the information stored in the memory (130) may be updated as received from an external device or input by a user.
[0075] The processor (140) controls the overall operation of the electronic device (100). Specifically, the processor (140) is connected to the configuration of the electronic device (100) including the speaker (110) and the memory (130), and may be configured to control the overall operation of the electronic device (100) by executing at least one instruction stored in the memory (130) as described above.
[0076] The processor (140) may be implemented in various ways. For example, the processor (140) may be implemented as at least one of an application-specific integrated circuit (ASIC), an embedded processor, a microprocessor, hardware control logic, a hardware finite state machine (FSM), and a digital signal processor (DSP). Meanwhile, the term "processor (140)" in the present disclosure may be used to mean a central processing unit (CPU), a graphic processing unit (GPU), and a microprocessor unit (MPU).
[0077] The processor (140) may be configured to process an audio signal corresponding to music content, obtain a control signal for controlling the operation of a plurality of speaker units (111) and a crossover filter (120), and perform various operations such as adjusting the frequency response of the audio signal.
[0078] The processor (140) may be configured to adjust a slope associated with a range in which the crossover filter (120) filters audio signals of each of the plurality of frequency bands based on at least one of the properties of the music content and the user's taste in sound.
[0079] In particular, the processor (140) can output music content by adjusting the slope of the crossover filter (120) based on the properties of the music content. And / or, the processor (140) can also output music content by adjusting the slope of the crossover filter (120) according to sound preference settings determined from a user input for selecting the user's sound taste. Hereinafter, an embodiment of outputting music content by adjusting the slope of the crossover filter (120) based on at least one property of the music content will first be described.
[0080] In one or more embodiments, the processor (140) may adjust the slope of the crossover filter (120) based on properties of the music content.
[0081] In the present disclosure, the 'attributes of music content' can be classified according to whether each music content is suitable for being provided to a user using a filter of a certain order corresponding to the slope of the crossover filter (120).
[0082] For example, the properties of music content can be distinguished based on whether or not it contains transient characteristics above a predetermined threshold level. "Transient characteristics" refer to the characteristics of the audio signal corresponding to the music content where there is abrupt change. For example, the sudden change in sound produced by a percussion instrument when struck, or the change in sound when a specific instrument begins or ends its performance, may exhibit transient characteristics.
[0083] For example, in musical content such as a piano solo, where the expressiveness of percussive sounds based on the time and strength of the keystroke and the transient characteristics are emphasized, utilizing a first-order filter may be desirable to provide users with superior expressiveness and more coherent musical content. Conversely, in musical content such as an orchestral concerto, where continuous sounds are important, utilizing a fourth-order filter may be desirable.
[0084] In addition to the transient characteristics, it can be determined based on various criteria whether each music content is appropriately provided to the user using a filter of a certain order according to the slope of the crossover filter (120).
[0085] The processor (140) can identify an attribute of at least one piece of music content based on metadata about the music content. Specifically, when a playback request for the music content is received, the processor (140) can identify an attribute of the music content based on metadata about the music content. Additionally or alternatively, the processor (140) can identify an attribute of the music content based on metadata about the music content before a playback request for the music content is received, and then, when a playback request for the music content is received, the processor (140) can adjust the slope of the crossover filter (120) using the identified attribute of the music content.
[0086] The processor (140) can identify attributes of music content based on at least one of the genre of the music content, the performer of the music content, and the type of instrument used in the music content, as examples of data types included in metadata for the music content. In addition, various pieces of information included in the metadata can be used to identify one or more attributes of the music content.
[0087] Furthermore, the processor (140) may input metadata into a neural network model trained to output information, such as a classification of attributes of the music content, to identify one or more attributes of the music content. Specifically, the neural network model may be trained to classify attributes of the music content corresponding to information included in the input metadata and output information about the attributes of the music content, and the processor (140) may identify attributes of the music content using the trained neural network model.
[0088] The processor (140) can adjust the slope of the crossover filter (120) to correspond to a predefined type of filter based on one or more properties of the music content.
[0089] For example, if the attribute of the music content is a first attribute that includes a transient characteristic above a preset threshold level, the processor (140) can adjust the slope to correspond to the first filter. If the attribute of the music content is a second attribute that includes a transient characteristic below the threshold level, the processor (140) can adjust the slope to correspond to a second filter that has a higher slope than the first filter. In this example, the first filter may be a first-order filter that has a gentler slope than the second filter, and the second filter may be a fourth-order filter that has a steeper slope than the first filter.
[0090] In one or more embodiments, the processor (140) may alternatively or additionally adjust the slope of the crossover filter (120) based on the user's taste in sound, as determined, for example, by the user's sound preference settings.
[0091] Specifically, the processor (140) may obtain information about the user's taste by receiving user input for selecting a setting corresponding to the user's taste in sound, such as received through the input unit (170) of the electronic device (100). Additionally or alternatively, the processor (140) may receive information about the user's taste by receiving user input for selecting a setting corresponding to the user's taste in sound from an external device through the communication unit (190) of the electronic device (100).
[0092] Here, 'user's preference' refers to information about which order filter the user prefers to use to reproduce music content according to the slope of the crossover filter (120). For example, the user may prefer to use a first-order filter according to the gentle slope of the crossover filter (120) in the case of music content with emphasized transient characteristics (e.g., piano solo, drum solo, percussion performance, etc.), and in the case of preferring to listen to a stable sound stage (advantageous when vertical and horizontal directivity are strong), the crossover filter (120) may prefer a fourth-order filter.
[0093] In one embodiment, the processor (140) can adjust the slope of the crossover filter (120) using both information about the properties of the music content and information about the user's taste.
[0094] The processor (140) can adjust the slope of the crossover filter (120) to match the user's preference, regardless of the properties of the music content. In some cases, the crossover filter (120) is initially released with a 4th-order slope in the initial shipping mode, and the user can change it to a desired setting after purchase. Thereafter, the user's desired setting can become the default setting, and the electronic device (100) can provide a crossover filter (120) that continuously operates using the changed setting.
[0095] On the other hand, even if a user generally prefers music content to be presented using a fourth-order filter, it may be preferable to present music content with emphasized transient characteristics, such as a piano solo, to the user using a first-order filter. Accordingly, the processor (140) may prioritize the properties of the music content regardless of the user's taste and adjust the slope of the crossover filter (120) to correspond to the user's taste. In these examples, the user's taste may be dependent on the properties of the music content when determining the characteristics of the crossover filter (120).
[0096] Meanwhile, the processor (140) assigns weights to each of information about the user's taste and the properties of the music content, calculates score information according to the weighted sum of the information about the user's taste and the properties of the music content, and may also adjust the slope of the crossover filter (120) based on the calculated score information.
[0097] The processor (140) can control the crossover filter (120) to filter an audio signal corresponding to the music content according to the adjusted slope while the music content is output as audio through the speaker (110). That is, the slope adjustment can be performed simultaneously while audio is continuously output from the speaker (110).
[0098] Specifically, the processor (140) can transmit a control signal to the crossover filter (120) to adjust the slope of the crossover filter (120) to a slope corresponding to at least one of the properties of the music content and the user's taste. Then, the speaker (110) can filter an audio signal corresponding to the music content according to the adjusted slope using the crossover filter (120) and then output the music content through a plurality of speaker units (111).
[0099] In the above, an embodiment of identifying properties of music content based on metadata about the music content has been described, but in one or more embodiments, the processor (140) may also identify properties of music content based on a pattern of an audio signal corresponding to the music content.
[0100] Specifically, the processor (140) can identify the properties of the music content based on whether the pattern of the audio signal corresponding to the music content is impulsive. For example, the audio signal corresponding to the music content may include a pattern of an impulsive signal. An 'impulsive signal' appears as a signal with high frequency components in the frequency domain because it includes a sudden high-energy impulse, and may appear in a form that changes abruptly in the time domain.
[0101] In addition, the continuity of the audio signal, whether the audio signal includes a predefined type of pattern, etc. can be used in the process of identifying properties of music content based on patterns of the audio signal.
[0102] In particular, the processor (140) can identify the properties of the music content for each section of the music content based on the pattern of the audio signal corresponding to the music content while the music content is being output through the speaker (110). In other words, the processor (140) can analyze the properties of the music content in real time while the music content is being output as an audio signal, and in particular, can identify the properties of the music content for each section constituting the music content, particularly for each section of time.
[0103] When the properties of the music content are identified for each section, the processor (140) can control the crossover filter (120) to adjust the slope for each section based on the properties of the music content identified for each section from one section to the next while the audio signal is being played, and to filter the audio signal corresponding to the music content according to the slope adjusted for each section.
[0104] For example, the processor (140) may analyze the music content of the second section following the first section while outputting the music content of the first section, and control the crossover filter (120) to filter the audio signal corresponding to the second section of the music content according to a slope corresponding to a first-order filter based on the analysis result. In addition, the processor (140) may analyze the music content of the third section following the second section while outputting the music content of the second section, and control the crossover filter (120) to filter the audio signal corresponding to the second section of the music content according to a slope corresponding to a fourth-order filter based on the analysis result.
[0105] Considering the sections, the processor (140) may control the crossover filter to filter the music content by adjusting the slope based on the average properties of the entire section rather than the instantaneous properties within the section of the music content, based on the pattern of the audio signal while playing the music content.
[0106] According to the above-described embodiment with reference to FIGS. 1 to 3, the electronic device (100) can provide the user with optimal playback of music content that matches the properties of the music content by controlling the slope of the crossover filter (120) according to the properties of the music content. In other words, the electronic device (100) can automatically provide optimal crossover settings based on metadata about the music content by using the speaker (110), thereby maximizing the advantages of the crossover design for the speaker (110). That is, the above operation can be advantageous when playing music content in a single speaker (110) including a plurality of speaker units (111), for example, when the music content is played in a mono audio format.
[0107] In addition, the electronic device (100) can provide the user with optimal music content that suits the user's taste by controlling the slope of the crossover filter (120) in consideration of the user's taste.
[0108] FIG. 4 is a block diagram showing in detail the configuration of an electronic device (100) according to one embodiment of the present disclosure.
[0109] As illustrated in FIG. 4, an electronic device (100) according to an embodiment may further include separate functional blocks for a speaker (110), a crossover filter (120), a memory (130), and a processor (140), as well as an amplifier (150), a sensor unit (160), an input unit (170), an output unit (180), a communication unit (190), and an interface unit (195). However, the selection of configurations and the division of functional blocks as illustrated in FIGS. 1 and 4 are merely exemplary, and it is to be understood that new configurations may be added or some configurations may be omitted in addition to the configurations illustrated in the present disclosure.
[0110] The amplifier (150) may be configured to amplify an audio signal. Specifically, the amplifier (150) may amplify the size of an audio signal corresponding to music content, and may perform operations such as adjusting the dynamic range generated in the music or correcting the frequency response.
[0111] In particular, in one or more embodiments, the processor (140) may transmit an audio signal corresponding to music content to the amplifier (150), thereby causing the signal amplified by the amplifier (150) to be output through the speaker (110). The electronic device (100) according to the present disclosure may be an active speaker device including an amplifier (150) and a speaker (110), but is not limited thereto.
[0112] The sensor unit (160) includes at least one sensor component (element or sensor modality) and can detect various information inside and outside the electronic device (100). Specifically, the sensor unit (160) can include at least one of an image sensor, an infrared sensor, a Global Positioning System (GPS) sensor, a gyro sensor (gyroscope), an acceleration sensor (accelerometer), a lidar sensor, an inertial measurement unit (IMU), and a motion sensor.
[0113] In particular, in one or more embodiments, the processor (140) obtains information on the user's listening height through the sensor unit (160), and if the difference between the user's listening height and the preset reference height is greater than a threshold value, the processor (140) may control the speaker (110) to output music content by compensating for a delay that occurs according to the difference between the listening height and the reference height. This embodiment will be described in more detail with reference to FIGS. 4 and 5.
[0114] The input unit (170) includes an electronic circuit, and the processor (140) may be configured to receive a user command for controlling the operation of the electronic device (100) through the input unit (170). Specifically, the input unit (170) may be configured with components such as a microphone, a camera, and a remote control signal receiving unit. In addition, the input unit (170) may be implemented in a form included in a display as a touch screen. In particular, the microphone may receive a voice signal and convert the received voice signal into an electrical signal.
[0115] In particular, in one or more embodiments, the processor (140) may obtain information about the user's taste by receiving a user input for selecting the user's taste in sound through the input unit (170). Then, when the user input for selecting the user's taste in sound is received through the input unit (170), the processor (140) may adjust the slope of the crossover filter (120) based on at least one of the user's taste and the properties of the music content.
[0116] Meanwhile, in one or more embodiments, the processor (140) obtains information on the location of at least one user through the sensor unit (160), and if the location of at least one user is identified as being outside a preset threshold range based on the information on the location of the user, a phase mismatch (so-called out-of-phase phenomenon) may occur due to a difference in the transmission distance between each speaker unit (111) on the listener side outside the threshold range, and thus a dip or the like may occur in the frequency characteristics, so that the slope may be adjusted to correspond to a third filter having a higher slope than the second filter. This embodiment will be described in more detail with reference to FIG. 6.
[0117] The output unit (180) includes an electronic circuit, and the processor (140) can output various functions that the electronic device (100) can perform through the output unit (180). In addition, the output unit (180) can include at least one of a display and an indicator.
[0118] The display may be configured to output image data under the control of the processor (140). Specifically, the display may output an image previously stored in the memory (130) under the control of the processor (140). In particular, the display according to an embodiment of the present disclosure may display a user interface stored in the memory (130). The display may be implemented as an LCD (Liquid Crystal Display Panel), an OLED (Organic Light Emitting Diodes), or the like, and in some cases, the display may also be implemented as a flexible display, a transparent display, or the like. However, the display according to the present disclosure is not limited to a specific type.
[0119] The indicator can be lit under the control of the processor (140). Specifically, the indicator can be lit in various colors under the control of the processor (140). For example, the indicator can be implemented using a light emitting diode (LED), a liquid crystal display panel (LCD), a vacuum fluorescent display (VFD), etc., but is not limited thereto.
[0120] In particular, in one or more embodiments, the processor (140) may control the output unit (180) to output information for guiding selection of a type of filter corresponding to an adjusted slope while music content is output through the speaker (110).
[0121] For example, if the type of filter corresponding to the adjusted slope is a first-order filter, the processor (140) can control the output unit (180) to output information indicating that music content is being output using the first-order filter. In addition, the processor (140) can also control the output unit (180) to output information in real time indicating the settings of the crossover filter (120) that change for each section within one music content.
[0122] Information to guide the selection of the type of filter corresponding to the adjusted slope may be provided in the form of a user interface including text and / or images via a display, or may be provided in the form of an indicator indicating a particular color.
[0123] The communication unit (190) includes an electronic circuit and can communicate with an external device. Specifically, the processor (140) can receive various data or information from an external device connected via the communication unit (190) and can also transmit various data or information to the external device.
[0124] The communication unit (190) may include at least one of a WiFi module, a Bluetooth module, a wireless communication module, an NFC module, and a UWB module (Ultra-Wide Band). Specifically, the WiFi module and the Bluetooth module may each perform communication in the WiFi or Bluetooth manner. When using a WiFi module or a Bluetooth module, various connection information, such as an SSID, may be first transmitted and received, and then communication may be established using this, after which various pieces of information may be transmitted and received.
[0125] In addition, the wireless communication module can perform communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), 5G (5th Generation), etc. And, the NFC module can perform communication in the NFC (Near Field Communication) method using the 13.56MHz band among various RF-ID frequency bands such as 135kHz, 13.56MHz, 433MHz, 860~960MHz, 2.45GHz, etc. In addition, the UWB module can accurately measure ToA (Time of Arrival), which is the time it takes for a pulse to reach a target, and AoA (Ange of Arrival), which is the pulse arrival angle at the transmitting device, through communication between UWB antennas, and accordingly, precise distance and location recognition is possible within an error range of several tens of centimeters indoors.
[0126] In particular, in one or more embodiments, the processor (140) may receive various information, such as music content, information about the music content, information for identifying properties of the music content, information for classifying properties of the music content, etc., from an external device via the communication unit (190). In addition, the processor (140) may also receive information about the user's preferences from the external device via the communication unit (190). Some of this information may be received in response to the same request, and the processor (140) may transmit it to the external device via the communication unit (190), and may receive it from the external device.
[0127] In addition, the processor (140) may control the communication unit (190) to transmit information about the slope of the crossover filter (120) adjusted based on at least one of an audio signal corresponding to the music content, an attribute of the music content, and a user's preference, to an external device, i.e., an audio output device (200), so that the music content is output by the external device. An embodiment of the audio output device (200) will be described in more detail with reference to FIG. 9.
[0128] The interface unit (195) can transmit and receive video data and / or audio data in relation to an external device. Specifically, the interface unit (195) may include an input port capable of receiving video data and / or audio data from an external device and an output port capable of transmitting video data and / or audio data to the external device. In particular, when the interface unit (195) can transmit and receive both video data and audio data, input / output ports capable of transmitting and receiving video data and audio data may be implemented separately. The interface unit (195) may connect the electronic device (100) and the external device wiredly via a cable, but may also connect the electronic device (100) and the external device wirelessly.
[0129] For example, the interface unit (195) may include an HDMI (High-Definition Multimedia Interface) module, a USB (Universal Serial Bus) module, etc. The HDMI module is one of the uncompressed digital video / audio interface standards and may provide an interface between the electronic device (100) and an external device providing content. The USB module may provide a communication system between the electronic device (100) and the external device providing content using a predefined input / output standard protocol. In addition to the HDMI module and the USB module, the interface unit (195) may be implemented with various modules for providing input / output of video / audio data between the electronic device (100) and an external device, such as a DP (Display Port) module, an RGB module, a DVI (Digital Visual Interface) module, and a Thunderbolt module.
[0130] In various embodiments according to the present disclosure, when an electronic device (100) and an external device are connected through an interface unit (195), the processor (140) identifies that an event for identifying a subscription service to which a user of the electronic device (100) is subscribed has occurred, and can identify the subscription service to which the user is subscribed. In addition, when a channel for providing content through a display is switched to at least one channel among a plurality of channels corresponding to a difference in channel configuration between a plurality of subscription services, the processor (140) can receive an image signal corresponding to at least one channel through the interface unit (195).
[0131] In addition, the interface unit (195) can transmit and receive various information / data, including control signals, between the electronic device (100) and an external device in various embodiments according to the present disclosure.
[0132] In particular, in one or more embodiments, the processor (140) may receive an audio signal corresponding to music content from an external device through the interface unit (195), and may also control the interface unit (195) to transmit an audio signal corresponding to music content to the external device.
[0133] FIGS. 5 and 6 are drawings for explaining in detail an embodiment related to controlling a speaker (110) according to a user's listening height.
[0134] In one or more embodiments, the processor (140) may obtain information corresponding to the user's listening height through the sensor unit (160). Specifically, the sensor unit (160) may include an image sensor (e.g., a vision sensor or a camera), an infrared sensor, an acoustic sensor, and a lidar sensor. These sensors may be the same as those described in the examples above. The processor (140) may obtain information on the user's listening height by identifying the position of the user's ears through the sensor unit (160) and calculating the distance between the user's ears and the floor of the space where the user is located. In other words, the 'user's listening height' refers to the distance between the user's ears and the floor.
[0135] For example, when obtaining information on the user's listening height using an image sensor, the processor (140) may obtain an image of the space where the user is located through the image sensor, input the obtained image into a neural network model trained for object recognition, and identify the floor of the space where the user is located and the user's ears. In addition, the processor (140) may obtain information on the user's listening height by calculating the distance between the floor of the space where the user is located and the user's ears.
[0136] Once information about the user's listening height is acquired, the processor (140) can determine whether the difference between the user's listening height and the reference height is greater than a threshold value. Here, the "reference height" is a reference height used in the process of adjusting the delay (or phase mismatch) between multiple speaker units (111), and can be changed according to the settings of the user or developer. Accordingly, the reference height may be a preset height value.
[0137] As illustrated in FIG. 5, when a user sits at a specific position in front of the electronic device (100), the distance between the floor and the user's ears can be set to a reference height (e.g., 90 cm). Then, if the distance between the floor and the user's ears matches the reference height or is less than a threshold value, the time it takes for the sound output through the woofer (111-1) and the sound output through the tweeter (111-2) to reach the user's ears can be identified as being equal to or comparable to the tuning delay between the plurality of speaker units (111). The tuning delay refers to the delay used to tune the speaker (110) so that the outputs of the woofer (111-1) and the tweeter (111-2) have equivalent phase characteristics. At this height, a crossover slope that prioritizes sound quality is used based on general listening conditions (e.g., a 1st or 4th order slope).
[0138] On the other hand, as illustrated in FIG. 6, if the distance between the floor of the space where the user is located and the user's ears is higher than the reference height (e.g., 160 cm), assuming that the reference height is 90 cm, if the time it takes for the sound output through the woofer (111-1) and the sound output through the tweeter (111-2) to reach the user's ears becomes excessively different, the probability of a situation in which the phase matching between the woofer (111-1) and the tweeter (111-2) is not good increases as described above, and in particular, when the listening heights of multiple listeners are different, it may be desirable to select a crossover with a very steep slope in order to exclude the dip phenomenon due to the phase mismatch between the multiple speaker units (111) that is, to provide stable frequency characteristics to multiple listeners.
[0139] Accordingly, if the difference between the user's listening height and the reference height is greater than the threshold value, the processor (140) can control the speaker (110) to output music content by compensating for the delay caused by the difference between the listening height and the reference height. Accordingly, even when the distance between the floor of the space where the user is located and the user's ears is higher than the reference height as shown in FIG. 6, the time difference between the sound output through the woofer (111-1) and the sound output through the tweeter (111-2) reaching the user's ears can be adjusted to be close to the ideal listening height. The threshold value can be determined in the form of an absolute value, and can be adjusted not only in a situation where it is higher than the reference height (e.g., when the listener stands up), but also in a situation where it is lower than the reference height (e.g., when the listener sits on the floor).
[0140] According to one or more embodiments described above with reference to FIGS. 5 and 6, the electronic device (100) can provide music content having frequency characteristics of an optimal crossover filter even when the user's listening height changes. Accordingly, the electronic device (100) can solve the problem that a phase difference may easily occur between a plurality of speaker units (111) depending on a change in the user's listening height, especially when the crossover filter (120) operates as a low-order filter such as a first-order filter.
[0141] FIG. 7 is a drawing for explaining in detail an embodiment related to controlling a speaker (110) according to the user's position.
[0142] In one or more embodiments, the processor (140) may obtain information about the location of at least one user through the sensor unit (160). Specifically, the sensor unit (160) may include an image sensor (e.g., a vision sensor or a camera), an infrared sensor, an acoustic sensor, and a lidar sensor. These sensors may be as described in the examples above. The processor (140) may obtain information about the location of at least one user through the sensor unit (160).
[0143] For example, when obtaining information on the location of at least one user using a lidar sensor, the processor (140) can identify the distance between the lidar sensor and the at least one user and the direction in which the user is located based on the lidar sensor by emitting a laser through the lidar sensor and detecting the laser reflected by the at least one user. In addition, the processor (140) can obtain information on the location of at least one user based on the distance between the lidar sensor and the at least one user and the direction in which the user is located based on the lidar sensor.
[0144] Once information about the location of at least one user is acquired, the processor (140) can identify whether the location of at least one user is outside a preset threshold range based on the information about the location of at least one user. In Fig. 7, the preset threshold range is represented by a region (70).
[0145] Here, the 'critical range (70)' refers to a three-dimensional spatial range corresponding to a good position for appreciating sound output through multiple speaker units (111), and may also be referred to as a so-called 'sweet spot'. The critical range (70) may vary depending on the slope characteristics of the crossover filter (120). Specifically, the critical range (70) may be wider when the crossover filter (120) operates as a fourth-order filter compared to when it operates as a first-order filter, and similarly, the higher the order of the crossover filter (120), the wider the critical range (70) may become.
[0146] If the location of at least one user is identified as being outside the preset threshold range (70), the processor (140) may adjust the slope of the crossover filter (120) to correspond to a third filter having a higher slope than the second filter. Here, the second filter may be a filter having a gentler slope than the third filter, for example, a 4th-order filter, and the third filter may be a filter having a steeper slope than the second filter, for example, a 16th-order filter (i.e., the slope of the third filter is 96 dB / octave).
[0147] For example, if the critical range (70) of FIG. 7 is the critical range (70) when the crossover filter (120) operates as a 4th-order filter, the position of the first user (71) is within the critical range (70), but the positions of the second user (72) and the third user (73) are outside the critical range (70), so the processor (140) can adjust the slope of the crossover filter (120) to correspond to a 16th-order filter having a higher slope than the 4th-order filter. This embodiment can be applied in particular to a situation where the tone (frequency characteristics) does not change as much as possible even when people move and change in listening height, such as when people gather for a party.
[0148] Meanwhile, if the positions of all users are identified as being within the critical range (70), the processor (140) can control the crossover filter (120) to expand the sweet spot according to the previously set slope (or adjusted according to the properties of the music content and the user's taste) without adjusting the slope of the crossover filter (120).
[0149] According to one or more embodiments described above with reference to FIG. 7, the electronic device (100) can minimize the deterioration of the frequency characteristics of the crossover band according to the listening position by adjusting the slope of the crossover filter (120) to a very steep slope, especially when a large number of users are located in a wide range or when the users are outside the optimal listening position.
[0150] FIG. 8 is a flowchart illustrating a method for controlling an electronic device (100) according to one or more embodiments of the present disclosure.
[0151] As illustrated in FIG. 8, the electronic device (100) is configured to adjust a slope related to a range in which the crossover filter (120) filters audio signals of each of a plurality of frequency bands based on at least one of the properties of the music content and the user's taste for sound (S810).
[0152] Specifically, the electronic device (100) can adjust the slope of the crossover filter (120) based on the properties of the music content, and can also adjust the slope of the crossover filter (120) based on the user's taste. In addition, the electronic device (100) can adjust the slope of the crossover filter (120) using both information about the properties of the music content and information about the user's taste.
[0153] When the slope of the crossover filter (120) is adjusted, the electronic device (100) can be configured to control the crossover filter (120) to filter an audio signal corresponding to the music content according to the adjusted slope while the music content is output (S20).
[0154] Specifically, the electronic device (100) may transmit a control signal to the crossover filter (120) to adjust the slope of the crossover filter (120) to a slope corresponding to at least one of the properties of the music content and the user's taste. Then, the speaker (110) may filter an audio signal corresponding to the music content according to the adjusted slope using the crossover filter (120) and then output the music content through a plurality of speaker units (111). The program may include instructions that cause the electronic device (100) to perform the method when executed by the processor (140).
[0155] Meanwhile, the control method of the electronic device (100) according to the above-described embodiment may be implemented as a program and provided to the electronic device (100). In particular, the program including the control method of the electronic device (100) may be stored and provided in a non-transitory computer readable medium.
[0156] Specifically, in a non-transitory computer-readable recording medium including a program for executing a control method of an electronic device (100), the control method of the electronic device (100) may include a step of adjusting a slope related to a range in which a crossover filter (120) included in a speaker (110) and dividing an input audio signal into a plurality of different frequency bands filters an audio signal of each of the plurality of frequency bands, based on at least one of a property of music content and a user's preference for sound, and a step of controlling the crossover filter (120) to filter an audio signal corresponding to the music content according to the adjusted slope while the music content is output.
[0157] In the above, a method for controlling an electronic device (100) and a computer-readable recording medium including a program for executing the method for controlling an electronic device (100) have been briefly described, but this is only to omit redundant descriptions, and it goes without saying that various embodiments of the electronic device (100) can also be applied to a method for controlling an electronic device (100) and a computer-readable recording medium including a program for executing the method for controlling an electronic device (100).
[0158] FIG. 9 is a sequence diagram illustrating the operation of an electronic device (100) and an audio output device (200) according to one or more embodiments of the present disclosure.
[0159] Although various embodiments have been described above on the premise that the electronic device (100) includes a speaker (110), a memory (130), and a processor (140), the present disclosure is not limited thereto. For example, some of the operations according to the various embodiments described above may be performed by the electronic device (100), and others may be performed by the audio output device (200). That is, various embodiments according to the present disclosure may be implemented through a system including the electronic device (100) and the audio output device (200).
[0160] The 'audio output device (200)' refers to a device configured to output audio, including a speaker (110). In particular, the speaker (110) of the audio output device (200) may include a plurality of speaker units (110) according to the present disclosure. In addition, the audio output device (200) may include a crossover filter (120) and an amplifier (150). For example, the audio output device (200) may be a Bluetooth speaker, earphones, headphones, etc., but there is no particular limitation on the type of the audio output device (200).
[0161] Meanwhile, in the embodiment described with reference to FIG. 9, the electronic device (100) may not include a speaker. For example, the electronic device (100) may be implemented as a server or an edge computing device.
[0162] As illustrated in FIG. 9, the audio output device (200) can transmit information about the speaker (110) included in the audio output device (200) to the electronic device (100) (S910), and the electronic device (100) can store information about the speaker (110) included in the audio output device (200) (S920).
[0163] Here, 'information about the speaker (110) included in the audio output device (200)' may include various types of information about the speaker (110) included in the audio output device (200), and a plurality of speaker units (111) and a crossover filter (120) included in the speaker (110). That is, the electronic device (100) may obtain information about the speaker (110) included in the audio output device (200) and store it in the memory (130) of the electronic device (100) before performing an operation related to adjusting the slope of the crossover filter (120).
[0164] The electronic device (100) can obtain information for adjusting a slope related to a range in which a crossover filter (120) filters audio signals of each of a plurality of frequency bands based on at least one of the properties of the music content and the user's taste for sound (S930).
[0165] When information for adjusting the inclination is obtained, the electronic device (100) can transmit information for adjusting the inclination to the audio output device (200) (S940). Then, when information on the adjusted inclination is received, the audio output device (200) can control the crossover filter (120) to filter an audio signal corresponding to the music content according to the adjusted inclination while the music content is output (S950).
[0166] According to the above-described embodiment with reference to FIG. 9, various embodiments according to the present disclosure can be implemented even in cases where the electronic device (100) does not include a speaker (110), the speaker (110) of the electronic device (100) does not include a plurality of speaker units (111) and a crossover filter (120), the specifications of the speaker (110) of the audio output device (200) are higher than those of the speaker (110) of the electronic device (100), and the audio output device (200) cannot obtain information for adjusting the slope of the crossover filter (120).
[0167] The artificial intelligence-related function according to the present disclosure is operated through the processor (140) and memory (130) of the electronic device (100).
[0168] The processor (140) may be composed of one or more processors (140). At this time, the one or more processors (140) may include at least one of a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and an NPU (Neural Processing Unit), but is not limited to the examples of the processors (140) described above.
[0169] The CPU is a general-purpose processor (140) capable of performing not only general calculations but also artificial intelligence calculations. Its multi-layer cache structure allows for the efficient execution of complex programs. The CPU is advantageous in a serial processing method, which enables organic linking of previous and subsequent calculation results through sequential calculations. The general-purpose processor (140) is not limited to the aforementioned examples, except in cases where it is specifically designated as a CPU.
[0170] A GPU is a processor (140) for large-scale operations such as floating point operations used in graphic processing, and can perform large-scale operations in parallel by integrating a large number of cores. In particular, a GPU may be advantageous compared to a CPU in parallel processing methods such as convolution operations. In addition, a GPU may be used as a co-processor (140) to supplement the functions of a CPU. The processor (140) for large-scale operations is not limited to the examples described above, except in cases where it is specifically referred to as a GPU.
[0171] An NPU is a processor (140) specialized in artificial intelligence operations using an artificial neural network, and each layer constituting the artificial neural network can be implemented with hardware (e.g., silicon). At this time, since the NPU is designed specifically according to the required specifications of the company, it has a lower degree of freedom compared to a CPU or GPU, but it can efficiently process the artificial intelligence operations requested by the company. Meanwhile, as a processor (140) specialized in artificial intelligence operations, the NPU can be implemented in various forms such as a Tensor Processing Unit (TPU), an Intelligence Processing Unit (IPU), a Vision Processing Unit (VPU), etc. The artificial intelligence processor (140) is not limited to the above-described examples, except in cases where it is specified as the above-described NPU.
[0172] Additionally, one or more processors (140) may be implemented as a System on Chip (SoC). In this case, the SoC may further include, in addition to one or more processors (140), a memory (130), and a network interface such as a bus for data communication between the processor (140) and the memory (130).
[0173] When a plurality of processors (140) are included in a SoC (System on Chip) included in an electronic device (100), the electronic device (100) may perform operations related to artificial intelligence (e.g., operations related to learning or inference of an artificial intelligence model) by using some of the plurality of processors (140). For example, the electronic device (100) may perform operations related to artificial intelligence by using at least one of a GPU, an NPU, a VPU, a TPU, and a hardware accelerator specialized in artificial intelligence operations such as convolution operations and matrix multiplication operations among the plurality of processors (140). However, this is merely an example, and it is of course possible to process operations related to artificial intelligence by using a CPU or a general-purpose processor (140).
[0174] In addition, the electronic device (100) can perform operations related to functions related to artificial intelligence by utilizing multiple cores (e.g., dual cores, quad cores, etc.) included in one processor (140). In particular, the electronic device (100) can perform artificial intelligence operations such as convolution operations, matrix multiplication operations, etc. in parallel by utilizing multiple cores included in the processor (140).
[0175] One or more processors (140) are controlled to process input data according to predefined operation rules or artificial intelligence models stored in the memory (130). The predefined operation rules or artificial intelligence models are characterized by being created through learning.
[0176] Here, "created through learning" means that a predefined set of behavioral rules or an AI model with desired characteristics is created by applying a learning algorithm to a large number of learning data. This learning may be performed on the device itself, where the AI according to the present disclosure is implemented, or through a separate server / system.
[0177] An artificial intelligence model may be composed of multiple neural network layers. At least one layer has at least one weight value and performs its operation through the operation result of the previous layer and at least one defined operation. Examples of neural networks include a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, and a transformer. The neural networks in the present disclosure are not limited to the above-described examples unless otherwise specified.
[0178] A learning algorithm is a method for training a target device (e.g., a robot) using a large amount of learning data, enabling the target device to make decisions or predictions on its own. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. Unless otherwise specified, the learning algorithms in this disclosure are not limited to the aforementioned examples.
[0179] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.
[0180] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smartphones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be at least temporarily stored or temporarily created in a device-readable storage medium, such as a manufacturer's server, an application store's server, or a memory (130) of an intermediary server.
[0181] Each of the components (e.g., modules or programs) according to the various embodiments of the present disclosure as described above may be composed of a single or multiple entities, and some of the sub-components described above may be omitted, or other sub-components may be further included in the various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration.
[0182] According to various embodiments, operations performed by a module, program or other component may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.
[0183] Meanwhile, the terms "part" or "module" used in the present disclosure include units composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A "part" or "module" may be an integrally composed component, a minimum unit performing one or more functions, or a portion thereof. For example, a module may be composed of an application-specific integrated circuit (ASIC).
[0184] Various embodiments of the present disclosure may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device (e.g., an electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored in the storage medium and operating according to the called instructions.
[0185] When the above instruction is executed by the processor, the processor may perform the function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter.
[0186] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.
Claims
1. In electronic devices, A speaker including a crossover filter that separates an input audio signal into a plurality of different frequency bands and a plurality of speaker units corresponding to each of the plurality of frequency bands; Memory for storing data about music content; and Based on at least one of the properties of the music content and the user's taste for sound, the slope of the crossover filter is adjusted within a range in which the crossover filter filters audio signals of each of the plurality of frequency bands. An electronic device comprising a processor that controls the crossover filter to filter an audio signal corresponding to the music content according to the adjusted slope while the music content is output through the speaker.
2. In paragraph 1, The above data includes metadata indicating the properties of the above music content, The above processor, An electronic device that identifies properties of the music content based on the metadata.
3. In paragraph 1, input section; including further; The above processor, An electronic device that adjusts the slope based on at least one of the user's taste and the properties of the music content when a user input for selecting the user's taste is received through the input unit.
4. In paragraph 1, The above processor, An electronic device that identifies an attribute of the music content based on at least one of the genre of the music content, the performer of the music content, and the type of instrument used in the music content included in the metadata.
5. In paragraph 1, An electronic device in which the above plurality of speaker units include a woofer that outputs sound in a low-frequency band and a tweeter that outputs sound in a frequency band higher than the low-frequency band.
6. In paragraph 1, The above processor, If the attribute of the above music content is a first attribute that includes a transient characteristic above a preset threshold level, the slope is adjusted to correspond to the first filter, An electronic device that adjusts the slope so as to correspond to a second filter having a higher slope than the first filter, if the property of the music content is a second property that includes the transient characteristic below the threshold level.
7. In paragraph 8, A sensor unit including at least one sensor; further comprising: The above processor, Obtain information on the user's listening height through the above sensor section, An electronic device that controls the speaker to output the music content by compensating for a delay caused by the difference between the listening height of the user and the preset reference height when the difference between the listening height of the user and the preset reference height is greater than a threshold value.
8. In paragraph 7, The above processor, Obtain information about the location of at least one user through the above sensor unit, An electronic device that adjusts the slope to correspond to a third filter having a higher slope than the second filter, if the location of at least one user is identified as being outside a preset threshold range based on information about the location of the user.
9. In paragraph 1, The above processor, While the music content is output through the speaker, the property of the music content is identified for each section of the music content based on the pattern of the audio signal corresponding to the music content, Adjusting the slope for each section based on the properties of the music content identified for each section, An electronic device that controls the crossover filter to filter an audio signal corresponding to the music content according to a slope adjusted for each section.
10. In paragraph 1, further comprising an output section; The above processor, An electronic device that controls the output unit to output information for guiding the type of filter corresponding to the adjusted slope while the music content is output through the speaker.
11. In paragraph 1, The above processor, An electronic device that identifies properties of the music content by inputting the metadata into a neural network model trained to output information on properties of the music content.
12. In a method for controlling an electronic device, A step of adjusting the slope of a crossover filter included in a speaker and dividing an input audio signal into a plurality of different frequency bands based on at least one of the properties of the music content and the user's taste for sound, within a range in which the crossover filter filters the audio signal of each of the plurality of frequency bands; and A method for controlling an electronic device, comprising: a step of controlling the crossover filter to filter an audio signal corresponding to the music content according to the adjusted slope while the music content is output; 13. In paragraph 12, The method of controlling the above electronic device is: A method for controlling an electronic device, further comprising: identifying a property of the music content based on metadata representing the property of the music content; 14. In paragraph 12, The steps for adjusting the above slope are: A method for controlling an electronic device, comprising: a step of adjusting the slope based on at least one of the user's taste and the properties of the music content when a user input for selecting the user's taste is received; 15. In paragraph 12, The step of identifying the properties of the above music content is: A method for controlling an electronic device, comprising: a step of identifying an attribute of the music content based on at least one of a genre of the music content, a performer of the music content, and a type of instrument used in the music content included in the metadata;
Citation Information
Patent Citations
The car audio system having the acoustic compensation function and acoustic compensation method
KR1020130078921A
Acoustic output device and control method thereof
KR1020180003264A
Multi-channel sound system which provides a tracking sweet spot for visitors to the exhibition space
KR102479067B1
Method for controlling output from ultrasonic speaker and ultrasonic speaker system
US20070286433A1
Multi-channel audio enhancement system
US20140044288A1