Electronic device and control method therefor
The electronic device addresses the challenge of managing audio settings for external speakers by using history information and measured audio signals to automatically adjust settings, enhancing sound quality and eliminating manual input requirements.
Patent Information
- Application Number
- PCT/KR2024/017201
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-21
- Filing Date
- 2024-11-04
- Publication Date
- 2025-05-30
AI Technical Summary
Existing electronic devices struggle to efficiently manage audio settings for external speakers, often requiring manual input and lacking a reliable method to verify the quality of auto-tuning settings.
An electronic device that uses history information and measured audio signals to obtain and adjust audio setting information for connected audio output devices, incorporating multiple external devices with microphones to record and analyze audio signals.
This solution enables automatic and accurate adjustment of audio settings, improving sound quality and eliminating the need for manual input, while ensuring reliable verification of tuning settings.
Smart Images

Figure KR2024017201_30052025_PF_FP_ABST
Abstract
Description
Electronic device and method of controlling the same
[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device and a control method thereof for controlling the settings of an external speaker connectable to an electronic device.
[0002] A speaker may be connected to an electronic device used by a user. The electronic device may output audio content through the connected speaker. For the electronic device and speaker to communicate with each other, mutual registration may be required based on a preset communication method.
[0003] When listening to audio content, users can use speakers (e.g., external speakers). To manage speaker settings, users can either maintain the initial settings or use the auto-tune feature. However, the auto-tune feature requires the user to manually enter information, which is inconvenient.
[0004] When using the auto-tune feature, there may be quality issues with your speaker setup as there is no way to verify that the tuning was performed properly.
[0005] The present disclosure is designed to improve the above-described problem, and an object of the present disclosure is to provide an electronic device and a control method thereof that acquires audio setting information of an audio output device connected to the electronic device using history information and a measured audio signal.
[0006] According to one embodiment, an electronic device includes a memory storing history information related to audio settings, an audio output device, a first external device including a microphone, and a second external device including a microphone. A communication interface for communicating with the first external device and the second external device, the second external device including the microphone, and at least one processor, wherein the at least one processor obtains first audio setting information based on the history information, transmits the first audio setting information and information about a first target audio signal for testing to the audio output device, receives from the first external device through the communication interface information about a first measurement audio signal that records information about the first target audio signal output from the audio output device, receives from the second external device through the communication interface information about a second measurement audio signal that records information about the first target audio signal output from the audio output device, obtains second audio setting information based on the information about the first measurement audio signal and the information about the second measurement audio signal, and transmits the second audio setting information and information about a second target audio signal for a user to the audio output device through the communication interface.
[0007] The above history information includes at least one of preferred volume, preferred frequency band, preferred style, preferred EQ (Equalizer) setting information, or hearing ability information, and the hearing ability information may include at least one of user age, user gender, and audible frequency range.
[0008] The at least one processor may obtain first location information of the first external device and second location information of the second external device based on the location of the electronic device, and obtain the first audio setting information based on the history information, the first location information, and the second location information.
[0009] The at least one processor may obtain third location information of the audio output device and obtain the first audio setting information based on the history information and the third location information.
[0010] The at least one processor may obtain a first expected frequency response predicted at a location of the first external device when the first target audio signal is output from the audio output device, obtain a first measured frequency response corresponding to the first measured audio signal, obtain a difference value between the first expected frequency response and the first measured frequency response, and obtain the second audio setting information by applying the difference value to the first audio setting information.
[0011] The at least one processor obtains spatial information including characteristics of a space in which the electronic device is placed, and obtains the first audio setting information based on the history information and the spatial information, wherein the spatial information may include at least one of a spatial shape or a spatial size.
[0012] The at least one processor may obtain user identification information corresponding to the first external device or the second external device, and obtain history information corresponding to the identification information from among a plurality of user-specific history information stored in the memory.
[0013] The above audio output device may include a first audio output device and a second audio output device, and the second audio setting information may include first stereophonic sound information corresponding to the first audio output device and second stereophonic sound information corresponding to the second audio output device.
[0014] Information about the first measured audio signal may include an audio signal obtained while a noise canceling function is performed in the first external device, and information about the second measured audio signal may include an audio signal obtained while a noise canceling function is performed in the second external device.
[0015] The first external device may be a left device of the earset, and the second external device may be a right device of the earset.
[0016] According to one embodiment, a control method of an electronic device storing history information related to audio settings and communicating with an audio output device, a first external device including a microphone, and a second external device including a microphone, includes the steps of: obtaining first audio setting information based on the history information; transmitting the first audio setting information and information on a first target audio signal for testing to the audio output device; receiving, from the first external device, information on a first measurement audio signal that records information on the first target audio signal output from the audio output device; receiving, from the second external device, information on a second measurement audio signal that records information on the first target audio signal output from the audio output device; obtaining second audio setting information based on the information on the first measurement audio signal and the information on the second measurement audio signal; and transmitting, to the audio output device, the second audio setting information and information on a second target audio signal for a user.
[0017] The above history information includes at least one of preferred volume, preferred frequency band, preferred style, preferred EQ (Equalizer) setting information, or hearing ability information, and the hearing ability information may include at least one of user age, user gender, and audible frequency range.
[0018] The step of obtaining the first audio setting information may include obtaining first location information of the first external device and second location information of the second external device based on the location of the electronic device, and obtaining the first audio setting information based on the history information, the first location information, and the second location information.
[0019] The step of obtaining the first audio setting information may include obtaining third location information of the audio output device, and obtaining the first audio setting information based on the history information and the third location information.
[0020] The step of obtaining the second audio setting information may include obtaining a first expected frequency response predicted at a location of the first external device when the first target audio signal is output from the audio output device, obtaining a first measured frequency response corresponding to the first measured audio signal, obtaining a difference value between the first expected frequency response and the first measured frequency response, and applying the difference value to the first audio setting information to obtain the second audio setting information.
[0021] The step of obtaining the first audio setting information may include obtaining spatial information including characteristics of a space in which the electronic device is placed, obtaining the first audio setting information based on the history information and the spatial information, and the spatial information may include at least one of a spatial shape or a spatial size.
[0022] The above control method may include a step of obtaining user identification information corresponding to the first external device or the second external device and a step of obtaining history information corresponding to the identification information among a plurality of user-specific history information stored in the electronic device.
[0023] The above audio output device may include a first audio output device and a second audio output device, and the second audio setting information may include first stereophonic sound information corresponding to the first audio output device and second stereophonic sound information corresponding to the second audio output device.
[0024] Information about the first measured audio signal may include an audio signal obtained while a noise canceling function is performed in the first external device, and information about the second measured audio signal may include an audio signal obtained while a noise canceling function is performed in the second external device.
[0025] The first external device may be a left device of the earset, and the second external device may be a right device of the earset.
[0026] FIG. 1 is a diagram for explaining an operation in which an external device receives an audio signal output through one audio output device according to one embodiment.
[0027] FIG. 2 is a diagram for explaining an operation in which an external device and a terminal device receive an audio signal output through one audio output device according to one embodiment.
[0028] FIG. 3 is a diagram for explaining an operation in which an external device receives audio signals output through multiple audio output devices according to one embodiment.
[0029] FIG. 4 is a diagram for explaining an operation in which an external device receives audio signals output through multiple audio output devices according to one embodiment.
[0030] FIG. 5 is a block diagram illustrating an electronic device according to one embodiment.
[0031] FIG. 6 is a block diagram illustrating a specific configuration of the electronic device of FIG. 5, according to one embodiment.
[0032] FIG. 7 is a diagram for explaining an operation of providing audio setting information according to one embodiment.
[0033] FIG. 8 is a diagram for explaining an operation of obtaining audio setting information according to one embodiment.
[0034] FIG. 9 is a drawing specifically explaining an operation of obtaining audio setting information according to one embodiment.
[0035] FIG. 10 is a diagram for explaining an operation of obtaining first audio setting information according to one embodiment.
[0036] FIG. 11 is a diagram for explaining an operation of obtaining first audio setting information according to one embodiment.
[0037] FIG. 12 is a diagram for explaining an operation of obtaining first audio setting information according to one embodiment.
[0038] FIG. 13 is a diagram for explaining an operation of providing audio setting information using multiple external devices according to one embodiment.
[0039] FIG. 14 is a diagram for explaining an operation of providing audio setting information using multiple audio output devices according to one embodiment.
[0040] FIG. 15 is a diagram for explaining an operation of providing audio setting information using an external device and an audio output device according to one embodiment.
[0041] FIG. 16 is a diagram for explaining an operation of providing audio setting information using a terminal device according to one embodiment.
[0042] FIG. 17 is a diagram for explaining an operation of obtaining first audio setting information according to one embodiment.
[0043] FIG. 18 is a drawing for explaining a screen related to audio setting information according to one embodiment.
[0044] FIG. 19 is a diagram for explaining a screen for obtaining context information according to one embodiment.
[0045] FIG. 20 is a drawing for explaining a screen for performing audio settings according to one embodiment.
[0046] FIG. 21 is a drawing for explaining a screen indicating the location of an audio output device according to one embodiment.
[0047] FIG. 22 is a diagram for explaining an operation of obtaining second audio setting information according to one embodiment.
[0048] FIG. 23 is a diagram for explaining an operation of obtaining audio setting information according to one embodiment.
[0049] FIG. 24 is a diagram illustrating a user database according to one embodiment.
[0050] FIG. 25 is a diagram for explaining an operation of obtaining first audio setting information using a pre-registered terminal device according to one embodiment.
[0051] FIG. 26 is a drawing for explaining a method of controlling an electronic device according to one embodiment.
[0052] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.
[0053] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.
[0054] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.
[0055] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".
[0056] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.
[0057] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).
[0058] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.
[0059] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "modules" or "parts" that need to be implemented as specific hardware.
[0060] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).
[0061] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.
[0062] FIG. 1 is a drawing for explaining an operation in which an external device receives an audio signal output through one audio output device according to one embodiment.
[0063] Referring to FIG. 1, an electronic device (100) can transmit an audio signal to an audio output device (200). The electronic device (100) may be a device that provides an audio signal. The audio output device (200) may be a device including a speaker.
[0064] The audio output device (200) can output an audio signal. The first external device (310) and the second external device (320) can obtain the audio signal output through the audio output device (200). The first external device (310) and the second external device (320) may be devices forming a set. For example, the first external device (310) and the second external device (320) may be ear sets. The first external device (310) and the second external device (320) may include a microphone.
[0065] The first external device (310) and the second external device (320) can obtain (or record) audio signals output from the audio output device (200). Each audio signal recorded from the first external device (310) and the second external device (320) can be used for an operation of analyzing audio setting information.
[0066] Depending on the various embodiments, the audio signal may be recorded only in either the first external device (310) or the second external device (320).
[0067] FIG. 2 is a diagram for explaining an operation in which an external device and a terminal device receive an audio signal output through one audio output device according to one embodiment.
[0068] Descriptions of the electronic device (100), audio output device (200), first external device (310), and second external device (320) are described in Fig. 1. Duplicate descriptions are omitted.
[0069] The terminal device (330) can additionally acquire audio signals output from the audio output device (200). The terminal device (330) may include a microphone. Each audio signal recorded in the first external device (310), the second external device (320), and the terminal device (330) may be used to analyze audio setting information.
[0070] The first external device (310) can transmit a first measurement audio signal including a recorded audio signal to the electronic device (100).
[0071] The second external device (320) can transmit a second measurement audio signal including the recorded audio signal to the electronic device (100).
[0072] The terminal device (330) can transmit a third measurement audio signal including the recorded audio signal to the electronic device (100).
[0073] The electronic device (100) can generate audio setting information suitable for the audio output device (200) using the first measurement audio signal, the second measurement audio signal, and the third measurement audio signal received from the first external device (310), the second external device (320), and the terminal device (330), respectively. Specific operations related thereto are described in FIG. 16.
[0074] FIG. 3 is a diagram for explaining an operation in which an external device receives audio signals output through multiple audio output devices according to one embodiment.
[0075] Descriptions of the electronic device (100), audio output device (200), first external device (310), and second external device (320) are described in Fig. 1. Duplicate descriptions are omitted.
[0076] The audio output device (200) may include multiple devices. The audio output device (200) may include at least one of a first audio output device (210), a second audio output device (220), or a third audio output device (230).
[0077] At least one of a first audio output device (210), a second audio output device (220), or a third audio output device (230) can be connected to the electronic device (100). The electronic device (100) can transmit an audio signal to at least one of the first audio output device (210), the second audio output device (220), or the third audio output device (230). The audio signal can be output through at least one of the first audio output device (210), the second audio output device (220), or the third audio output device (230). The output audio signal can be obtained through the first external device (310) and the second external device (320).
[0078] FIG. 4 is a diagram for explaining an operation in which an external device receives audio signals output through multiple audio output devices according to one embodiment.
[0079] Descriptions of the electronic device (100), audio output device (200), first external device (310), and second external device (320) are described in Fig. 1. Duplicate descriptions are omitted.
[0080] The audio output device (200) may include multiple devices. The audio output device (200) may include at least one of a first audio output device (210), a second audio output device (220), a third audio output device (230), a fourth audio output device (240), a fifth audio output device (250), or a sixth audio output device (260).
[0081] At least one of the plurality of devices (210, 220, 230, 240, 250, 260) can be connected to the electronic device (100). The electronic device (100) can transmit an audio signal to at least one of the plurality of devices (210, 220, 230, 240, 250, 260). The audio signal can be output through at least one of the plurality of devices (210, 220, 230, 240, 250, 260). The output audio signal can be obtained through the first external device (310) and the second external device (320).
[0082] FIG. 5 is a block diagram illustrating an electronic device (100) according to one embodiment.
[0083] Referring to FIG. 5, the electronic device (100) may include at least one of a memory (110), at least one processor (120), or a communication interface (130).
[0084] The electronic device (100) may include various devices. The electronic device (100) may be an electronic whiteboard, a TV, a desktop PC, a laptop, a smartphone, a tablet PC, a server, etc. The above-described examples are merely examples for describing the electronic device and are not necessarily limited to the above-described devices.
[0085] The memory (110) can store history information related to audio settings.
[0086] History information may indicate information related to settings applied to the audio output function. History information may include a past history of settings applied to the audio output function.
[0087] The history information may include at least one of preferred volume, preferred frequency band, preferred style, preferred EQ (Equalizer) setting information, or hearing ability information.
[0088] Hearing ability information may include at least one of user age, user gender, and audible frequency range.
[0089] The audible frequency range can be identified based on at least one of the user's age or gender. The audible frequency range may be inversely proportional to the user's age. The older the user, the narrower the audible frequency range.
[0090] According to one embodiment, history information may be stored in the electronic device (100). The electronic device (100) may obtain the history information stored in the memory (110).
[0091] According to one embodiment, the history information may be stored in at least one of the first external device (310) or the second external device (320). The electronic device (100) may request the history information from at least one of the first external device (310) or the second external device (320). The electronic device (100) may receive the history information from at least one of the first external device (310) or the second external device (320).
[0092] According to one embodiment, history information may be stored in the terminal device (330). The electronic device (100) may request history information from the terminal device (330). The electronic device (100) may receive history information from the terminal device (330).
[0093] Additional explanations regarding history information are provided in Fig. 7.
[0094] The communication interface (130) can communicate with an audio output device (200), a first external device (310) including a microphone, and a second external device (320) including a microphone. The microphone of the first external device (310) and the microphone of the second external device (320) may be separate components.
[0095] The electronic device (100) can communicate with the first external device (310) and the second external device (320) based on a preset communication method. The preset communication method may be one of the Bluetooth communication method, UWB (Ultra-Wideband) communication method, or Wi-Fi communication method.
[0096] The first external device (310) and the second external device (320) may be devices forming a single group. The first external device (310) and the second external device (320) may each include a microphone.
[0097] For example, the first external device (310) may be a left-side device of the earset, and the second external device (320) may be a right-side device of the earset. The first external device (310) and the second external device (320) may be included in one earset.
[0098] For example, the first external device (310) may be the left part of the headset, and the second external device (320) may be the right part of the headset. The first external device (310) and the second external device (320) may be devices arranged in one headset. In relation to the headset, the first external device (310) and the second external device (320) may be described as the first part and the second part.
[0099] For example, the first external device (310) may be a first audio receiving device, and the second external device (320) may be a second audio receiving device. The first external device (310) and the second external device (320) may be different microphones.
[0100] At least one processor (120) can perform overall control operations of the electronic device (100). At least one processor (120) can perform a function of controlling overall operations of the electronic device (100).
[0101] At least one processor (120) may obtain first audio setting information based on history information, transmit the first audio setting information and information about a first target audio signal for testing to an audio output device (200), receive information about a first measurement audio signal that records information about the first target audio signal output from the audio output device (200) from a first external device (310) through a communication interface (130), receive information about a second measurement audio signal that records information about the first target audio signal output from the audio output device (200) from a second external device (320) through the communication interface (130), obtain second audio setting information based on the information about the first measurement audio signal and the information about the second measurement audio signal, and transmit the second audio setting information and information about the second target audio signal for a user to the audio output device (200) through the communication interface (130).
[0102] Information about the first target audio signal can be described as first target audio information or first target audio signal.
[0103] Information about the second target audio signal can be described as second target audio information or second target audio signal.
[0104] Information about the first measurement audio signal may be described as first measurement audio information or first measurement audio signal.
[0105] Information about the second measurement audio signal may be described as second measurement audio information or second measurement audio signal.
[0106] In Figures 7 to 25, information about an audio signal is described as an audio signal. The operation of transmitting an audio signal does not simply transmit the audio signal alone, but may also represent an operation of transmitting information including the audio signal.
[0107] At least one processor (120) can obtain (or generate) first audio setting information related to the audio environment of the audio output device (200) based on history information. The history information can represent a user's personal preference information. At least one processor (120) can obtain first audio setting information using the history information so that the user's preference information can be applied to the audio output device (200). At least one processor (120) can provide the first audio setting information to the audio output device (200).
[0108] For example, at least one processor (120) can obtain a preferred volume included in the history information. At least one processor (120) can obtain first audio setting information including the preferred volume so that the preferred volume can be applied to the audio output device (200). At least one processor (120) can transmit the first audio setting information including the preferred volume to the audio output device (200). The audio output device (200) can output an audio signal based on the preferred volume included in the first audio setting information. Although the preferred volume has been described as an example, various pieces of information included in the history information can be equally applied to the audio output device (200).
[0109] At least one processor (120) may obtain first location information of a first external device (310) and second location information of a second external device (320) based on the location of the electronic device (100), and may obtain first audio setting information based on the history information, the first location information, and the second location information.
[0110] For example, at least one processor (120) can obtain first location information and second location information using a preset communication method. At least one processor (120) can transmit a signal requesting location information to a first external device (310) and a second external device (320). The first external device (310) and the second external device (320) can transmit a response signal corresponding to the request signal to the electronic device (100). At least one processor (120) can obtain first location information based on a first response signal received from the first external device (310). At least one processor (120) can obtain second location information based on a second response signal received from the second external device (320).
[0111] The electronic device (100) can identify the location of an external device (or terminal device) that transmitted a response signal based on the measured intensity of the response signal and the reception angle of the response signal. The response signal may include identification information of the device that transmitted the response signal and the output intensity of the response signal.
[0112] The response signal may decrease in intensity at a certain rate or function as the distance increases. The electronic device (100) may compare the output intensity included in the response signal with the measured intensity analyzed from the response signal to identify (or calculate) the distance between the external device (or terminal device) that output the response signal and the electronic device (100).
[0113] For example, if the output intensity is 100, the measurement intensity may be 50. The electronic device (100) can identify the location of the electronic device (100) and the external device (or terminal device) that output the response signal based on the value reduced by 50.
[0114] The electronic device (100) can sense the reception angle of the response signal. The electronic device (100) can identify the output direction of the external device (or terminal device) based on the reception angle of the response signal.
[0115] The electronic device (100) can identify the location of an external device (or terminal device) based on the measured intensity of the response signal and the reception angle of the response signal. The electronic device (100) can identify the relative location of the external device (or terminal device) based on the location of the electronic device (100).
[0116] For example, at least one processor (120) may obtain a photographed image including a space in which an electronic device (100) is placed. At least one processor (120) may identify at least one of a first external device (310) or a second external device (320) from the photographed image. At least one processor (120) may obtain first location information of the first external device (310) and second location information of the second external device (320) based on the photographed image.
[0117] At least one processor (120) can obtain first audio setting information based on history information, first location information, and second location information.
[0118] For example, at least one processor (120) may determine a sound pressure level of the audio output device (200) such that an audio signal output from the audio output device (200) is measured at a preferred sound volume included in the history information at a first coordinate corresponding to the first location information. At least one processor (120) may obtain first audio setting information including the determined sound pressure level of the audio output device (200). The sound pressure level may be described as audio size, audio intensity, audio level, audio output level, volume, sound volume, etc.
[0119] For example, at least one processor (120) may determine a sound pressure level of the audio output device (200) such that an audio signal output from the audio output device (200) is measured at a preferred sound volume included in the history information at a second coordinate corresponding to the second location information. At least one processor (120) may obtain first audio setting information including the determined sound pressure level of the audio output device (200).
[0120] At least one processor (120) can obtain third location information of the audio output device (200) and obtain first audio setting information based on the history information and the third location information.
[0121] At least one processor (120) can obtain third location information of the audio output device (200). The method for identifying the location of the audio output device (200) may be the same as the operation for identifying the locations of the first external device (310) and the second external device (320). Duplicate descriptions are omitted.
[0122] For example, at least one processor (120) may determine a sound pressure level of an audio output device (200) output at a third coordinate corresponding to the third location information so as to correspond to a preferred sound volume included in the history information. At least one processor (120) may obtain first audio setting information including the determined sound pressure level of the audio output device (200).
[0123] At least one processor (120) can obtain first audio setting information based on at least one of history information, first location information, second location information, or third location information.
[0124] For example, at least one processor (120) may determine a sound pressure level of the audio output device (200) such that an audio signal output at a third coordinate corresponding to the third location information is measured at a preferred volume included in the history information at a first coordinate corresponding to the first location information. At least one processor (120) may obtain first audio setting information including the determined sound pressure level of the audio output device (200).
[0125] For example, at least one processor (120) may determine a sound pressure level of the audio output device (200) such that an audio signal output at a third coordinate corresponding to the third location information is measured at a preferred volume included in the history information at a second coordinate corresponding to the second location information. At least one processor (120) may obtain first audio setting information including the determined sound pressure level of the audio output device (200).
[0126] Information about the first target audio signal may include a test audio signal for obtaining first audio setting information.
[0127] At least one processor (120) can obtain (or identify) information about a first target audio signal. The information about the first target audio signal may be a signal output from an audio output device (200).
[0128] For example, information about the first target audio signal may be a test audio signal. Information about the first target audio signal may be a test audio signal previously stored in the memory (110). The test audio signal may vary based on the number of audio output devices (200).
[0129] The processor (120) may determine the first test audio signal as information about the first target audio signal. If the audio output device (200) includes two speakers, at least one processor (120) may determine the second test audio signal as information about the first target audio signal. The information about the first target audio signal corresponding to an audio output device (200) including a plurality of speakers may be an audio signal related to surround sound.
[0130] For example, information about the first target audio signal may be an audio signal corresponding to a user input. When a user input for outputting a specific audio signal is received, at least one processor (120) may determine the specific audio signal as information about the first target audio signal.
[0131] At least one processor (120) can control the communication interface (130) to transmit first audio setting information and information about the first target audio signal to the audio output device (200).
[0132] For example, at least one processor (120) can simultaneously transmit first audio setting information and information about a first target audio signal to an audio output device (200). At least one processor (120) can group the first audio setting information and information about a first target audio signal into one communication packet and transmit the grouped communication packet to the audio output device (200).
[0133] For example, at least one processor (120) may control a first time point for transmitting first audio configuration information and a second time point for transmitting information about the first target audio signal differently. If the first time point and the second time point are different, the first audio configuration information and the information about the first target audio signal may be transmitted to the audio output device (200) at different times.
[0134] The audio output device (200) can receive first audio configuration information and information about a first target audio signal from at least one processor (120). The audio output device (200) can output information about the first target audio signal based on the first audio configuration information. The audio output device (200) can include a speaker. The audio output device (200) can output information about the first target audio signal by applying the first audio configuration information.
[0135] After information about the first target audio signal is acquired, at least one processor (120) can transmit a recording control command to the first external device (310) and the second external device (320). The first external device (310) and the second external device (320) can perform a function of recording the audio signal when the recording control command is received. As the function of recording the audio signal is performed, the first external device (310) can acquire information about the first measurement audio signal, and the second external device (320) can acquire information about the second measurement audio signal.
[0136] The start time at which the first external device (310) acquires information about the first measurement audio signal and the start time at which the second external device (320) acquires information about the second measurement audio signal may be the same. The information about the first measurement audio signal and the information about the second measurement audio signal may be signals acquired through spatial sound (360-degree audio) measurement.
[0137] While information about the first target audio signal is output through the audio output device (200), the first external device (310) can obtain information about the first measurement audio signal through the microphone of the first external device (310). The first external device (310) can transmit information about the first measurement audio signal to the electronic device (100).
[0138] While information about the first target audio signal is output through the audio output device (200), the second external device (320) can obtain information about the second measurement audio signal through the microphone of the second external device (320). The second external device (320) can transmit information about the second measurement audio signal to the electronic device (100).
[0139] At least one processor (120) can receive information about a first measurement audio signal from a first external device (310) via a communication interface (130).
[0140] At least one processor (120) can receive information about a second measurement audio signal from a second external device (320) via a communication interface (130).
[0141] At least one processor (120) can analyze information about a first measurement audio signal and information about a second measurement audio signal to obtain an analysis result. At least one processor (120) can obtain second audio setting information based on the analysis result.
[0142] At least one processor (120) can use information about the first measured audio signal and information about the second measured audio signal to determine the result of applying the first audio setting information to the audio output device (200).
[0143] At least one processor (120) can change the first audio setting information to second audio setting information based on information about the first measurement audio signal and information about the second measurement audio signal.
[0144] For example, at least one processor (120) can obtain an expected sound pressure level when information about a first target audio signal output based on first audio configuration information is recorded. At least one processor (120) can obtain a measured sound pressure level based on at least one of information about the first measured audio signal or information about the second measured audio signal. At least one processor (120) can compare the expected sound pressure level and the measured sound pressure level to obtain a difference value. At least one processor (120) can correct (or update) the first audio configuration information to the second audio configuration information based on the difference value.
[0145] The second audio setting information includes EQ setting information, and the EQ setting information may include a first sound pressure level corresponding to a first frequency band and a second sound pressure level corresponding to a second frequency band.
[0146] EQ setting information can indicate information for controlling audio frequencies to provide audio characteristics desired by the user. EQ setting information can include sound pressure levels corresponding to each of a plurality of preset frequency bands. EQ setting information can be of multiple types, and each of the multiple types can have different EQ setting information.
[0147] EQ setting information may include information related to at least one of frequency band, gain, Q factor, band type, and filter.
[0148] The audio output device (200) includes a first audio output device (200) and a second audio output device (200), and the second audio setting information may include first stereophonic sound information corresponding to the first audio output device (210) and second stereophonic sound information corresponding to the second audio output device (220).
[0149] Surround sound can include technologies that create a three-dimensional effect based on the temporal flow of audio signals. Surround sound can enhance the immersive audio experience by controlling the direction, distance, and pitch of audio in a three-dimensional space.
[0150] Surround sound can be a technology that utilizes the individual positions of multiple speakers. The multiple speakers may represent multiple devices included in an audio output device (200). The surround sound information may differ for each of the multiple audio output devices.
[0151] The surround sound information may include at least one of a 3D audio codec and a spatial audio algorithm. The 3D audio codec may include a codec used to encode and decode audio signals. The spatial audio algorithm may include an algorithm for simulating the phenomena of audio signals being transmitted, reflected, attenuated, and diffracted at a specific location.
[0152] According to various embodiments, the first external device (310) and the second external device (320) can record audio signals via microphones. Each of the first external device (310) and the second external device (320) can perform a noise canceling function while recording audio signals.
[0153] Information about the first measurement audio signal may be a signal acquired while a noise canceling function is performed in the first external device (310), and information about the second measurement audio signal may be a signal acquired while a noise canceling function is performed in the second external device (320).
[0154] The first external device (310) can obtain information about the first measurement audio signal while performing a noise canceling function.
[0155] The second external device (320) can obtain information about the second measurement audio signal while performing a noise canceling function.
[0156] At least one processor (120) may obtain a first expected frequency response predicted at a location of a first external device when a first target audio signal is output from an audio output device, obtain a first measured frequency response (measurement level) corresponding to the first measured audio signal, obtain a difference value between the first expected frequency response and the first measured frequency response (measurement level), and apply the difference value to the first audio setting information to obtain second audio setting information. Additional descriptions related thereto are described in FIG. 11.
[0157] At least one processor (120) acquires spatial information including characteristics of a space in which an electronic device is placed, acquires first audio setting information based on the history information and the spatial information, and the spatial information may include at least one of a spatial shape or a spatial size. Additional descriptions related thereto are provided in FIG. 3.
[0158] At least one processor (120) may acquire user identification information corresponding to a first external device or a second external device, and may acquire history information corresponding to the identification information from among multiple user-specific history information stored in memory. Additional descriptions related to this are provided in FIGS. 24 and 25.
[0159] According to various embodiments, the electronic device (100) can identify whether the first external device (310) and the second external device (320) are activated simultaneously.
[0160] The electronic device (100) can obtain first audio setting information or second audio setting information based on the activation status of at least one of the first external device (310) or the second external device (320).
[0161] It is assumed that the first external device (310) is worn on the left side based on the direction in which the user is looking at the audio output device (200). It is assumed that the second external device (320) is worn on the right side based on the direction in which the user is looking at the audio output device (200).
[0162] The electronic device (100) can determine a reference position of the stereoscopic sound based on the activation state of at least one of the first external device (310) or the second external device (320).
[0163] For example, only the first external device (310) may be activated. The electronic device (100) may identify that the first external device (310) is activated. The electronic device (100) may obtain setting information related to stereophonic sound based on the location information of the first external device (310).
[0164] For example, only the second external device (320) may be activated. The electronic device (100) may identify that the second external device (320) is activated. The electronic device (100) may obtain setting information related to stereophonic sound based on the location information of the second external device (320).
[0165] For example, both the first external device (310) and the second external device (320) may be activated. The electronic device (100) may identify that both the first external device (310) and the second external device (320) are activated. The electronic device (100) may acquire setting information related to stereophonic sound by considering both the location information of the first external device (310) and the location information of the second external device (320).
[0166] According to various embodiments, the electronic device (100) can adjust the EQ level of the audio output device (200) or adjust the music volume by frequency based on the user's preferred sound.
[0167] According to various embodiments, the electronic device (100) can optimize the tuning of the stereophonic sound by performing a direction recognition test function of the audio output device (200).
[0168] In various embodiments, the first target audio signal and the second target audio signal may be identical. For example, the first target audio signal and the second target audio signal may both be audio content provided to the user.
[0169] FIG. 6 is a block diagram for explaining the specific configuration of the electronic device (100) of FIG. 5.
[0170] Referring to FIG. 6, the electronic device (100) may include at least one of a memory (110), at least one processor (120), a communication interface (130), a display (140), an operation interface (150), an input / output interface (160), a speaker (170), a microphone (180), and a camera (190).
[0171] The memory (110) may be implemented as an internal memory such as a ROM (e.g., an electrically erasable programmable read-only memory (EEPROM)) or RAM included in at least one processor (120), or may be implemented as a separate memory from at least one processor (120). The memory (110) may be implemented as a memory embedded in the electronic device (100) or as a memory detachable from the electronic device (100) depending on the purpose of data storage. For example, data for driving the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding functions of the electronic device (100) may be stored in a memory detachable from the electronic device (100).
[0172] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD), and in the case of memory that can be attached or detached to the electronic device (100), it may be implemented in the form of a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc.
[0173] The memory (110) can store at least one instruction. Based on the instruction stored in the memory (110), at least one processor (120) can perform various operations.
[0174] At least one processor (120) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an advanced reduced instruction set computer (RISC) machines (ARM) processor, or may be defined by the relevant terminology. At least one processor (120) may be implemented as a system on chip (SoC) having a built-in processing algorithm, a large scale integration (LSI), or may be implemented in the form of a field programmable gate array (FPGA). At least one processor (120) may perform various functions by executing computer executable instructions stored in a memory.
[0175] The communication interface (130) is a configuration that performs communication with various types of external devices according to various types of communication methods. The communication interface (130) may include a wireless communication module or a wired communication module. Each communication module may be implemented in the form of at least one hardware chip.
[0176] A wireless communication module may be a module that communicates wirelessly with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.
[0177] Wi-Fi and Bluetooth modules can communicate via Wi-Fi and Bluetooth, respectively. When using a Wi-Fi or Bluetooth module, various connection information, such as the service set identifier (SSID) and session key, is first transmitted and received. This information is then used to establish a communication connection before various other information can be transmitted and received.
[0178] Infrared communication modules perform communication based on infrared communication (IrDA, infrared Data Association) technology, which transmits data wirelessly over short distances using infrared light, which is between visible light and millimeter waves.
[0179] In addition to the above-described communication method, other communication modules may include at least one communication chip that performs communication according to various wireless communication standards such as zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.
[0180] A wired communication module may be a module that communicates with an external device via a wire. For example, the wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a paired cable, a coaxial cable, a fiber optic cable, or an Ultra Wide-Band (UWB) module.
[0181] According to various embodiments, the communication interface (130) may utilize the same communication module (e.g., a Wi-Fi module) to communicate with an external device such as a remote control device and an external server.
[0182] According to various embodiments, the communication interface (130) may utilize different communication modules to communicate with external devices, such as remote control devices, and external servers. For example, the communication interface (130) may utilize at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and may also utilize a Bluetooth module to communicate with an external device, such as a remote control device. However, this is merely an embodiment, and the communication interface (130) may utilize at least one of various communication modules when communicating with multiple external devices or external servers.
[0183] The display (140) may be implemented as a variety of displays such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), etc. The display (140) may also include a driving circuit, a backlight unit, etc., which may be implemented as a form such as an a-si TFT (amorphous silicon thin film transistor), an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc. The display (140) may be implemented as a touch screen combined with a touch sensor, a flexible display, a three-dimensional display (3D display, three-dimensional dispaly), etc. According to an embodiment of the present disclosure, the display (140) may include not only a display panel that outputs an image, but also a bezel that houses the display panel. In particular, according to an embodiment of the present disclosure, the bezel may include a touch sensor for detecting user interaction.
[0184] The operating interface (150) may be implemented as a device such as a button, a touch pad, a mouse, and a keyboard, or as a touch screen capable of performing the above-described display function and operating input function. The button may be a mechanical button, a touch pad, a wheel, or any other type of button formed in any area of the front, side, or back of the main body of the electronic device (100).
[0185] The input / output interface (160) may be any one of HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface). The input / output interface (160) may input / output at least one of audio and video signals. Depending on the implementation example, the input / output interface (160) may include a port that inputs / outputs only audio signals and a port that inputs / outputs only video signals as separate ports, or may be implemented as a single port that inputs / outputs both audio signals and video signals. The electronic device (100) may transmit at least one of the audio and video signals to an external device (e.g., an external display device or an external speaker) through the input / output interface (160). An output port included in the input / output interface (160) can be connected to an external device, and the electronic device (100) can transmit at least one of an audio and video signal to the external device through the output port.
[0186] The input / output interface (160) can be connected to a communication interface. The input / output interface (160) can transmit information received from an external device to the communication interface or transmit information received through the communication interface to the external device.
[0187] The speaker (170) may be a component that outputs various audio data as well as various notification sounds or voice messages.
[0188] The microphone (180) is a component that receives a user's voice or other sounds and converts them into audio data. The microphone (180) can receive the user's voice in an activated state. For example, the microphone (180) can be formed integrally on the upper side, the front side, the side side, etc. of the electronic device (100). The microphone (180) can include various components such as a microphone that collects the user's voice in analog form, an amplifier circuit that amplifies the collected user's voice, an A / D conversion circuit that samples the amplified user's voice and converts it into a digital signal, and a filter circuit that removes noise components from the converted digital signal.
[0189] The camera (190) is a device configured to capture a subject and generate a captured image, and the captured image includes both moving images and still images. The camera (190) can acquire images for at least one external device and can be implemented with a camera, lens, infrared sensor, or the like.
[0190] The camera (190) may include a lens and an image sensor. The type of lens may include a general-purpose lens, a wide-angle lens, a zoom lens, etc., and may be determined according to the type, characteristics, usage environment, etc. of the electronic device (100). The image sensor may include a complementary metal oxide semiconductor (CMOS) and a charge-coupled device (CCD).
[0191] FIG. 7 is a diagram for explaining an operation of providing audio setting information according to one embodiment.
[0192] Referring to FIG. 7, the electronic device (100) can store audio context information. The context information can include at least one of audio setting history information, spatial information, or location information.
[0193] The electronic device (100) may include at least one of a storage module (710) related to audio setting history information, a storage module (720) related to spatial information, a storage module (730) related to location information, a decision module (740) related to audio setting information, and an audio provision module (750). Each module may be described as a first module, a second module, a third module, a fourth module, a fifth module, etc. The ordinal number may vary.
[0194] A storage module (710) related to audio setting history information can store user history information related to audio settings. The history information can include at least one of preferred volume, preferred frequency band, preferred style (or genre), preferred EQ (Equalizer) information, or hearing ability information.
[0195] Preferred loudness can represent an average of the audio loudness (or level or volume) selected by the user.
[0196] The preferred frequency band may represent the average value of the audio frequency band selected (or listened to) by the user.
[0197] The preferred style (or genre) can indicate the style (or style information) of the audio selected by the user.
[0198] Preferred EQ (EQualizer) information can indicate audio-related EQ settings selected by the user.
[0199] Hearing ability information may include at least one of the following: the user's age, gender, or hearing impairment information. Hearing ability information may include an audible frequency range corresponding to the user's age. The audible frequency range may be narrower as the user ages.
[0200] The storage module (720) related to spatial information can store information related to the space in which the audio output device (200) is placed. The information related to the space can include at least one of spatial shape, spatial size, or object characteristics. The object can represent an object identified in the space. The object characteristics can represent classification criteria for representing the identified object. For example, the object characteristics can represent obstacles, people, etc.
[0201] The electronic device (100) can use a sensor to obtain spatial information.
[0202] For example, the sensor may be an image sensor. The image sensor may include a camera (190). The electronic device (100) may acquire a photographed image through the camera (190). Based on the photographed image, the electronic device (100) may acquire spatial information about the environment in which the electronic device (100) is placed.
[0203] The electronic device (100) may utilize a sensor to obtain location information. The electronic device (100) may sense location information of the first external device (310) and / or the second external device (320) through a distance sensor included in each of the first external device (310) and / or the second external device (320).
[0204] The electronic device (100) can be connected to each of the audio output device (200), the first external device (310), and the second external device (320) using a preset communication method. The electronic device (100) can obtain location information based on the preset communication method. The preset communication method can be one of the Bluetooth communication method, UWB (Ultra-Wideband) communication method, or Wi-Fi communication method.
[0205] The storage module (730) related to location information can store at least one of the location of an external device or the location of an audio output device. The storage module (730) related to location information can store at least one of the location information of an audio output device (200), the location information of a first external device (310), and the location information of a second external device (320).
[0206] According to various embodiments, the electronic device (100) can identify the location of an external device. The electronic device (100) can communicate with the external device and, during the communication process with the external device, output a request signal for identifying the location of the external device. The external device can transmit a response signal corresponding to the request signal. The electronic device (100) can obtain location information of the external device based on the response signal transmitted by the external device.
[0207] According to various embodiments, the electronic device (100) can identify the user's location. The electronic device (100) can capture an image using a camera and identify the user's location based on the captured image. Once the user is identified, the electronic device (100) can store the user's location in a storage module (730) associated with the location information.
[0208] According to various embodiments, the electronic device (100) can determine the location of the external device as the location of the user.
[0209] A decision module (740) related to audio setting information can obtain (or determine or identify) first audio setting information based on context information. The electronic device (100) can obtain the first audio setting information based on at least one of history information, spatial information, location information of an external device, and location information of an audio output device related to audio settings. The decision module (740) related to audio setting information can transmit the first audio setting information to an audio provision module (750). The decision module (740) related to audio setting information can transmit the first audio setting information to an audio output device (200) via a communication interface (130). The audio provision module (750) can be described as an audio signal determination module.
[0210] The audio providing module (750) can determine a first target audio signal to be transmitted to the audio output device (200). The audio providing module (750) can identify the first target audio signal based on the first audio setting information. The audio providing module (750) can obtain a first target audio signal suitable for the location of the audio output device (200) included in the first audio setting information. The audio providing module (750) can transmit the first target audio signal to the audio output device (200) through the communication interface (130).
[0211] The audio output device (200) may include at least one of a communication interface (201), an audio setting module (202), or an audio output module (203). The audio output device (200) may receive first audio setting information and a first target audio signal from the electronic device (100) through the communication interface (201). The audio output device (200) may store and set the first audio setting information through the audio setting module (202). The audio output device (200) may output the first target audio signal through the audio output module (203). The audio output device (200) may output the first target audio signal using the first audio setting information. The audio output module (203) may include a speaker.
[0212] A first target audio signal output through an audio output device (200) can be obtained from a first external device (310) and a second external device (320).
[0213] The first external device (310) may include at least one of an audio receiving module (311) and a communication interface (312). The audio receiving module (311) may include a microphone. The first external device (310) may record a first target audio signal through the audio receiving module (311) to obtain a first measurement audio signal. The first external device (310) may transmit the first measurement audio signal to the electronic device (100) through the communication interface (312).
[0214] The second external device (320) may include at least one of an audio receiving module (321) and a communication interface (322). The audio receiving module (321) may include a microphone. The second external device (320) may record a first target audio signal through the audio receiving module (321) to obtain a second measurement audio signal. The second external device (320) may transmit the second measurement audio signal to the electronic device (100) through the communication interface (322).
[0215] The electronic device (100) can receive a first measurement audio signal from a first external device (310) via a communication interface (130). The electronic device (100) can receive a second measurement audio signal from a second external device (320) via the communication interface (130).
[0216] A decision module (740) related to audio setting information can obtain second audio setting information based on the first measurement audio signal and the second measurement audio signal. The electronic device (100) can analyze the first measurement audio signal and the second measurement audio signal to change (or update) the first audio setting information to the second audio setting information.
[0217] A decision module (740) related to audio setting information can obtain second audio setting information based on a first target audio signal, a first measurement audio signal, and a second measurement audio signal.
[0218] The decision module (740) related to audio setting information can determine second audio setting information based on the first target audio signal, the first measured audio signal, the second measured audio signal, and context information. The decision module (740) related to audio setting information can transmit the second audio setting information to the audio providing module (750). The decision module (740) related to audio setting information can transmit the second audio setting information to the audio output device (200) via the communication interface (130).
[0219] The audio providing module (750) can determine a second target audio signal to be transmitted to the audio output device (200). The audio providing module (750) can identify the second target audio signal based on the second audio setting information. The audio providing module (750) can obtain a second target audio signal suitable for the location of the audio output device (200) included in the second audio setting information. The audio providing module (750) can transmit the second target audio signal to the audio output device (200) through the communication interface (130).
[0220] The audio output device (200) can receive second audio setting information and a second target audio signal from the electronic device (100) through the communication interface (201). The audio output device (200) can store and set the second audio setting information through the audio setting module (202). The audio output device (200) can output the second target audio signal through the audio output module (203). The audio output device (200) can output the second target audio signal using the second audio setting information.
[0221] FIG. 8 is a diagram for explaining an operation of obtaining audio setting information according to one embodiment.
[0222] Referring to FIG. 8, the electronic device (100) can obtain context information (S810). The context information may include at least one of audio setting history information, spatial information, or location information.
[0223] The electronic device (100) can obtain first audio setting information (S820). The electronic device (100) can obtain the first audio setting information based on context information. The electronic device (100) can provide a first target audio signal based on the first audio setting information.
[0224] For example, the act of providing the first target audio signal may include the act of transmitting the first target audio signal to an audio output device (200). The audio output device (200) may output the first target audio signal based on the first audio setting information.
[0225] For example, the act of providing the first target audio signal may include the act of outputting the first target audio signal through the speaker (170). The electronic device (100) may output directly through the speaker (170).
[0226] The electronic device (100) can obtain a measurement audio signal (S850). The electronic device (100) can obtain a measurement audio signal that records the output first target audio signal.
[0227] For example, the electronic device (100) can obtain a measurement audio signal recorded from an external device through a microphone included in the external device.
[0228] For example, the electronic device (100) can obtain a measured audio signal recorded through a microphone (180) included in the electronic device (100).
[0229] The electronic device (100) can obtain second audio setting information (S860). The electronic device (100) can analyze the measured audio signal to obtain the second audio setting information. The electronic device (100) can obtain the second audio setting information after obtaining the first audio setting information. The electronic device (100) can change the first audio setting information to the second audio setting information.
[0230] FIG. 9 is a drawing specifically explaining an operation of obtaining audio setting information according to one embodiment.
[0231] Steps S910, S920, S950, and S960 of FIG. 9 may correspond to steps S810, S820, S850, and S860 of FIG. 8. Duplicate explanations are omitted.
[0232] The electronic device (100) can obtain context information for audio settings (S910).
[0233] The electronic device (100) can obtain first audio setting information (S920). The electronic device (100) can obtain first audio setting information based on context information.
[0234] The electronic device (100) can obtain a first target audio signal (S930). The electronic device (100) can obtain the first target audio signal based on first audio setting information. The electronic device (100) can obtain the first target audio signal based on context information and the first audio setting information. The first target audio signal can represent an audio signal to be output through the audio output device (200). The first target audio signal can be a pre-stored test audio signal. The test audio signal can vary depending on the number of speakers included in the audio output device (200).
[0235] The electronic device (100) can transmit first audio setting information and a first target audio signal to the audio output device (200) (S940). The electronic device (100) and the audio output device (200) can be mutually connected for communication.
[0236] The electronic device (100) can obtain a first measurement audio signal and / or a second measurement audio signal after transmitting a first target audio signal to an audio output device (200) (S950). The electronic device (100) can receive the first measurement audio signal from a first external device (310). The electronic device (100) can receive the second measurement audio signal from a second external device (320).
[0237] The electronic device (100) can obtain second audio setting information (S960). The electronic device (100) can obtain the second audio setting information based on at least one of the first measurement audio signal or the second measurement audio signal. The first measurement audio signal and the second measurement audio signal may be signals recorded using microphones included in a first external device (310) and a second external device (320) other than the electronic device (100). The first external device (310) and the second external device (320) may be earsets carried by the user. The first measurement audio signal and the second measurement audio signal recorded in each of the first external device (310) and the second external device (320) may be signals measured at the user's location.
[0238] The electronic device (100) can analyze at least one of the first measurement audio signal or the second measurement audio signal to obtain (or identify) second audio setting information suitable for the user.
[0239] The electronic device (100) can obtain a second target audio signal (S970). The electronic device (100) can obtain the second target audio signal based on second audio setting information. The electronic device (100) can obtain the second target audio signal based on context information and the second audio setting information. The second target audio signal can represent an audio signal to be output through the audio output device (200). The second target audio signal can represent content that is to be listened to through the audio output device (200).
[0240] The electronic device (100) can transmit second audio setting information and second target audio signal to the audio output device (200) (S980).
[0241] The transmission operation performed in steps S940 and S980 can utilize Bluetooth communication, UWB (Ultra-Wideband) communication, or Wi-Fi communication.
[0242] According to various embodiments, the transmission operation performed in step S940 may be a Bluetooth communication method (or a Wi-Fi communication method), and the transmission operation performed in step S980 may be a Wi-Fi communication method (or a Bluetooth communication method).
[0243] FIG. 10 is a diagram for explaining an operation of obtaining first audio setting information according to one embodiment.
[0244] Referring to FIG. 10, the electronic device (100) can obtain audio setting history information (S1011). The audio setting history information can be described as history information related to audio settings. The history information can include a past history of audio settings provided to the user.
[0245] The electronic device (100) can acquire spatial information (S1012). The spatial information may include information related to space. The spatial information may include at least one of spatial shape, spatial size, or object characteristics. The object may represent an object identified in the space. The object characteristics may represent classification criteria for indicating the identified object. For example, the object characteristics may represent obstacles, people, etc.
[0246] The electronic device (100) can obtain location information of the first external device (310) (S1013). The electronic device (100) can obtain location information of the second external device (320) (S1014). The electronic device (100) can obtain location information of the audio output device (200) (S1015). The order of steps S1013, S1014, and S1015 may be changed.
[0247] According to one embodiment, the electronic device (100) can obtain location information using a preset communication method. The electronic device (100) can transmit a request signal for determining a location. The electronic device (100) can broadcast the request signal. The first external device (310), the second external device (320), and the audio output device (200) can transmit a response signal to the electronic device (100) in response to the request signal. The electronic device (100) can obtain location information of each of the first external device (310), the second external device (320), and the audio output device (200) based on the response signal. Each location information can be described as first location information, second location information, and third location information. The ordinal number can be changed.
[0248] According to one embodiment, the electronic device (100) may acquire a captured image of the surroundings of the electronic device (100) using the camera (190). The electronic device (100) may acquire location information of each of the first external device (310), the second external device (320), and the audio output device (200) based on the captured image. The first external device (310), the second external device (320), and the audio output device (200) may be identified from the captured image, and the respective location information may be acquired by analyzing the respective locations of the identified first external device (310), the second external device (320), and the audio output device (200).
[0249] The electronic device (100) can predict audio information through a simulation function (S1016). The simulation function may be a function that predicts the result of how an audio signal will sound without actually outputting the audio signal. The simulation function may be performed based on an artificial intelligence model. The artificial intelligence model may obtain context information as input data and output audio setting information as output data.
[0250] The electronic device (100) can obtain first audio setting information based on the predicted results of the simulation (S1020). The electronic device (100) can obtain first audio setting information based on the results of step S1016.
[0251] FIG. 11 is a diagram for explaining an operation of obtaining first audio setting information according to one embodiment.
[0252] Step S1150 of FIG. 11 may correspond to step S950 of FIG. 9. Duplicate explanation is omitted.
[0253] The electronic device (100) can obtain a first expected frequency response (expected level) predicted at the location of the first external device (310) when the first target audio signal is output at a first level at the location of the audio output device (200) (S1121). The first level can indicate the magnitude information of the specific frequency being output. The level can be described as sound pressure, volume, intensity, strength, etc.
[0254] The electronic device (100) can obtain an expected level related to the intensity of an audio signal based on the expected frequency response. For example, assume that an audio signal of 100 dB is output from a speaker located 10 m away from the electronic device (100). The electronic device (100) can predict that the audio signal will be obtained at 80 dB based on the expected frequency response.
[0255] A single target audio signal can be output for a single frequency band. A target audio signal corresponding to each of multiple frequency bands can be output. The output levels of each of the multiple frequency bands can be different.
[0256] The electronic device (100) can obtain a second expected frequency response (expected level) predicted at the location of the second external device (320) when the first target audio signal is output at the first level at the location of the audio output device (200) (S1122).
[0257] After the first target audio signal is output, the electronic device (100) can obtain at least one of the first measurement audio signal or the second measurement audio signal (S1150).
[0258] The electronic device (100) can obtain a first measurement frequency response (measurement level) corresponding to a first measurement audio signal and / or a second measurement frequency response (measurement level) corresponding to a second measurement audio signal (S1161).
[0259] The electronic device (100) can obtain a measured frequency response based on the measured audio signal. The electronic device (100) can identify a measured level representing the intensity of the audio signal based on the measured frequency response. The electronic device (100) can compare the measured level with the expected level.
[0260] The electronic device (100) can obtain a first comparison result based on the difference value between the first expected frequency response (expected level) and the first measured frequency response (measured level) (S1162).
[0261] The electronic device (100) can obtain a second comparison result based on the difference between the second expected frequency response (expected level) and the second measured frequency response (measured level) (S1163).
[0262] The electronic device (100) can change the EQ level based on the first comparison result and the second comparison result (S1164). The electronic device (100) can change the first level to the second level.
[0263] Based on the difference between the expected level and the measured level, the electronic device (100) can obtain audio setting information related to the audio output device (200). The audio setting information can include EQ setting information.
[0264] If the difference value obtained by subtracting the expected level from the measured level is greater than or equal to the first threshold value (positive), the electronic device (100) can change the audio setting information (EQ setting information) so that the audio signal is output at a second level that is lower than the first level.
[0265] If the difference between the measured level and the expected level is less than the second threshold value (negative), the electronic device (100) can change the audio setting information (EQ setting information) so that the audio signal is output at a third level greater than the first level.
[0266] If the difference between the measured level and the expected level is less than the first threshold (positive number) or greater than the second threshold (negative number), the electronic device (100) may maintain the first level. The electronic device (100) may not change the audio settings.
[0267] FIG. 12 is a diagram for explaining an operation of obtaining first audio setting information according to one embodiment.
[0268] Steps S1230, S1240, and S1250 of FIG. 12 may correspond to steps S930, S940, and S950 of FIG. 9. Duplicate explanations are omitted.
[0269] After obtaining the first measurement audio signal and / or the second measurement audio signal, the electronic device (100) can obtain time difference information of the first measurement audio signal and the second measurement audio signal (S1261).
[0270] The first measurement audio signal may be a signal recorded from a first external device (310). The second measurement audio signal may be a signal recorded from a second external device (320). The reception times of the same sound source (or the same signal pattern) may differ based on the difference in positions between the first external device (310) and the second external device (320). The difference in reception times may be included in the time difference information. The time difference information may include time delay information.
[0271] The electronic device (100) can obtain location information of the audio output device (200) based on time difference information (S1262).
[0272] The electronic device (100) can obtain 3D audio setup information based on the location information of the audio output device (200) (S1263). 3D audio can include technology that allows the user to experience a three-dimensional effect based on the temporal flow of the audio signal. 3D audio can enhance the immersive audio experience by adjusting the direction, distance, and height of the audio in a three-dimensional space.
[0273] FIG. 13 is a diagram for explaining an operation of providing audio setting information using multiple external devices according to one embodiment.
[0274] Steps S1310, S1320, S1330, S1340, S1360, S1370, and S1380 of FIG. 13 may correspond to steps S910, S920, S930, S940, S960, S970, and S980 of FIG. 9. Duplicate explanations are omitted.
[0275] The electronic device (100) can obtain context information (including at least one of audio setting history information, spatial information, location information of the first external device (310), location information of the second external device (320), and location information of the audio output device (200)) (S1310).
[0276] The electronic device (100) can obtain first audio setting information based on context information (S1320). The electronic device (100) can obtain a first target audio signal (S1330). The electronic device (100) can transmit the first audio setting information and the first target audio signal to the audio output device (200) (S1340).
[0277] After the first target audio signal is acquired, the electronic device (100) can transmit a recording control command to the first external device (310) (S1341-1). After the first target audio signal is acquired, at least one processor (120) can transmit a recording control command to the second external device (320) (S1341-2). The first external device (310) and the second external device (320) can record the audio signal based on the recording control command.
[0278] The audio output device (200) can receive first audio setting information and a first target audio signal from the electronic device (100). The audio output device (200) can output the first target audio signal based on the first audio setting information (S1345).
[0279] The first external device (310) can obtain a first measurement audio signal based on the outputted first target audio signal (S1350-1). The first external device (310) can transmit the first measurement audio signal to the electronic device (100) (S1355-1).
[0280] The second external device (310) can obtain a second measurement audio signal based on the output first target audio signal (S1350-2). The second external device (310) can transmit the second measurement audio signal to the electronic device (100) (S1355-2).
[0281] The electronic device (100) can receive a first measurement audio signal from a first external device (310). The electronic device (100) can receive a second measurement audio signal from a second external device (320).
[0282] The electronic device (100) can obtain second audio setting information based on at least one of the first measurement audio signal or the second measurement audio signal (S1360). The electronic device (100) can obtain a second target audio signal (S1370). The electronic device (100) can transmit the second audio setting information and the second target audio signal to the audio output device (200) (S1380).
[0283] The audio output device (200) can receive second audio setting information and a second target audio signal from the electronic device (100). The audio output device (200) can output a second target audio signal based on the second audio setting information (S1385).
[0284] FIG. 14 is a diagram for explaining an operation of providing audio setting information using multiple audio output devices according to one embodiment.
[0285] Steps S1410, S1420, S1430, S1441-1, S1441-2, S1450-1, S1450-2, S1455-1, S1455-2, S1460, S1470 of FIG. 14 may correspond to steps S1310, S1320, S1330, S1341-1, S1341-2, S1350-1, S1350-2, S1355-1, S1355-2, S1360, S1370 of FIG. 13. Duplicate explanations are omitted.
[0286] The audio output device (200) may include a first audio output device (210) and a second audio output device (220). The first audio output device (210) and the second audio output device (220) may each include separate speakers. Each speaker may be a speaker for outputting signals of different frequency bands.
[0287] The electronic device (100) can obtain first audio setting information (S1420). The electronic device (100) can obtain first sub audio setting information corresponding to the first audio output device (210). The electronic device (100) can obtain the first sub audio setting information based on the location information of the first audio output device (210). The electronic device (100) can obtain second sub audio setting information corresponding to the second audio output device (220). The electronic device (100) can obtain the second sub audio setting information based on the location information of the second audio output device (220). The first audio setting information can include first sub audio setting information and second sub audio setting information.
[0288] The electronic device (100) can obtain a first target audio signal (S1430). The electronic device (100) can obtain a first sub-target audio signal corresponding to the first audio output device (210). The electronic device (100) can obtain the first sub-target audio signal based on location information of the first audio output device (210). The electronic device (100) can obtain a second sub-target audio signal corresponding to the second audio output device (220). The electronic device (100) can obtain the second sub-target audio signal based on location information of the second audio output device (220). The first target audio signal can include the first sub-target audio signal and the second sub-target audio signal.
[0289] The electronic device (100) can transmit first sub audio setting information and first sub target audio signal to the first audio output device (210) (S1440-1).
[0290] The first audio output device (210) can receive first sub-audio setting information and a first sub-target audio signal from the electronic device (100). The first audio output device (210) can output the first sub-target audio signal based on the first sub-audio setting information (S1445-1).
[0291] The electronic device (100) can transmit second sub audio setting information and second sub target audio signal to the second audio output device (220) (S1440-2).
[0292] The second audio output device (220) can receive second sub-audio setting information and a second sub-target audio signal from the electronic device (100). The second audio output device (220) can output a second sub-target audio signal based on the second sub-audio setting information (S1445-2).
[0293] While the first sub-target audio signal is output from the first audio output device (210) and the second sub-target audio signal is output from the second audio output device (220), the first external device (310) can obtain the first measurement audio signal (S1450-1). The first measurement audio signal can include the first sub-target audio signal and the second sub-target audio signal.
[0294] While the first sub-target audio signal is output from the first audio output device (210) and the second sub-target audio signal is output from the second audio output device (220), the second external device (320) can obtain the second measurement audio signal (S1450-2). The second measurement audio signal can include the first sub-target audio signal and the second sub-target audio signal.
[0295] The electronic device (100) can obtain second audio setting information (S1460).
[0296] The electronic device (100) can analyze the first measurement audio signal and the second measurement audio signal to obtain second audio setting information. The electronic device (100) can obtain an analysis result based on the first measurement audio signal and the second measurement audio signal.
[0297] The electronic device (100) can obtain third sub-audio setting information corresponding to the first audio output device (210). The electronic device (100) can obtain the third sub-audio setting information based on the analysis result and the location information of the first audio output device (210).
[0298] The electronic device (100) can obtain fourth sub-audio setting information corresponding to the second audio output device (220). The electronic device (100) can obtain fourth sub-audio setting information based on the analysis result and the location information of the second audio output device (220). The second audio setting information can include third sub-audio setting information and fourth sub-audio setting information.
[0299] The electronic device (100) can obtain a second target audio signal (S1470). The electronic device (100) can obtain a third sub-target audio signal corresponding to the first audio output device (210). The electronic device (100) can obtain the third sub-target audio signal based on location information of the first audio output device (210). The electronic device (100) can obtain a fourth sub-target audio signal corresponding to the second audio output device (220). The electronic device (100) can obtain the fourth sub-target audio signal based on location information of the second audio output device (220). The second target audio signal can include the third sub-target audio signal and the fourth sub-target audio signal.
[0300] The electronic device (100) can transmit third sub audio setting information and third sub target audio signal to the first audio output device (210) (S1480-1).
[0301] The first audio output device (210) can receive third sub-audio setting information and a third sub-target audio signal from the electronic device (100). The first audio output device (210) can output a third sub-target audio signal based on the third sub-audio setting information (S1485-1).
[0302] The electronic device (100) can transmit the fourth sub audio setting information and the fourth sub target audio signal to the second audio output device (220) (S1480-2).
[0303] The second audio output device (220) can receive fourth sub-audio setting information and fourth sub-target audio signal from the electronic device (100). The second audio output device (220) can output the fourth sub-target audio signal based on the fourth sub-audio setting information (S1485-2).
[0304] FIG. 15 is a diagram for explaining an operation of providing audio setting information using an external device and an audio output device according to one embodiment.
[0305] Steps S1510, S1520, S1530, S1540, S1545, S1560, S1570, S1580, and S1585 of FIG. 15 may correspond to steps S1310, S1320, S1330, S1340, S1345, S1360, S1370, S1380, and S1385 of FIG. 13. Duplicate explanations are omitted.
[0306] Unlike FIG. 13, FIG. 15 describes the external device (300) as a single device. For example, the external device (300) may include a single device. For example, the external device (300) may include multiple devices.
[0307] When the first target audio signal is acquired, the electronic device (100) can transmit a recording control command to the external device (300) (S1541). When the recording control command is received, the external device (300) can record the audio signal.
[0308] When the first target audio signal is output from the audio output device (200), the external device (300) can obtain a measurement audio signal (S1550). The external device (300) can transmit the measurement audio signal to the electronic device (100) (S1555).
[0309] The electronic device (100) can receive a measurement audio signal from an external device (300). The electronic device (100) can analyze the received measurement audio signal to obtain an analysis result. The electronic device (100) can obtain second audio setting information based on the analysis result (S1560). Thereafter, the electronic device (100) can perform steps S1570, S1580, and S1585.
[0310] FIG. 16 is a diagram for explaining an operation of providing audio setting information using a terminal device according to one embodiment.
[0311] Steps S1610, S1620, S1630, S1640, S1641-1, S1641-2, S1645, S1650-1, S1650-2, S1655-1, S1655-2, S1660, S1670, S1680, S1685 of FIG. 16 may correspond to steps S1310, S1320, S1330, S1340, S1341-1, S1341-2, S1345, S1350-1, S1350-2, S1355-1, S1355-2, S1360, S1370, S1380, S1385 of FIG. 13. Duplicate explanations are omitted.
[0312] The electronic device (100) can be connected to a terminal device (330). The terminal device (330) can be connected to the electronic device (100) through a preset communication method. For example, the electronic device (100) can be connected to the terminal device (330) based on a Bluetooth communication method, a UWB communication method, or a Wi-Fi communication method.
[0313] When the first target audio signal is output through the audio output device (200), the terminal device (330) can obtain a third measurement audio signal (S1650-3). The terminal device (330) may include a microphone and can obtain a third measurement audio signal that records the first target audio signal through the microphone. The terminal device (330) can transmit the third measurement audio signal to the electronic device (100) (S1655-3).
[0314] The electronic device (100) can receive a third measurement audio signal from the terminal device (330). The electronic device (100) can obtain second audio setting information based on at least one of the first measurement audio signal received from the first external device (310), the second measurement audio signal received from the second external device (320), or the third measurement audio signal received from the terminal device (330) (S1660).
[0315] The electronic device (100) can obtain an analysis result based on at least one of the first measurement audio signal, the second measurement audio signal, or the third measurement audio signal. The electronic device (100) can change (or update) the first audio setting information to second audio setting information based on the analysis result. The electronic device (100) can obtain a second target audio signal based on at least one of the analysis result or the second audio setting information (S1670).
[0316] Thereafter, the electronic device (100) can perform steps S1680 and S1685.
[0317] According to various embodiments, the electronic device (100) may be connected to a first external device (310), a second external device (320), and a terminal device (330). Each of the first external device (310), the second external device (320), and the terminal device (330) may include its own microphone.
[0318] The electronic device (100) can receive a first measurement audio signal from a first external device (310).
[0319] The electronic device (100) can receive a second measurement audio signal from a second external device (320).
[0320] The electronic device (100) can receive a third measurement audio signal from the terminal device (330).
[0321] The electronic device (100) can adjust the EQ level of the audio output device (200) or adjust the sound pressure intensity by frequency based on the third measurement audio signal.
[0322] The electronic device (100) can obtain setting information related to stereophonic sound through sound direction recognition of the audio output device (200) based on the first measurement audio signal and the second measurement audio signal.
[0323] FIG. 17 is a diagram for explaining an operation of obtaining first audio setting information according to one embodiment.
[0324] Referring to FIG. 17, the electronic device (100) can obtain location information of the terminal device (330) (S1711). The electronic device (100) can obtain context information including the location information of the terminal device (330). Based on the context information, the electronic device (100) can obtain first audio setting information and a first target audio signal.
[0325] After the first audio setting information and the first target audio signal are acquired, the electronic device (100) can acquire a third predicted frequency response predicted at the location of the terminal device (330) when the first target audio signal is output at the first level at the location of the audio output device (200) (S1721).
[0326] After the first target audio signal is output from the audio output device (200), the electronic device (100) can receive a third measurement audio signal from the terminal device (330) (S1751).
[0327] The electronic device (100) can obtain a third measurement frequency response (measurement level) corresponding to the third measurement audio signal (S1761). The electronic device (100) can obtain a third comparison result based on the difference between the third expected frequency response (expected level) and the third measured frequency response (measurement level) (S1762).
[0328] The electronic device (100) can change the EQ level based on the third comparison result (S1763). The electronic device (100) can change the first level to the second level.
[0329] The electronic device (100) can additionally change the EQ level by utilizing the first comparison result and the second comparison result mentioned in the embodiment of FIG. 11. The electronic device (100) can change the EQ level based on at least one of the first comparison result, the second comparison result, or the third comparison result. The contents related to FIG. 11 can be equally applied to the embodiment of FIG. 17.
[0330] FIG. 18 is a drawing for explaining a screen related to audio setting information according to one embodiment.
[0331] Referring to FIG. 18, the electronic device (100) may provide a screen (1800) related to audio settings. When first audio setting information or second audio setting information is obtained, the electronic device (100) may provide the screen (1800) related to audio settings.
[0332] The screen (1800) may include history information related to audio settings. The screen (1800) may include at least one of a UI (1810) indicating that the screen is related to audio settings, a UI (1820) indicating user personal preference settings, a UI (1830) indicating preset EQ settings, a UI (1840) indicating user age, and a UI (1850) indicating user hearing ability information.
[0333] The electronic device (100) can receive user input related to audio settings through the screen (1800). The electronic device (100) can change (or update) the audio settings based on the user input.
[0334] For example, when user input is received through the UI (1840), the electronic device (100) can change the user age based on the user input.
[0335] For example, when user input is received through the UI (1850), the electronic device (100) can change user hearing ability information based on the user input.
[0336] FIG. 19 is a diagram for explaining a screen for obtaining context information according to one embodiment.
[0337] Referring to FIG. 19, the electronic device (100) may provide a screen (1900) related to a hearing test. The electronic device (100) may obtain context information. The context information may include information on the user's hearing ability. The electronic device (100) may obtain information on the user's hearing ability based on the hearing ability test.
[0338] The electronic device (100) can initiate a hearing ability test based on a preset event. When an event occurs in which a preset user command is received or an event in which a preset application is executed, the electronic device (100) can perform a function corresponding to the hearing test.
[0339] The electronic device (100) may provide a screen (1900) related to a hearing test. The screen (1900) may include at least one of a UI (1910) indicating a hearing test and a guide UI (1920) related to a hearing test.
[0340] The UI (1920) may be a UI that guides selection of one of the preset first candidate sound or the preset second candidate sound.
[0341] FIG. 20 is a drawing for explaining a screen for performing audio settings according to one embodiment.
[0342] Referring to FIG. 20, the electronic device (100) may provide a screen (2000) related to audio settings.
[0343] The screen (2000) may include at least one of a UI (2010) indicating that a screen related to audio settings is provided, a UI (2020) including image information representing an external device, and a UI (2030) including a guide operation related to audio settings.
[0344] The UI (2030) may include at least one of information indicating that test audio is output and information indicating a guide operation for wearing a device included in the UI (2020). The device included in the UI (2020) may include image information corresponding to at least one of the first external device (310) or the second external device (320).
[0345] The user can easily recognize that he or she must perform the guide actions included in the UI (2030) in relation to the device corresponding to the UI (2020) through the screen (2000).
[0346] FIG. 21 is a drawing for explaining a screen indicating the location of an audio output device according to one embodiment.
[0347] Referring to FIG. 21, the electronic device (100) may provide a screen (2100) for changing the position of the audio output device (200). The electronic device (100) may obtain position information of the audio output device (200). The electronic device (100) may change the position of the audio output device (200) to provide an optimal audio environment. In the process of obtaining the first audio setting information, the electronic device (100) may identify that the position of the audio output device (200) needs to be changed. The electronic device (100) may provide a guide screen (2100) for changing the position of the audio output device (200).
[0348] The screen (2100) may include at least one of a UI (2110) indicating that a change in the position of the audio output device (200) is required, and a UI (2120) including image information guiding the changed position. The UI (2120) may include the existing position and the changed position of the audio output device (200).
[0349] FIG. 22 is a diagram for explaining an operation of obtaining second audio setting information according to one embodiment.
[0350] An embodiment (2210) of FIG. 22 may represent a situation in which an audio output device (200) is positioned in front of a user. In the embodiment (2210), it is assumed that the user wears a first external device (310) and a second external device (320). Since the audio output device (200) is positioned in front of the user, the time difference information between the first measured audio signal obtained from the first external device (310) and the second measured audio signal obtained from the second external device (320) may be 0.
[0351] An embodiment (2220) of FIG. 22 may represent a situation in which an audio output device (200) is positioned at the user's side. In the embodiment (2220), it is assumed that the user wears a first external device (310) and a second external device (320). Since the audio output device (200) is positioned at the user's side, the time difference information between the first measurement audio signal obtained from the first external device (310) and the second measurement audio signal obtained from the second external device (320) may not be 0.
[0352] The electronic device (100) can obtain time difference information by analyzing the first measurement audio signal and the second measurement audio signal. Based on the time difference information, the location of the audio output device (200) can be obtained (or verified).
[0353] It is assumed that the first external device (310) is worn on the left side based on the direction in which the user is looking at the audio output device (200). It is assumed that the second external device (320) is worn on the right side based on the direction in which the user is looking at the audio output device (200).
[0354] For example, if the time difference information between the first measurement audio signal and the second measurement audio signal is 0, the electronic device (100) can identify that the audio output device (200) is located in front of the user.
[0355] For example, if the first target audio signal is received earlier than the second target audio signal, the electronic device (100) can identify that the audio output device (200) is located on the left side of the user.
[0356] For example, if the first target audio signal is received later than the second target audio signal, the electronic device (100) can identify that the audio output device (200) is located on the right side of the user.
[0357] The electronic device (100) can identify that a time difference in the pulse of an audio signal occurs depending on the direction of the speaker. The electronic device (100) can recognize up / down / left / right stereoscopic sound.
[0358] An embodiment (2230) of FIG. 22 illustrates a situation in which an audio signal is reflected (or diffracted) by one surface of a space. An audio signal output from an audio output device (200) may be reflected by a specific surface (such as a wall or ceiling). An audio signal that is not reflected may be described as a direct wave, and a reflected audio signal may be described as a reflected wave. The electronic device (100) may obtain (or verify) spatial information by comparing the direct wave and the reflected wave in the measured audio signal. The spatial information may include at least one of a spatial shape and a spatial size. The electronic device (100) may confirm (or verify) whether the output of the audio output device (200) placed in the listening space is normally performed at the user's location.
[0359] FIG. 23 is a diagram for explaining an operation of obtaining audio setting information according to one embodiment.
[0360] Referring to FIG. 23, the electronic device (100) can obtain images (2311, 2312) including the user's ears. The electronic device (100) can input the images (2311, 2312) into an ear image analysis module (2320) to obtain ear appearance information.
[0361] The ear image analysis module (2320) can acquire ear appearance information including characteristic information related to the user's ear. The ear appearance information may include ear shape information. The ear shape information may include information indicating the structure or shape of the ear.
[0362] The electronic device (100) can obtain audio setting information by inputting ear shape information into the audio setting information determination module (2330). The audio setting information determination module (2330) can additionally use ear shape information to obtain audio setting information.
[0363] The electronic device (100) can obtain setting information related to stereophonic sound based on ear shape information. Since ear shape information varies for each user, by obtaining the user's unique ear shape information, the electronic device (100) can provide a personalized audio environment to the user.
[0364] The electronic device (100) can classify the external appearance information of the ear into a plurality of preset types. The preset types can be classified based on the shape of the ear, the size of the ear hole, etc.
[0365] The electronic device (100) can store a mapping table that maps ears and audio settings, including first audio setting information corresponding to the first type and second audio setting information corresponding to the second type.
[0366] The electronic device (100) can identify the user's ear type based on ear shape information. The electronic device (100) can obtain audio setting information corresponding to the identified user's ear type based on a mapping table. If the user's ear is identified as a first type based on an image including the user's ear, the electronic device (100) can obtain first audio setting information corresponding to the first type based on the mapping table. The electronic device (100) can transmit the first audio setting information to the audio output device (200).
[0367] FIG. 24 is a diagram illustrating a user database according to one embodiment.
[0368] Referring to FIG. 24, the electronic device (100) may store a database related to at least one user. The database may include a table (2400) containing history information related to at least one user.
[0369] Table (2400) may include at least one of identification information, user name, preferred volume, preferred frequency, and level associated with EQ settings. Table (2400) may include a user's settings history related to the audio environment.
[0370] The electronic device (100) can store a database containing a user's setting history related to the audio environment.
[0371] If it is determined that a user has accessed, the electronic device (100) can obtain history information corresponding to the user. Based on the obtained history information, the electronic device (100) can obtain audio setting information corresponding to the user.
[0372] An electronic device (100) can scan (or search) peripheral devices present around the electronic device (100). The electronic device (100) can obtain identification information of the scanned peripheral devices. The electronic device (100) can determine whether the identification information is pre-registered information. The identification information may include at least one of the device's identification information or the user's account information.
[0373] If the identification information is pre-registered information, the electronic device (100) can obtain audio setting information (or history information) stored in the database based on the identification information.
[0374] According to various embodiments, if two peripheral devices are scanned and both devices are pre-registered, the electronic device (100) can acquire audio setting information based on the pre-stored priority. For example, assume that the first user is an administrator and the second user is a general user. If both the first user's device and the second user's device are scanned, the electronic device (100) can acquire and apply audio setting information corresponding to the first user.
[0375] According to various embodiments, if there are two scanned peripheral devices and both devices are pre-registered, the electronic device (100) may obtain final audio setting information using the average (or median) of the audio setting information of each of the two devices. For example, the electronic device (100) may obtain and apply final audio setting information using the average (or median) of the audio setting information corresponding to the first user and the audio setting information corresponding to the second user.
[0376] FIG. 25 is a diagram for explaining an operation of obtaining first audio setting information using a pre-registered terminal device according to one embodiment.
[0377] Referring to FIG. 25, the electronic device (100) can scan a peripheral device (S2501). The electronic device (100) can identify a first terminal device based on the scan result (S2502). The electronic device (100) can identify whether the first terminal device is already registered (S2503). The electronic device (100) can identify whether the first terminal device or a user account corresponding to the first terminal device is already registered based on a pre-stored database.
[0378] When the first terminal device is pre-registered (S2053-Y), the electronic device (100) can obtain first audio setting information corresponding to the pre-registered first terminal device (S2504).
[0379] If the first terminal device is not pre-registered (S2503-N), the electronic device (100) can obtain context information for audio settings (S2510). The electronic device (100) can obtain first audio setting information based on the context information (S2520).
[0380] Steps S2510 and S2520 may correspond to steps S910 and S920 of FIG. 9. Duplicate descriptions are omitted. When first audio setting information is acquired based on steps S2504 and S2520, the electronic device (100) may perform steps S930 to S980 of FIG. 9.
[0381] FIG. 26 is a drawing for explaining a control method of an electronic device (100) according to one embodiment.
[0382] Referring to FIG. 26, a control method of an electronic device storing history information related to audio settings and communicating with an audio output device, a first external device including a microphone, and a second external device including a microphone includes the steps of obtaining first audio setting information based on the history information (S2605), transmitting the first audio setting information and information on a first target audio signal for testing to the audio output device (S2610), receiving from the first external device information on a first measurement audio signal that records information on the first target audio signal output from the audio output device (S2615), receiving from the second external device information on a second measurement audio signal that records information on the first target audio signal output from the audio output device (S2620), obtaining second audio setting information based on the information on the first measurement audio signal and the information on the second measurement audio signal (S2625), and transmitting the second audio setting information and information on the second target audio signal for a user to the audio output device (S2630).
[0383] The history information may include at least one of preferred volume, preferred frequency band, preferred style, preferred EQ (Equalizer) setting information, or hearing ability information, and the hearing ability information may include at least one of user age, user gender, and audible frequency range.
[0384] The step of obtaining first audio setting information (S2605) may obtain first location information of a first external device and second location information of a second external device based on the location of the electronic device, and obtain first audio setting information based on history information, the first location information, and the second location information.
[0385] The step of obtaining first audio setting information (S2605) may obtain third location information of an audio output device and obtain first audio setting information based on the history information and the third location information.
[0386] The step of obtaining second audio setting information (S2625) may include obtaining a first expected frequency response (expected level) predicted at the location of the first external device when a first target audio signal is output from the audio output device, obtaining a first measured frequency response (measured level) corresponding to the first measured audio signal, obtaining a difference value between the first expected frequency response (expected level) and the first measured frequency response (measured level), and applying the difference value to the first audio setting information to obtain second audio setting information.
[0387] The step of obtaining first audio setting information (S2605) obtains spatial information including characteristics of a space in which an electronic device is placed, and obtains first audio setting information based on history information and spatial information, and the spatial information may include at least one of a spatial shape or a spatial size.
[0388] The control method may include a step of obtaining user identification information corresponding to a first external device or a second external device and a step of obtaining history information corresponding to the identification information among a plurality of user-specific history information stored in the electronic device.
[0389] The audio output device may include a first audio output device and a second audio output device, and the second audio setting information may include first stereophonic sound information corresponding to the first audio output device and second stereophonic sound information corresponding to the second audio output device.
[0390] Information about the first measurement audio signal may include an audio signal obtained while a noise canceling function is performed in the first external device, and information about the second measurement audio signal may include an audio signal obtained while a noise canceling function is performed in the second external device.
[0391] The first external device may be the left device of the earset, and the second external device may be the right device of the earset.
[0392] The methods according to the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.
[0393] The methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for an existing electronic device.
[0394] The various embodiments of the present disclosure described above may also be performed through an embedded server provided in an electronic device, or an external server of at least one of the electronic device and the display device.
[0395] According to an example embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device according to the disclosed embodiments, which is a device that can call instructions stored in the storage medium and operate according to the called instructions. When the instructions are executed by a processor, the processor may directly or under the control of the processor use other components to perform a function corresponding to the instructions. The instructions may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not contain signals and is tangible, but does not distinguish between whether data is stored semi-permanently or temporarily in the storage medium.
[0396] According to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0397] Each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.
[0398] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea of the present disclosure.
Claims
1. In electronic devices, Memory that stores history information related to audio settings; A communication interface for communicating with an audio output device, a first external device including a microphone, and a second external device including a microphone; and comprising at least one processor; At least one processor of the above, Obtain first audio setting information based on the above history information, Transmitting the first audio setting information and information about the first target audio signal for testing to the audio output device, Receive information about a first measurement audio signal that records information about the first target audio signal output from the audio output device from the first external device through the communication interface, Receive information about a second measurement audio signal that records information about the first target audio signal output from the audio output device from the second external device through the communication interface, Obtain second audio setting information based on information about the first measurement audio signal and information about the second measurement audio signal, An electronic device that transmits the second audio setting information and information about a second target audio signal for a user to the audio output device through the communication interface.
2. In paragraph 1, The above history information is, Contains at least one of the following: preferred volume, preferred frequency band, preferred style, preferred EQ (Equalizer) setting information, or hearing ability information; The above hearing ability information is, An electronic device comprising at least one of user age, user gender, and audible frequency range.
3. In paragraph 1, At least one processor of the above, Obtaining first location information of the first external device and second location information of the second external device based on the location of the electronic device, An electronic device that obtains the first audio setting information based on the above history information, the first location information, and the second location information.
4. In paragraph 1, At least one processor of the above, Obtain third location information of the above audio output device, An electronic device that obtains the first audio setting information based on the above history information and the third location information.
5. In paragraph 1, At least one processor of the above, When the first target audio signal is output from the audio output device, a first expected frequency response predicted at the location of the first external device is obtained, Obtaining a first measurement frequency response corresponding to the first measurement audio signal, Obtain the difference value between the first expected frequency response and the first measured frequency response, An electronic device that obtains the second audio setting information by applying the difference value to the first audio setting information.
6. In paragraph 1, At least one processor of the above, Obtaining spatial information including the characteristics of the space in which the electronic device is placed, Obtaining the first audio setting information based on the above history information and the above spatial information, The above spatial information is, An electronic device comprising at least one of a spatial shape or a spatial size.
7. In paragraph 1, At least one processor of the above, Obtaining user identification information corresponding to the first external device or the second external device, An electronic device that obtains the history information corresponding to the identification information among a plurality of user-specific history information stored in the memory.
8. In paragraph 1, The above audio output device, Including a first audio output device and a second audio output device, The above second audio setting information is, An electronic device including first stereoscopic sound information corresponding to the first audio output device and second stereoscopic sound information corresponding to the second audio output device.
9. In paragraph 1, Information about the above first measurement audio signal, Contains an audio signal obtained while the noise canceling function is performed in the first external device; Information about the second measurement audio signal, An electronic device comprising an audio signal obtained while a noise canceling function is performed in the second external device.
10. In paragraph 1, The above first external device, It is the left device of the earset, The above second external device is, An electronic device, which is the right-hand device of the above earset.
11. A method for controlling an electronic device that stores history information related to audio settings and communicates with an audio output device, a first external device including a microphone, and a second external device including a microphone, The above control method is, A step of obtaining first audio setting information based on the above history information; A step of transmitting the first audio setting information and information about the first target audio signal for testing to the audio output device; A step of receiving information about a first measurement audio signal, which records information about the first target audio signal output from the audio output device, from the first external device; A step of receiving information about a second measurement audio signal, which records information about the first target audio signal output from the audio output device, from the second external device; A step of obtaining second audio setting information based on information about the first measurement audio signal and information about the second measurement audio signal; and A control method, comprising: a step of transmitting the second audio setting information and information about a second target audio signal for a user to the audio output device.
12. In paragraph 11, The above history information is, Contains at least one of the following: preferred volume, preferred frequency band, preferred style, preferred EQ (Equalizer) setting information, or hearing ability information; The above hearing ability information is, A control method comprising at least one of user age, user gender, and audible frequency range.
13. In paragraph 11, The step of obtaining the above first audio setting information is: Obtaining first location information of the first external device and second location information of the second external device based on the location of the electronic device, A control method for obtaining the first audio setting information based on the above history information, the first location information, and the second location information.
14. In paragraph 11, The step of obtaining the above first audio setting information is: Obtain third location information of the above audio output device, A control method for obtaining the first audio setting information based on the above history information and the third location information.
15. In paragraph 11, The step of obtaining the second audio setting information is: When the first target audio signal is output from the audio output device, a first expected frequency response predicted at the location of the first external device is obtained, Obtaining a first measurement frequency response corresponding to the first measurement audio signal, Obtain the difference value between the first expected frequency response and the first measured frequency response, A control method for obtaining the second audio setting information by applying the difference value to the first audio setting information.
Citation Information
Patent Citations
Electronic device, position detecting device, and system and method of automatically setting speaker
KR1020140099122A
System for tuning audio processing features and method thereof
KR1020150018327A
Hinge Device for Display Panel with Round Holding Bar
KR1020230019908A
Video surveillance system and method using communication between smart building system and blackbox of car
KR102040040B1
Multi-channel audio system, multi-channel audio device, program, and multi-channel audio playback method
US20230101944A1