Electronic device and method of controlling same

Abstract

The present invention relates to an electronic device for outputting binaural audio and a method of controlling same. The electronic device: recognizes a target sound image position on the basis of detection information on the movement of the head; determines some of a plurality of reference sound image positions stored in a memory as a plurality of indexes on the basis of the recognized target sound image position; acquires reference transfer functions and initial delays corresponding to the determined plurality of indexes on the basis of information stored in the memory; acquires a weight for each index on the basis of the determined plurality of indexes; generates a target transfer function on the basis of the acquired weight for each index, the acquired reference transfer functions, and the acquired initial delays; generates a sound image on the basis of an input source received from an external device and the generated target transfer function; and controls the output of the generated sound image.

Description

Electronic device and method of controlling the same

[0001] The disclosed invention relates to an electronic device that generates sound images through head tracking and outputs the generated sound images, and a method for controlling the same.

[0002] Recently, with the advancement of IT technology, various electronic devices have been developed. Most of these devices provide audio output.

[0003] Electronic devices are using binaural rendering technology to provide immersive and interactive audio.

[0004] Binaural rendering is the process of modeling 3D audio, which provides immersive sound in a three-dimensional space, as a two-channel audio output signal.

[0005] In this way, if 3D audio can be modeled as an audio signal transmitted to two human ears, the three-dimensional effect of 2D audio can be reproduced through two-channel audio output without a large number of speakers.

[0006] At this time, as the number of objects or channels contained in the audio signal subject to binaural rendering increases, the computational load and power consumption required for binaural rendering may increase. Accordingly, there is a need for technology to efficiently perform binaural rendering on input audio signals in electronic devices subject to computational and power constraints.

[0007] Additionally, limited memory capacity may limit the amount of Head Related Transfer Function (HRTF) data. The HRTF is a function that measures the frequency response according to direction when the same sound is generated from all directions.

[0008] This can result in a degradation of sound localization performance in electronic devices. Therefore, technologies that can increase the spatial resolution of audio signals reproduced in three-dimensional space, even with limited memory capacity, are in demand.

[0009] One aspect of the disclosed invention provides an electronic device and a control method thereof that generate a transfer function corresponding to a target sound image position based on a target sound image position, a plurality of reference sound image positions, a plurality of pre-stored transfer functions, and a plurality of pre-stored initial delays, and generates a sound image based on the generated transfer function.

[0010] According to the disclosed invention, an electronic device according to one aspect includes a memory that stores information on a plurality of reference sound image positions, and a plurality of reference transfer functions and initial delays corresponding to each of the plurality of reference sound image positions; a communication unit that receives head movement detection information; and a processor that recognizes a target sound image position based on the head movement detection information received by the communication unit, determines some of the plurality of reference sound image positions as a plurality of indexes based on the recognized target sound image positions, obtains a reference transfer function and an initial delay corresponding to the plurality of indices determined based on the information stored in the memory, obtains weights for each index based on the determined plurality of indices, and generates a target transfer function based on the obtained weights for each index, the obtained reference transfer function, and the obtained initial delay.

[0011] A plurality of indexes of an electronic device according to one aspect include a first index and a second index. The acquired first and second reference transfer functions include a first reference transfer function corresponding to the first index and a second reference transfer function corresponding to the second index.

[0012] A processor of an electronic device according to one aspect obtains a first weight for a first index and a second weight for a second index based on first and second indices, obtains a magnitude based on a first reference transfer function, a second reference transfer function and the first and second weights, and generates an interpolation transfer function based on one of the first and second reference transfer functions and the obtained magnitude.

[0013] A processor of an electronic device according to one aspect identifies a weight having a larger size among the first and second weights, obtains an index corresponding to the identified weight, and obtains a phase of a reference transfer function corresponding to the obtained index among the first and second reference transfer functions as a phase of a reference transfer function for generating an interpolation transfer function.

[0014] A processor of an electronic device according to one aspect generates an interpolation transfer function based on the phase and magnitude of a reference transfer function corresponding to an acquired index among the first and second reference transfer functions.

[0015] The acquired initial delays of the electronic device according to one aspect include a first initial delay corresponding to a first index and a second initial delay corresponding to a second index.

[0016] A processor of an electronic device according to one aspect obtains an adjustment delay based on first and second weights and first and second initial delays, and generates a target transfer function based on the obtained adjustment delay and the generated interpolation transfer function.

[0017] A processor of an electronic device according to one aspect obtains coordinate values ​​of a recognized target sound image location and coordinate values ​​of each of a plurality of reference sound image locations, obtains distance values ​​between the obtained coordinate values ​​of the recognized target sound image location and coordinate values ​​of each of the plurality of reference sound image locations, and obtains weights for each index based on the obtained distance values.

[0018] An electronic device according to one aspect further includes a speaker. A communication unit of the electronic device according to one aspect communicates with an external device. A processor of the electronic device according to one aspect generates a sound image based on an input source received from the external device and a generated target transfer function, and controls the speaker to output the generated sound image through the speaker.

[0019] The electronic device according to one aspect further includes a sensor unit that detects movement of the head and transmits the detected information to the processor through a communication unit.

[0020] A communication unit of an electronic device according to one aspect communicates with an external device and an audio output device. A processor of the electronic device according to one aspect generates a sound image based on an input source received from the external device and a generated target transfer function, and transmits the generated sound image to the audio output device.

[0021] The target sound image position of the electronic device according to one aspect includes a target azimuth angle and a target elevation angle. Each of the plurality of reference sound image positions of the electronic device according to one aspect includes a reference azimuth angle and a reference elevation angle.

[0022] A processor of an electronic device according to one aspect determines a predetermined number of reference azimuth angles in descending order of azimuth difference values ​​from a target azimuth angle among a plurality of reference azimuth angles, determines a predetermined number of reference elevation angles in descending order of altitude difference values ​​from a target elevation angle among a plurality of reference elevation angles, and determines a plurality of indices based on the determined predetermined number of reference azimuth angles and the determined predetermined number of reference elevation angles.

[0023] A processor of an electronic device according to one aspect generates a sound image based on a reference transfer function corresponding to a reference sound image position that is identical to a target sound image position based on the existence of a reference sound image position that is identical to a target sound image position among a plurality of reference sound image positions.

[0024] A method for controlling an electronic device according to another aspect comprises: recognizing a target sound image position based on detection information of head movement; determining a plurality of reference sound image positions stored in a memory as a plurality of indexes based on the recognized target sound image position; obtaining a reference transfer function and an initial delay corresponding to the plurality of indexes determined based on the information stored in the memory; obtaining weights for each index based on the determined plurality of indexes; generating a target transfer function based on the obtained weights for each index, the obtained reference transfer function, and the obtained initial delay; generating a sound image based on an input source received from an external device and the generated target transfer function; and controlling an output of the generated sound image.

[0025] A plurality of indices include a first index and a second index. The obtained first and second reference transfer functions include a first reference transfer function corresponding to the first index and a second reference transfer function corresponding to the second index. Generating an interpolation transfer function includes obtaining a first weight for the first index and a second weight for the second index based on the first and second indices, obtaining a magnitude based on the first reference transfer function, the second reference transfer function, and the first and second weights, and generating an interpolation transfer function based on the phase of one of the first and second reference transfer functions and the obtained magnitude.

[0026] A control method of an electronic device according to another aspect further includes identifying a weight having a larger size among the first and second weights, obtaining an index corresponding to the identified weight, and obtaining a phase of a reference transfer function corresponding to the obtained index among the first and second reference transfer functions as a reference phase of an interpolation transfer function.

[0027] Generating the interpolation transfer function includes generating the interpolation transfer function based on the phase and magnitude of the reference transfer function corresponding to the obtained index among the first and second reference transfer functions.

[0028] The acquired initial delays include a first initial delay corresponding to the first index and a second initial delay corresponding to the second index. Generating a target transfer function includes acquiring an adjustment delay based on the first and second weights and the first and second initial delays, and generating a target transfer function based on the acquired adjustment delay and the generated interpolated transfer function.

[0029] Obtaining weights for each index includes obtaining coordinate values ​​of a recognized target sound image location and coordinate values ​​of each of a plurality of reference sound image locations, obtaining distance values ​​between the obtained coordinate values ​​of the recognized target sound image location and coordinate values ​​of each of the plurality of reference sound image locations, and obtaining weights for each index based on each of the obtained distance values.

[0030] The target sound image position includes a target azimuth angle and a target elevation angle. Each of the plurality of reference sound image positions includes a reference azimuth angle and a reference elevation angle. Determining the plurality of indices includes determining a predetermined number of reference azimuth angles among the plurality of reference azimuth angles in descending order of azimuth difference values ​​from the target azimuth angle, determining a predetermined number of reference elevation angles among the plurality of reference elevation angles in descending order of altitude difference values ​​from the target elevation angle, and determining a plurality of indices based on the determined predetermined number of reference azimuth angles and the determined predetermined number of reference elevation angles.

[0031] A method for controlling an electronic device according to another aspect further includes generating a target transfer function based on the absence of a reference sound position identical to a target sound position among a plurality of reference sound positions.

[0032] The present invention can alleviate timbre distortion while maintaining the sound localization performance of an input source.

[0033] The present invention can output a sound image corresponding to a user's target sound image position even when the number of reference information for binaural rendering (reference sound image position information, reference transfer function information, initial delay information, etc.) is small.

[0034] The present invention can minimize the capacity of memory because it can reduce the amount of information stored in the memory of an electronic device.

[0035] The present invention can improve the marketability of electronic devices for audio output and secure competitiveness of electronic devices.

[0036] Figure 1 is a schematic diagram of an audio system including an electronic device according to one embodiment.

[0037] Figure 2 is a control configuration diagram of an electronic device according to one embodiment.

[0038] FIG. 3 and FIG. 4 are examples of recognition of the head position of a user of an audio device according to an embodiment.

[0039] FIG. 5 is a specific configuration diagram of a processor of an electronic device according to one embodiment.

[0040] FIG. 6a is an example diagram of coordinate values ​​of reference sound image positions and target sound image positions of an electronic device according to one embodiment, and FIG. 6b is a detailed example diagram of the coordinate values ​​shown in FIG. 6a.

[0041] Figure 7 is a control flowchart of an electronic device according to one embodiment.

[0042] FIG. 8 is an example diagram of a target sound location recognized by an electronic device according to one embodiment.

[0043] FIG. 9 is a block diagram of an audio system including an electronic device according to another embodiment.

[0044] Fig. 10 is a control configuration diagram of an electronic device according to another embodiment.

[0045] It should be understood that the various embodiments and terms used in this document are not intended to limit the technical features described in this document to specific embodiments, but rather to include various modifications, equivalents, or substitutes of the embodiments.

[0046] In connection with the description of the drawings, similar reference numerals may be used for similar or related components.

[0047] The singular form of a noun corresponding to an item may include one or more items, unless the context clearly indicates otherwise.

[0048] In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof.

[0049] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not limit the components in any other respect (e.g., importance or order).

[0050] When a component (e.g., a first component) is referred to as being "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0051] The terms "include" or "have" are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in this document, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0052] When a component is said to be “connected,” “coupled,” “supported,” or “in contact with” another component, this includes not only cases where the components are directly connected, coupled, supported, or in contact, but also cases where the components are indirectly connected, coupled, supported, or in contact through a third component.

[0053] When we say that a component is "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where there is another component between the two components.

[0054] The term "and / or" includes any combination of a plurality of related described elements or any one of a plurality of related described elements.

[0055] The operating principle and embodiments of the present invention will be described with reference to the attached drawings below.

[0056] FIG. 1 is a schematic diagram of an audio system including an electronic device according to one embodiment.

[0057] The electronic device (100) can communicate with an external device (200) and output video signals and audio signals received from the external device (200), or output video signals and audio signals received through communication, or output video and audio signals of content stored inside the electronic device (100).

[0058] The electronic device (100) may include, but is not limited to, a television, a user device, or a projector.

[0059] The user device may be carried by the user or placed in the user's home or office. The user device may be implemented as a computer or portable terminal that can connect to an external device (200) and an audio output device (300) via a network.

[0060] Here, the computer includes, for example, a notebook, desktop, laptop, tablet PC, slate PC, etc. equipped with a WEB browser, and the portable terminal includes, for example, a wireless communication device that ensures portability and mobility, such as a PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), WiBro (Wireless Broadband Internet) terminal, smart phone, etc., and may include all kinds of handheld-based wireless communication devices, and wearable devices such as watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted devices (HMD).

[0061] When the electronic device (100) is a user device, a program for controlling the audio output device (300), i.e., an application, may be stored in the memory of the user device. The application may be sold installed on the user device, or may be downloaded and installed from an external server (not shown).

[0062] A user can access a server by executing an application installed on a user device, create a user account, and communicate with the server based on the logged-in user account to register an audio output device (300).

[0063] For example, when the audio output device (300) is operated so that the audio output device (300) can be connected to the server according to the procedure guided by the application installed on the user device, the audio output device (300) can be registered to the user account by registering the identification information (e.g., serial number or MAC address) of the audio output device (300) to the corresponding user account on the server.

[0064] A user can control an audio output device (300) using an application installed on the user device. For example, when a user logs into a user account using an application installed on the user device, an audio output device (300) registered to the user account appears, and when a control command for the audio output device (300) is input, the control command can be transmitted to the audio output device (300) via the server.

[0065] An external device (200) transmits video signals and audio signals of the content to an electronic device (100).

[0066] The external device (200) may include, but is not limited to, a set-top box or an external memory device.

[0067] If the electronic device is a television or projector, the external device may include the user device.

[0068] The electronic device (100) can communicate with the audio output device (300) and transmit an audio signal to the audio output device (300).

[0069] The electronic device (100) can generate a sound image by binaural rendering an input source based on a transfer function corresponding to a target sound image location and transmit the generated sound image to an audio output device (300). Here, the transfer function can include a head-related transfer function (HRTF).

[0070] The input source is an input audio signal, which may be an audio signal received from an external device (200) or an audio signal stored in an electronic device (100).

[0071] The sound is an audio signal output through an audio output device (300), and may be an output audio signal.

[0072] The audio output device (300) can output sound received from the electronic device (100).

[0073] The audio output device (300) may include, but is not limited to, a headset, earphones, or a head-mounted display device capable of audio output.

[0074] FIG. 2 is a control configuration diagram of an electronic device according to one embodiment, which is described with reference to FIGS. 2 and 3.

[0075] FIGS. 3 and 4 are exemplary diagrams of the position of a user's head using an electronic device according to one embodiment.

[0076] An electronic device (100) may include an input unit (110), a communication unit (120), a display unit (130), a speaker (140), a processor (150), and a memory (160).

[0077] The input unit (110) receives user input.

[0078] The input unit (110) can receive user input related to audio output.

[0079] The input unit (110) can receive a power on command, a power off command, an audio play command, and an audio stop command.

[0080] The input unit (110) can receive a volume up command and a volume down command.

[0081] The input unit (110) can receive a content selection command.

[0082] The input unit (110) may include a button, a key, a tact switch, a push switch, a slide switch, a toggle switch, a micro switch, a touch switch, a touch pad, a touch screen, a jog dial, etc.

[0083] The communication unit (120) communicates with an external device (200) and an audio output device (300).

[0084] The communication unit (120) can receive an input source from an external device (200) and transmit the received input source to the processor (150).

[0085] The communication unit (120) can transmit sound to the audio output device (300) and receive detection information for head tracking of the user from the audio output device (300).

[0086] The communication unit (120) may include one or more components that enable communication with an external device (200) and an audio output device (300), and may include, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module.

[0087] The short-range communication module may include various short-range communication modules that transmit and receive signals using a wireless communication network at a short distance, such as a Bluetooth module, an infrared communication module, an RFID (Radio Frequency Identification) communication module, a WLAN (Wireless Local Access Network) communication module, an NFC communication module, and a Zigbee communication module.

[0088] The wired communication module may include various wired communication modules such as a Local Area Network (LAN) module, a Wide Area Network (WAN) module, or a Value Added Network (VAN) module, as well as various cable communication modules such as a Universal Serial Bus (USB), a High Definition Multimedia Interface (HDMI), a Digital Visual Interface (DVI), RS-232 (recommended standard 232), power line communication, or plain old telephone service (POTS).

[0089] The wireless communication module may include a wireless communication module that supports various wireless communication methods such as GSM (global System for Mobile Communication), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), UMTS (universal mobile telecommunications system), TDMA (Time Division Multiple Access), and LTE (Long Term Evolution), in addition to a WiFi module and a WiBro (Wireless broadband) module.

[0090] The display unit (130) can display information corresponding to the operating status of the electronic device (100) in response to a control command of the processor (150).

[0091] The display unit (130) can display video information of the content.

[0092] The display unit (130) can also display information corresponding to the operating status of the audio output device (300). For example, the display unit (130) can display the power-on status, power-off status, audio playback status, audio stop status, low battery charge status, etc. of the audio output device (300).

[0093] The display unit (130) may be provided as a digital light processing (DLP) panel, a plasma display panel, a liquid crystal display (LCD) panel, an electroluminescence (EL) panel, an electrophoretic display (EPD) panel, an electrochromic display (ECD) panel, a light emitting diode (LED) panel, or an organic light emitting diode (OLED) panel, but is not limited thereto.

[0094] The speaker (140) can output an audio signal corresponding to a control command of the processor (150).

[0095] The speaker (140) can stop outputting an audio signal in response to a control command from the processor (150).

[0096] There may be one or two or more speakers (140).

[0097] The speaker (140) may additionally include a converter (e.g., digital-to-analog converter, DAC) that converts a digital audio signal into an analog audio signal.

[0098] The processor (150) can control the overall operation of the electronic device (100).

[0099] The processor (150) can turn on or off the power of the electronic device (100) based on user input.

[0100] The processor (150) can recognize a command from a user input based on receiving a user input from the input unit (110) and control the operation of the display unit (130) based on the recognized command.

[0101] The processor (150) can recognize a command from a user input based on receiving a user input from the input unit (110) and control the operation of the speaker (140) based on the recognized command.

[0102] The processor (150) can recognize a command from a user input based on receiving a user input from the input unit (110) and control the operation of the audio output device (300) based on the recognized command.

[0103] The processor (150) can output an audio signal through the speaker (140) based on user input, or can stop outputting the audio signal.

[0104] The processor (150) can control the volume up or down of the audio output device (300) based on user input.

[0105] The processor (150) can control communication connection or communication blocking with the audio output device (300) based on user input.

[0106] The processor (150) recognizes the target sound position for the position of the user's head based on the detection information received through the communication unit (120).

[0107] The detection information may include acceleration information detected by an acceleration sensor provided in the audio output device and angular velocity information detected by a gyro sensor.

[0108] When recognizing a target sound position, the processor (150) can recognize the target azimuth angle and target elevation angle of the head.

[0109] As illustrated in FIG. 3, when the state of the head looking at the center of the external device (100) is referred to as the reference state (0 degrees), the azimuth angle is the angle by which the head is rotated when the user's head is rotated to the left or right from the reference state.

[0110] As shown in Figure 4, elevation is the angle at which the user's head moves up and down from the reference state.

[0111] The processor (150) recognizes whether there is a reference sound image position identical to a target sound image position among a plurality of reference sound image positions stored in the memory (160), recognizes a reference transfer function corresponding to the recognized reference sound image position based on the recognition that there is a reference sound image position identical to the target sound image position, and filters the recognized reference transfer function and an input source to generate a sound image.

[0112] The processor (150) can control the communication unit (120) to generate a transfer function corresponding to the target sound image position based on the input source, the target sound image position, the pre-stored reference transfer function, and the pre-stored initial delay based on the recognition that there is no reference sound image position identical to the target sound image position, filter the generated transfer function to generate a sound image having a three-dimensional effect and a sense of space, and output the generated sound image through the audio output device (300).

[0113] The input source may be an input audio signal that is the target of binaural rendering.

[0114] The sound image may be an output audio signal. The output audio signal may be a binaural audio signal. For example, the output audio signal may be a two-channel audio signal in which the input audio signal is represented as a virtual sound source located in three-dimensional space.

[0115] The specific configuration of this processor (150) will be described later with reference to FIG. 5.

[0116] The processor (150) can perform the above-described operation using data stored in the memory (160).

[0117] The processor (150) may include hardware such as a CPU or memory, and software such as a control program. For example, the processor (150) may include one or more processor chips that perform the aforementioned operations using an algorithm for controlling the operations of components within the audio device, at least one memory that stores program-type data, and data stored in the at least one memory, or may include one or more processing cores.

[0118] The processor (150) may include a separate NPU that performs the operation of the artificial intelligence model.

[0119] The memory (160) can store reference sound position information, reference transfer function information, and initial delay information.

[0120] The reference sound position information may include information about a plurality of reference sound positions.

[0121] The reference transfer function information includes information about a plurality of reference transfer functions, each corresponding to a plurality of reference sound positions.

[0122] The initial delay information may include information about a plurality of initial delays, each corresponding to a plurality of reference sound positions.

[0123] The plurality of reference sound positions may include a plurality of reference azimuth angles and a plurality of reference elevation angles.

[0124] As shown in Fig. 3, the reference azimuth angles are set at 30 degree intervals and can range from 0 degrees to 360 degrees clockwise.

[0125] The reference azimuth angles can be set at 45 degree intervals, or at 60 degree intervals, but are not limited thereto.

[0126] As shown in FIG. 4, the reference elevation angles can be set at 5 degree intervals or 10 degree intervals, and can range from -40 degrees to +40 degrees.

[0127] The reference elevation angles may be set at 3 degree intervals or 6 degree intervals, or may include, but are not limited to, -30 degrees to +30 degrees.

[0128] When multiple reference sound positions are (θ1, φ1), (θ2, φ1), (θ3, φ1), (θ1, φ2), ..., (θi, φj), the multiple reference transfer functions may include HRTFL(θ1, φ1), HRTFR(θ1, φ1)), ..., (HRTFL(θi, φj), HRTFR(θi, φj).

[0129] When a plurality of reference sound positions are (θ1, φ1), (θ2, φ1), (θ3, φ1), (θ1, φ2), ..., (θi, φj), a plurality of initial delays may include DeL(θ1, φ1), DeR(θ1, φ1)), ..., DeL(θi, φj), DeR(θi, φj).

[0130] The number or amount of information stored in the memory (160) can be determined based on the capacity of the memory (160).

[0131] That is, the number of reference sound positions corresponding to each of a plurality of reference sound positions, a plurality of reference transfer functions, and a plurality of initial delays may be less than or equal to a preset number, and may be determined based on the capacity of the memory (160).

[0132] Reference transfer function information is information that can be obtained by taking a fast Fourier transform (FFT) of a head-related impulse response (HRIR) signal. In other words, reference transfer function information can be obtained by analyzing and modifying the head impulse response (HRIR) signal in terms of frequency.

[0133] The reference transfer function information includes information on the transfer function for the left ear and the right ear when the input source is output at each reference sound image location.

[0134] Early delay information is the time it takes from the output of the input source to the time it reaches the left and right ears when recording the head impulse response (HRIR) signal.

[0135] The initial delay information is used to interpolate the inter-aural time difference (ITD) between the two ears, using time sample units.

[0136] The memory (160) may be implemented as a separate chip from the processor (150). Alternatively, the memory (160) may be implemented as a single chip with the processor (150).

[0137] The memory (160) can store data for an algorithm for controlling the operation of components within the audio device (100) or a program that reproduces the algorithm.

[0138] The memory (160) may be implemented as at least one of non-volatile memory elements such as cache, ROM (Read Only Memory), PROM (Programmable ROM), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), and flash memory, or volatile memory elements such as RAM (Random Access Memory) and DRAM (Dynamic random-access memory), but is not limited thereto.

[0139] At least one component may be added or deleted to correspond to the performance of the components of the electronic device illustrated in FIG. 2. Furthermore, it will be readily apparent to those skilled in the art that the relative positions of the components may be altered to correspond to the performance or structure of the system.

[0140] Meanwhile, each component illustrated in FIG. 2 refers to software and / or hardware components such as a Field Programmable Gate Array (FPGA) and an Application Specific Integrated Circuit (ASIC).

[0141] Figure 5 is a specific configuration diagram of a processor of an electronic device according to an embodiment.

[0142] The processor (150) of the electronic device may include a target sound position recognition unit (151), a weight acquisition unit (152), an interpolation unit (153), a fast Fourier transform unit (FFT, 154), a filter unit (155), and an inverse fast Fourier transform unit (IFFT, 156).

[0143] The target sound position recognition unit (151) recognizes the current head position of the user based on the detection information received from the audio output device (300).

[0144] Here, the user's current head position can be the target sound position.

[0145] The detection information is information about the movement of the user's head, and may include acceleration information and angular velocity information.

[0146] That is, the target sound position recognition unit (151) can recognize the user's target sound position based on acceleration information and angular velocity information detected by the audio output device.

[0147] The user's target sound position may be the degree to which the head position changes relative to a reference point when the user moves the head.

[0148] The user's target sound position may include a target azimuth angle (θtar) and a target elevation angle (φtar).

[0149] The target sound position recognition unit (151) transmits the recognized target sound position to the weight acquisition unit (152).

[0150] The weight acquisition unit (152) can determine a predetermined number of reference azimuth angles in the order of the smallest azimuth difference value from the target azimuth angle among a plurality of reference azimuth angles, determine a predetermined number of reference elevation angles in the order of the smallest altitude difference value from the target elevation angle among a plurality of reference elevation angles, and determine a plurality of indices based on the determined predetermined number of reference azimuth angles and the determined predetermined number of reference elevation angles.

[0151] The weight acquisition unit (152) can also determine multiple indices by dividing them into a direction index and an altitude index.

[0152] The weight acquisition unit (152) determines a plurality of azimuth indices based on a plurality of reference azimuth angles and a target azimuth angle (θtar).

[0153] The plurality of azimuth indices may include two or more. In this embodiment, an example of determining two azimuth indices is described.

[0154] The weight acquisition unit (152) recognizes reference azimuth angles smaller than the target azimuth angle among the reference azimuth angles as first reference azimuth angles, acquires first azimuth difference values ​​between the first reference azimuth angles and the target azimuth angle, and determines the first reference azimuth angle having the smallest first azimuth difference value among the acquired first azimuth difference values ​​as the first azimuth index.

[0155] The weight acquisition unit (152) recognizes the reference azimuth angles that are greater than the target azimuth angle among the reference azimuth angles as second reference azimuth angles, acquires the second azimuth difference values ​​between the second reference azimuth angles and the target azimuth angle, and determines the second reference azimuth angle that has the smallest second azimuth difference value among the acquired second azimuth difference values ​​as the second azimuth index.

[0156] The weight acquisition unit (152) determines a plurality of altitude index information based on a plurality of reference altitude angles and a target altitude angle (φtar).

[0157] A plurality of altitude indices may include two or more. In this embodiment, an example of determining two altitude indices is described.

[0158] The weight acquisition unit (152) recognizes reference altitude angles smaller than the target altitude angle among the reference altitude angles as first reference altitude angles, acquires first altitude difference values ​​between the first reference altitude angles and the target altitude angle, and determines the first reference altitude angle having the smallest first altitude difference value among the acquired first altitude difference values ​​as the first altitude index.

[0159] The weight acquisition unit (152) recognizes reference altitude angles greater than the target altitude angle among the reference altitude angles as second reference altitude angles, acquires second altitude difference values ​​between the second reference altitude angles and the target altitude, and determines the second reference altitude angle having the smallest second altitude difference value among the acquired second altitude difference values ​​as the second altitude index.

[0160] The weight acquisition unit (152) acquires a first weight based on the target azimuth angle (θtar) and the first azimuth index (θin1), and acquires a second weight based on the target azimuth angle (θtar) and the second azimuth index (θin2).

[0161] First weight (We1) = 1 - (θtar -θin1) / ((θtar - θin1) + (θin2-θtar))

[0162] Second weight (We2) = 1 - (θin2- θtar) / ((θtar- θin1) + (θin2-θtar))

[0163] The weight acquisition unit (152) can acquire the first and second weights based on the absolute value of the first azimuth difference value between the target azimuth angle and the first azimuth index, and the absolute value of the second azimuth difference value between the target azimuth angle and the second azimuth index.

[0164] The weight acquisition unit (152) acquires a third weight based on the target altitude angle and the first altitude index, and acquires a fourth weight based on the target altitude angle and the second altitude index.

[0165] The weight acquisition unit (152) can acquire the third and fourth weights based on the absolute value of the first altitude difference value between the target altitude angle and the first altitude index, and the absolute value of the second altitude difference value between the target altitude angle and the second altitude index.

[0166] Third weight (We3) = 1 - (φtar -φin1) / ((φtar- φin1) + (φin2 - φtar))

[0167] The fourth weight (We4) = 1 - (φin2- φtar) / ((φtar- φin1) + (φin2- φtar))

[0168] The interpolation unit (153) can perform magnitude interpolation and delay interpolation.

[0169] Magnitude interpolation is the inter-aural loudness difference (ILD) interpolation of the difference in sound level between the two ears.

[0170] Magnitude is the magnitude of the frequency-specific signal transmitted to the left and right ears from the target sound location, and can be a numerical value representing the frequency-specific intensity of the head impulse response signal. Magnitude can be an absolute value.

[0171] Delay interpolation is the process of obtaining the inter-aural time difference (ITD) between the two ears.

[0172] An example of the composition of the interpolation section is described.

[0173] The interpolation unit (153) can obtain the first and second reference transfer functions corresponding to the first and second azimuth indices based on the information stored in the memory (160), and obtain the third and fourth reference transfer functions corresponding to the first and second altitude indices.

[0174] The interpolation unit (153) can obtain a first size based on the first and second azimuth indices and the first and second reference transfer functions, and can obtain a second size based on the first and second altitude indices and the third and fourth reference transfer functions. Here, the first size is a size obtained for generating the first interpolation transfer function, and the second size is a size obtained for generating the second interpolation transfer function.

[0175] The interpolation unit (153) can generate a first interpolation transfer function based on the first and second weights, the first and second azimuth indices, the first and second reference transfer functions, and the first magnitude, and can generate a second interpolation transfer function based on the third and fourth weights, the first and second elevation indices, the third and fourth reference transfer functions, and the second magnitude.

[0176] The interpolation unit (153) can obtain the first and second initial delays corresponding to the first and second azimuth indices and the third and fourth initial delays corresponding to the first and second altitude indices based on the information stored in the memory (160), obtain the first adjustment delay based on the first and second weights, the first interpolation transfer function, and the first and second initial delays, and obtain the second adjustment delay based on the third and fourth weights, the second interpolation transfer function, and the third and fourth initial delays.

[0177] The interpolation unit (153) can generate a third interpolation transfer function based on the first and second interpolation transfer functions, and can obtain a third adjustment delay based on the first and second adjustment delays.

[0178] The interpolation unit (153) can generate a target transfer function based on the third interpolation transfer function and the third adjustment delay.

[0179] That is, the interpolation unit (153) can generate a target transfer function based on the first and second weights, the first and second azimuth indices, the third and fourth weights, the first and second altitude indices, the first, second, third, and fourth reference transfer functions, and the first, second, third, and fourth initial delays. This will be described in more detail.

[0180] The interpolation unit (153) can obtain a first magnitude (Mag1) based on the magnitudes of the first and second reference transfer functions corresponding to the first and second azimuth indices (θin1, θin2) and the first and second weights (We1, We2), and can obtain a second magnitude (Mag2) based on the magnitudes of the third and fourth reference transfer functions corresponding to the first and second altitude indices (φin1, φin2) and the third and fourth weights (We3, We4).

[0181] Each of the first, second, third, and fourth reference transfer functions may include a reference transfer function corresponding to the left ear (HRTFL) and a reference transfer function corresponding to the right ear (HRTFR).

[0182] The first magnitude may be the magnitude of the first interpolation transfer function corresponding to the target azimuth angle (θtar).

[0183] The second magnitude may be the magnitude of the second interpolation transfer function corresponding to the target elevation angle (φtar).

[0184] The first and second sizes to be used for size interpolation are as follows.

[0185] Mag1(HRTFL(θtar, 0), HRTFR(θtar, 0))=We1 × mag(HRTFL(θin1, 0), HRTFR(θin1, 0)) + We2 × mag(HRTFL(θin2, 0), HRTFR(θin2, 0))

[0186] Mag2(HRTFL(0, ϕtar), HRTFR(0, ϕtar))=We31

[0187] The interpolation unit (153) compares the first and second weights to identify whether the first weight is greater than the second weight or whether the second weight is greater than the first weight.

[0188] When the first weight is greater than the second weight, the interpolation unit (153) obtains a first direction index corresponding to the first weight, obtains a phase of a first reference transfer function corresponding to the first direction index, and generates a first interpolation transfer function based on the phase of the obtained first reference transfer function and the obtained first magnitude.

[0189] The identified reference transfer function may include a reference transfer function corresponding to the left ear (HRTFL) and a reference transfer function corresponding to the right ear (HRTFR).

[0190] When the first weight is greater than the second weight, the phase of the identified reference transfer function is as follows.

[0191] Phase(HRTFL(θin_c, 0), HRTFR(θin_c, 0)) = Phase(HRTFL(θin1, 0), HRTFR(θ in1, 0))

[0192] When the second weight is greater than the first weight, the interpolation unit (153) obtains a second direction index corresponding to the second weight, obtains a phase of a second reference transfer function corresponding to the second direction index, and generates a first interpolation transfer function based on the phase and the first magnitude of the obtained second reference transfer function.

[0193] When the second weight is greater than the first weight, the phase of the identified reference transfer function is as follows.

[0194] Phase(HRTFL(θin_c, 0), HRTFR(θin_c, 0)) = Phase(HRTFL(θin2, 0), HRTFR(θin2, 0))

[0195] That is, the interpolation unit (153) can identify a larger weight among the first and second weights, and generate a first interpolation transfer function based on the phase and first magnitude of the reference transfer function corresponding to the identified weight.

[0196] Here, the phase can be the frequency-dependent phase of the head impulse response signal.

[0197] Here, the first interpolation transfer function may be an interpolation transfer function related to orientation.

[0198] The phase of the reference transfer function may be the phase with the initial delay applied, and this initial delay may be stored in the memory (160).

[0199] The interpolation unit (153) obtains the first and second initial delays corresponding to the first and second azimuth indices based on the information stored in the memory (160), and obtains the first adjustment delay based on the obtained first and second initial delays and the first and second weights.

[0200] Each of the first and second initial delays may include an initial delay (DeL) corresponding to the left ear and an initial delay (DeR) corresponding to the right ear.

[0201] The first adjustment delay may include a first adjustment delay (△DeL1) corresponding to the left ear and a first adjustment delay (△DeR1) corresponding to the right ear.

[0202] The first adjustment delay (△De) to be used in delay interpolation is as follows.

[0203] (△DeL1, △DeR1) = {(DeL (θin_i, 0), DeR (θ in_i, 0)) - (DeL (θin_c, 0), DeR (θin_c, 0))} × We_i

[0204] Here, in_c is the direction index with a large weight, and in_i is the direction index with a small weight.

[0205] The interpolation unit (153) compares the third and fourth weights to identify whether the third weight is greater than the fourth weight or whether the fourth weight is greater than the third weight.

[0206] When the third weight is greater than the fourth weight, the interpolation unit (153) obtains a first height index corresponding to the third weight, obtains a phase of a third reference transfer function corresponding to the first height index, and generates a second interpolation transfer function based on the phase of the obtained third reference transfer function and the obtained second magnitude.

[0207] When the third weight is greater than the fourth weight, the phase of the identified reference transfer function is as follows.

[0208] Phase(HRTFL(0, ϕin_c, HRTFR(0, ϕin_c)) = Phase(HRTFL(0, ϕin1), HRTFR(0, ϕin1))

[0209] When the fourth weight is greater than the third weight, the interpolation unit (153) obtains a second height index corresponding to the fourth weight, obtains a phase of a fourth reference transfer function corresponding to the second height index, and generates a second interpolation transfer function based on the phase and second magnitude of the obtained fourth reference transfer function.

[0210] When the fourth weight is greater than the third weight, the phase of the identified reference transfer function is as follows.

[0211] Phase(HRTFL(0, ϕin_c), HRTFR(0, ϕin_c)) = Phase(HRTFL(0, ϕin2), HRTFR(0, ϕin2))

[0212] That is, the interpolation unit (153) can identify a larger weight among the third and fourth weights, and generate a second interpolation transfer function based on the phase and second magnitude of the reference transfer function corresponding to the identified weight.

[0213] The second interpolation transfer function can transfer interpolation related to altitude.

[0214] The interpolation unit (153) obtains the third and fourth initial delays corresponding to the first and second altitude indices based on the information stored in the memory (160), and obtains the second adjustment delay based on the obtained third and fourth initial delays and the third and fourth weights.

[0215] The second adjustment delay may include a second adjustment delay (△DeL2) corresponding to the left ear and a second adjustment delay (△DeR2) corresponding to the right ear.

[0216] The second adjustment delay to be used for delay interpolation is as follows.

[0217] (△DeL2, △DeR2) = {(DeL(0, ϕin_i), DeR(0, ϕin_i)) - (DeL(0, ϕin_c), DeR(0, ϕin_c))} × We_i

[0218] Here, in_c is the altitude index with large weights, and in_i is the altitude index with small weights.

[0219] The interpolation unit (153) can generate a third interpolation transfer function based on the first and second interpolation transfer functions, and can obtain a third adjustment delay based on the first and second adjustment delays.

[0220] The interpolation unit (153) generates a target transfer function based on the third interpolation transfer function and the third adjustment delay.

[0221] The interpolation unit (153) is the third interpolation transfer function. The target transfer function can be generated by multiplying the target transfer function, where the target transfer function can be the target head transfer function.

[0222] HRIR[s-△De] ↔ HRTF[k]

[0223] The above equation is an expression of the delay in time on the frequency axis.

[0224] The above example of generating a target transfer function is an example of generating an interpolation transfer function by distinguishing direction and altitude, and then generating a target transfer function.

[0225] That is, an example of obtaining weights based on the first and second reference azimuth angles and the first and second reference elevation angles, and obtaining a target transfer function based on the first, second, third, and fourth transfer functions and the first, second, third, and fourth initial delays is described.

[0226] As a modified example, it is also possible to obtain the first, second, third, and fourth indices (θin1, φin1), (θin1, φin2), (θin2, φin1) (θin2, φin2) by combinations of the first and second reference azimuth angles (θin1, θin2) and the first and second reference elevation angles (φin1, φin2), obtain weights for each index, obtain the first, second, third, and fourth transfer functions and the first, second, third, and fourth initial delays corresponding to the first, second, third, and fourth indices, and obtain the target transfer function based on the first, second, third, and fourth transfer functions and the first, second, third, and fourth initial delays.

[0227] Another example of the composition of the interpolation section is described.

[0228] As another example of generating a target transfer function, we describe an example of generating an interpolated transfer function by considering both heading and altitude, and then generating the target transfer function.

[0229] As shown in FIGS. 6A and 6B, when the azimuth angle is implemented as a coordinate with the x-axis and the elevation angle as the y-axis, the weight acquisition unit (152) determines a plurality of indices based on the distance between the coordinate values ​​(θtar, φtar) of the target sound image position and the coordinate values ​​of the reference sound image position, and it is also possible to acquire weights based on the distance between the coordinate values ​​of the determined indices and the coordinate values ​​of the target sound image position.

[0230] The weight acquisition unit (152) acquires distance values ​​between the coordinate values ​​(θtar, φtar) of the target sound position and the coordinate values ​​of the reference sound position, lists the acquired distance values ​​in descending order of distance values, acquires a predetermined number of distance values ​​having a high rank among the listed distance values, and acquires coordinate values ​​of the reference sound position having the acquired distance values ​​as indices.

[0231] When two indices are acquired, the weight acquisition unit (152) can acquire the coordinate values ​​(θin1, φin1) of the reference sound position of one of the two determined indices as the first index, and can acquire the coordinate values ​​(θin2, φin2) of the other reference sound position as the second index.

[0232] The weight acquisition unit (152) acquires a first weight for the first index and a second weight for the second index based on the distance (d1) between the coordinate values ​​(θtar, φtar) of the target sound position and the coordinate values ​​(θin1, φin1) of the first index and the distance (d2) between the coordinate values ​​(θtar, φtar) of the target sound position and the coordinate values ​​(θin2, φin2) of the second index.

[0233] First weight (We1) = 1 - (d1 / (d1+ d2))

[0234] Second weight (We2) = 1 - (d2 / (d1 + d2))

[0235] The interpolation unit (153) obtains a first reference transfer function corresponding to a first index and a second reference transfer function corresponding to a second index based on information stored in the memory (160), and obtains a magnitude (mag) based on the magnitudes of the obtained first and second reference transfer functions and the first and second weights. Here, the magnitude obtained may be a magnitude obtained for generating an interpolation transfer function.

[0236] Each of the first and second reference transfer functions may include a reference transfer function corresponding to the left ear (HRTFL) and a reference transfer function corresponding to the right ear (HRTFR).

[0237] mag(HRTFL(θtar, ϕtar), HRTFR(θtar, ϕtar))= we1

[0238] The interpolation unit (153) compares the first and second weights to identify whether the first weight is greater than the second weight or whether the second weight is greater than the first weight.

[0239] When the first weight is greater than the second weight, the interpolation unit (153) obtains a first index corresponding to the first weight, obtains a phase of the first reference transfer function corresponding to the first index, and generates an interpolation transfer function based on the phase of the obtained first reference transfer function and the obtained magnitude.

[0240] When the first weight is greater than the second weight, the phase of the reference transfer function is as follows.

[0241] Phase(HRTFL(θin_c, ϕin_c), HRTFR(θin_c, ϕin_c)) = Phase(HRTFL(θin1, ϕin1), HRTFR(θin1, ϕin1))

[0242] When the second weight is greater than the first weight, the interpolation unit (153) obtains a second index corresponding to the second weight, obtains the phase of the second reference transfer function corresponding to the second index, and generates an interpolation transfer function based on the phase of the obtained second reference transfer function and the obtained magnitude.

[0243] When the second weight is greater than the first weight, the phase of the reference transfer function is as follows.

[0244] Phase(HRTFL(θin_c, ϕin_c), HRTFR(θin_c, ϕin_c)) = Phase(HRTFL(θin2, ϕin2), HRTFR(θin2, ϕin2))

[0245] The interpolation unit (153) can identify a larger weight among the first and second weights and generate an interpolation transfer function based on the phase and acquired magnitude of the reference transfer function corresponding to the identified weight.

[0246] The interpolation unit (153) obtains the first and second initial delays corresponding to the first and second indices based on the information stored in the memory (160), and obtains an adjustment delay based on the obtained first and second initial delays and the first and second weights.

[0247] Each of the first and second initial delays may include an initial delay (DeL) corresponding to the left ear and an initial delay (DeR) corresponding to the right ear.

[0248] The adjustment delay may include an adjustment delay corresponding to the left ear (△DeL) and an adjustment delay corresponding to the right ear (△DeR).

[0249] (△DeL, △DeR) = {(DeL (θin_i, ϕin_i), DeR (θin_i, ϕin_i)) - (DeL (θin_c, ϕin_c), DeR (θin_c, ϕin_c))} × we_i

[0250] Here, in_c is an index with a large weight, and in_i is an index with a small weight.

[0251] The interpolation unit (153) can generate a target transfer function based on the interpolation transfer function and the adjustment delay.

[0252] The interpolation unit (153) is an interpolation transfer function. The target transfer function can be generated by multiplying the target transfer function. Here, the target transfer function can be the final interpolation transfer function or the target head transfer function.

[0253] HRIR[s-△De] ↔ HRTF[k]

[0254] The above equation is an expression of the delay in time on the frequency axis.

[0255] The fast Fourier transform unit (FFT, 154) applies a fast Fourier transform to the input source received from an external device (200) to convert the signal of the input source into the frequency domain.

[0256] The fast Fourier transform unit (154) transmits the audio signal in the transformed frequency domain to the filter unit (155).

[0257] The filter unit (155) generates left and right audio signals based on the changed audio signal and the left and right target transfer functions generated by the interpolation unit (153).

[0258] The left and right audio signals generated in the filter section (155) may be signals in the frequency domain.

[0259] The filter unit (155) transmits the generated left and right audio signals to the inverse fast Fourier transform unit (156).

[0260] The inverse fast Fourier transform (IFFT, 156) applies an inverse fast Fourier transform to the left and right audio signals received from the filter unit (155) to generate left and right output audio signals.

[0261] The inverse fast Fourier transform unit (156) converts the audio signal generated by the filter unit (155) back into the time domain. The audio signal converted by the inverse fast Fourier transform unit (156) may be an output audio signal in the time domain. The output audio signal may be a sound image.

[0262] The audio signal converted in the inverse fast Fourier transform unit (156) can be transmitted to the audio output device (300) through the communication unit (120).

[0263] The audio signal on the left side converted in the inverse fast Fourier transform unit (156) can be transmitted to the audio output device (300) on the left side via the communication unit (120), and the audio signal on the right side converted in the inverse fast Fourier transform unit (156) can be transmitted to the audio output device (300) on the right side via the communication unit (120).

[0264] This embodiment outputs a sound image based on information about a predetermined number of reference sound image positions and a target sound image position, thereby enabling the user to always output a desired sound image even when the user moves his or her head at various angles.

[0265] This embodiment is explained using a head transfer function as an example.

[0266] The transfer function may also include at least one of ITF (Interaural Transfer Function), MITF (Modified ITF), BRTF (Binaural Room Transfer Function), RIR (Room Impulse Response), BRIR (Binaural Room Impulse Response), HRIR (Head Related Impulse Response) and their modified and edited data.

[0267] For example, the transfer function may include a second-order binaural transfer function obtained by linearly combining multiple binaural transfer functions.

[0268] FIG. 7 is a control flowchart of an electronic device according to one embodiment, which is described with reference to FIG. 8.

[0269] The electronic device can receive sensing information from an audio output device (300) (171).

[0270] The sensing information may include acceleration information and angular velocity information.

[0271] The electronic device can recognize the user's target sound position based on the received acceleration information and angular velocity information (172).

[0272] The user's target sound position may include a target azimuth angle (θtar) and a target elevation angle (φtar).

[0273] The electronic device can recognize a plurality of indices based on a plurality of reference sound image locations and a target sound image location.

[0274] Each reference sound position may include a reference azimuth angle and a reference elevation angle.

[0275] The electronic device can determine a plurality of azimuth indices based on a plurality of reference azimuth angles and a target azimuth angle, and can determine a plurality of altitude indices based on a plurality of reference elevation angles and a target elevation angle.

[0276] For example, the electronic device can determine the first and second azimuth indices and the first and second altitude indices (173). This will be described in more detail below.

[0277] The electronic device recognizes reference azimuth angles smaller than the target azimuth angle among the reference azimuth angles as first reference azimuth angles, obtains first azimuth difference values ​​between the first reference azimuth angles and the target azimuth angle, and determines the first reference azimuth angle having the smallest first azimuth difference value among the obtained first azimuth difference values ​​as the first azimuth index.

[0278] The electronic device recognizes reference azimuth angles greater than the target azimuth angle among the reference azimuth angles as second reference azimuth angles, obtains second azimuth difference values ​​between the second reference azimuth angles and the target azimuth angle, and determines the second reference azimuth angle having the smallest second azimuth difference value among the obtained second azimuth difference values ​​as the second azimuth index.

[0279] The electronic device recognizes reference altitude angles smaller than the target altitude angle among the reference altitude angles as first reference altitude angles, obtains first altitude difference values ​​between the first reference altitude angles and the target altitude angle, and determines the first reference altitude angle having the smallest first altitude difference value among the obtained first altitude difference values ​​as the first altitude index.

[0280] The electronic device recognizes reference altitude angles greater than the target altitude angle among the reference altitude angles as second reference altitude angles, obtains second altitude difference values ​​between the second reference altitude angles and the target altitude, and determines the second reference altitude angle having the smallest second altitude difference value among the obtained second altitude difference values ​​as the second altitude index.

[0281] As illustrated in FIG. 8, when the reference azimuth angles are 0 degrees, 30 degrees, 60 degrees, 90 degrees, 120 degrees, 150 degrees, 180 degrees, 210 degrees, 240 degrees, 270 degrees, 300 degrees, 330 degrees, and 360 degrees (= 0 degrees) and the target azimuth angle is 50 degrees, the electronic device may determine the reference azimuth angle of 30 degrees among the reference azimuth angles as the first azimuth index and the reference azimuth angle of 60 degrees as the second azimuth index.

[0282] When the reference elevation angles are 0 degrees, 5 degrees, 10 degrees, 15 degrees, 20 degrees, 25 degrees, 30 degrees, -5 degrees, -10 degrees, -15 degrees, -20 degrees, -25 degrees, and -30 degrees, and the target elevation angle is 6 degrees, the electronic device may determine the reference angle of 5 degrees among the reference elevation angles as the first elevation index, and determine the reference angle of 10 degrees as the second elevation index.

[0283] The electronic device obtains first, second, third, and fourth weights based on the target azimuth angle, the first azimuth index, the second azimuth index, the target elevation angle, the first elevation index, and the second elevation index (174).

[0284] More specifically, the electronic device obtains a first weight based on the target azimuth angle and the first azimuth index, and obtains a second weight based on the target azimuth angle and the second azimuth index.

[0285] The electronic device obtains a third weight based on the target elevation angle and the first elevation index, and obtains a fourth weight based on the target elevation angle and the second elevation index.

[0286] If the target elevation angle is 0 degrees, the electronic device may not determine the elevation index. In this case, it is possible to determine the first index for the first azimuth index, the second index for the second azimuth index, and to omit the acquisition of the third and fourth weights, and acquire only the first and second weights.

[0287] For example, if the target sound position is (50, 0), the first index is (30, 0), and the second index is (60, 0), the first weight for the first index and the second weight for the second index are as follows.

[0288] First weight = 1 - (50-30) / ((50-30) + (60-50)) = 0.333333

[0289] Second weight = 1 - (60-50) / ((50-30) + (60-50)) = 0.666666

[0290] The electronic device obtains first and second reference transfer functions corresponding to the first and second azimuth indices (θin1, θin2), and obtains third and fourth reference transfer functions corresponding to the first and second altitude indices (φin1, φin2) (175).

[0291] The electronic device can obtain a first magnitude (Mag1) based on the magnitudes of the first and second reference transfer functions and the first and second weights (We1, We2), and can obtain a second magnitude (Mag2) based on the magnitudes of the third and fourth reference transfer functions and the third and fourth weights (We3, We4) (176).

[0292] The size of each reference transfer function may be information pre-stored in memory.

[0293] Each reference transfer function may include a reference transfer function corresponding to the left ear (HRTFL) and a reference transfer function corresponding to the right ear (HRTFR).

[0294] It is assumed that the magnitude of the first reference transfer function corresponding to the first orientation index (θin1) and the magnitude of the second reference transfer function corresponding to the second orientation index (θin2) are as follows.

[0295] mag(HRTFL_1000Hz(30, 0), HRTFR_1000Hz (30, 0)) = (0.4, 0.7)

[0296] mag(HRTFL_1000Hz (60, 0), HRTFR_1000Hz (60, 0)) = (0.3, 0.75)

[0297] In this case, the left and right sizes at 1000Hz are as follows.

[0298] Mag1(HRTFL_1000Hz(50, 0), HRTFR_1000Hz (50, 0)) = (0.4×0.333+0.3×0.666, 0.7×0.333 + 0.75×0.666) = (0.333, 0.733)

[0299] The electronic device compares the first and second weights to determine whether the first weight is greater than the second weight or whether the second weight is greater than the first weight.

[0300] The electronic device can identify a larger weight among the first and second weights, obtain a direction index corresponding to the identified weight, and generate a first interpolation transfer function based on the phase and first magnitude of the reference transfer function corresponding to the obtained direction index (θin_c) (177).

[0301] The electronic device can identify a larger weight among the third and fourth weights, obtain an elevation index corresponding to the identified weight, and generate a second interpolated transfer function based on the phase and second magnitude of the reference transfer function corresponding to the obtained elevation index (φin_c) (178).

[0302] The identified reference transfer function may include a reference transfer function corresponding to the left ear (HRTFL) and a reference transfer function corresponding to the right ear (HRTFR).

[0303] The phase of each reference transfer function may be the phase with the initial delay applied, and this initial delay may be stored in the memory (160).

[0304] That is, the electronic device can obtain the first and second initial delays corresponding to the first and second azimuth indices based on the information stored in the memory (160), and obtain the third and fourth initial delays corresponding to the first and second altitude indices (179).

[0305] The electronic device can obtain a first adjustment delay based on the obtained first and second initial delays and the first and second weights, and can obtain a second adjustment delay based on the obtained third and fourth initial delays and the third and fourth weights (180).

[0306] Each initial delay may include an initial delay (DeL) corresponding to the left ear and an initial delay (DeR) corresponding to the right ear.

[0307] The first and second adjustment delays may include the first and second adjustment delays (△DeL1, △DeL2) corresponding to the left ear and the first and second adjustment delays (△DeR1, △DeL2) corresponding to the right ear.

[0308] The first adjustment delay to be used in delay interpolation is as follows.

[0309] (△DeL1, △DeR1) = {(DeL (θin_i, 0), DeR (θ in_i, 0)) - (DeL (θin_c, 0), DeR (θin_c,))} × We_i

[0310] The second adjustment delay to be used for delay interpolation is as follows.

[0311] (△DeL2, △DeR2) = {(DeL (0, ϕin_i), DeR (0, ϕin_i)) - (DeL (0, ϕin_c), DeR (0, ϕin_c))} × We_i

[0312] Here, in_c is the altitude index with large weights, and in_i is the altitude index with small weights.

[0313] The electronic device can generate a third interpolation transfer function based on the first and second interpolation transfer functions, and can obtain a third adjustment delay based on the first and second adjustment delays.

[0314] The acquisition of the first adjustment delay is explained with an example. Assume that the first, second, and initial delays acquired from memory are as follows.

[0315] (DeL(30,0), DeR(30,0)) = (90, 60)

[0316] (DeL(60,0), DeR(60,0)) = (100, 50)

[0317] In this case, the first adjustment delay is as follows:

[0318] (△DeL1, △DeR1) = ((90, 60) - (100, 50)) × 0.333= (-3.333, 3.333)

[0319] The electronic device has a third-order adjustment delay and a third-order interpolation transfer function. The target transfer function to be applied to the signal of the input source is generated by multiplying (181).

[0320] The delay in time can be expressed on the frequency axis as follows:

[0321] HRIR[s-△De] ↔ HRTF[k], s is the time sample

[0322] The electronic device converts a signal of an input source into a frequency domain by applying a fast Fourier transform to the input source received from an external device (200) (182).

[0323] The electronic device performs filtering to generate left and right audio signals based on the changed audio signal and the generated left and right target transfer functions (183).

[0324] The electronic device generates a sound image by applying an inverse fast Fourier transform to the filtered left and right audio signals to convert the left and right output audio signals into the time domain (184).

[0325] The electronic device can output the converted audio signal to the audio output device (300) via the communication unit (120) (185).

[0326] The converted left audio signal can be transmitted to the left audio output device (300) through the communication unit (120), and the right audio signal converted in the inverse fast Fourier transform unit (156) can be transmitted to the right audio output device (300) through the communication unit (120).

[0327] This embodiment outputs a sound image based on information about a predetermined number of reference sound image positions and a target sound image position, thereby enabling the user to always output a desired sound image even when the user moves his or her head at various angles.

[0328] FIG. 9 is a schematic diagram of an audio system including an electronic device according to another embodiment.

[0329] The audio system may include an electronic device (400) and an external device (500).

[0330] The electronic device (400) can communicate with an external device (500).

[0331] The external device (500) can output video signals and audio signals received from the outside or output video and audio signals of content stored internally.

[0332] An external device (500) can transmit an audio signal to an electronic device (400).

[0333] The external device (500) may include, but is not limited to, a television, a user device, or a projector.

[0334] The user device may be carried by the user or placed in the user's home or office. The user device may include, but is not limited to, a personal computer, a terminal, a portable telephone, a smart phone, a handheld device, a wearable device, etc.

[0335] Personal computers can include desktops, laptops, and tablet PCs.

[0336] The memory of the user device may store a program for controlling the electronic device (400), i.e., an application. The application may be sold installed on the user device or downloaded and installed from an external server (not shown).

[0337] A user can access a server by executing an application installed on a user device, create a user account, and register an electronic device (400) by communicating with the server based on the logged-in user account.

[0338] For example, when the electronic device (400) is operated so that the electronic device (400) can be connected to the server according to the procedure guided by the application installed on the user device, the electronic device (400) can be registered in the user account by registering the identification information (e.g., serial number or MAC address) of the electronic device (400) in the corresponding user account on the server.

[0339] A user can control an electronic device (400) using an application installed on the user device. For example, when a user logs into a user account using an application installed on the user device, an electronic device (400) registered to the user account appears, and when a control command for an audio device (100) is input, the control command can be transmitted to the electronic device (400) via a server.

[0340] The electronic device (400) can detect a target sound image location corresponding to the movement of the user's head, generate a sound image by binaural rendering an input source based on a transfer function corresponding to the detected target sound image location, and output the generated sound image. Here, the transfer function can include a head-related transfer function (HRTF).

[0341] The input source is an input audio signal, which may be an audio signal received from an external device (500).

[0342] The sound is an audio signal output through an electronic device (400) and may be an output audio signal.

[0343] The electronic device (400) may include, but is not limited to, a headset, earphones, or a head-mounted display device capable of audio output.

[0344] Fig. 10 is a control configuration diagram of an electronic device according to another embodiment.

[0345] The electronic device (400) may include an input unit (410), a communication unit (420), a sensor unit (430), a speaker (440), a processor (450), and a memory (460).

[0346] The input unit (410) receives user input.

[0347] The input unit (410) can receive user input related to audio output.

[0348] The input unit (410) can receive a power on / off command, an audio play command, and an audio stop command.

[0349] The input unit (410) can receive a volume up command and a volume down command.

[0350] The input unit (410) can receive a call connection command and a call end command.

[0351] The input unit (410) can receive a command to select audio mode or call mode.

[0352] The input unit (410) may include a button, a key, a tact switch, a push switch, a slide switch, a toggle switch, a micro switch, a touch switch, a touch pad, a touch screen, a jog dial, etc.

[0353] The communication unit (420) communicates with an external device (500).

[0354] The communication unit (420) can receive an input source from an external device (500) and transmit the received input source to the processor (450). Here, the input source can include an input audio signal.

[0355] The communication unit (420) can support the establishment of a direct (e.g., wired) communication channel or wireless communication channel with an external device (500), and the performance of communication through the established communication channel.

[0356] The configuration of the communication unit (420) is the same as that of the communication unit (120) of one embodiment, so description thereof is omitted.

[0357] The sensor unit (430) detects information about the movement of the user's head for head tracking and transmits the detected information to the processor (450).

[0358] Information about head movement is information about the target sound position, and may include information about the target azimuth and target elevation.

[0359] The sensor unit (430) may include at least one of an acceleration sensor and a gyro sensor for detecting movement of the user's head.

[0360] Accelerometers can detect the direction and speed of head movement.

[0361] The gyro sensor can detect the angular velocity of the head movement.

[0362] The speaker (440) can output a sound corresponding to a control command of the processor (450). Here, the sound can include an output audio signal.

[0363] There may be one or more speakers (440).

[0364] Here, the output audio signal may be a two-channel output audio signal corresponding to each of the user's two ears.

[0365] The output audio signal may be a binaural 2-channel output audio signal.

[0366] The speaker (440) may additionally include a converter (e.g., a digital-to-analog converter, DAC) that converts a digital audio signal into an analog audio signal.

[0367] The processor (450) can control the overall operation of the electronic device (400).

[0368] The processor (450) can recognize a command from a user input based on receiving a user input from the input unit (410) and control the operation of the audio device based on the recognized command.

[0369] The processor (450) can be powered on or off based on user input.

[0370] The processor (450) can control audio playback, audio pause, volume up, or volume down based on user input.

[0371] The processor (450) can also control mode switching between audio mode and call mode based on user input.

[0372] The processor (450) can also receive user input received from an external device (500) through the communication unit (420).

[0373] The processor (450) recognizes the user's target sound position based on acceleration information detected by the acceleration sensor of the sensor unit (430) and angular velocity information detected by the gyro sensor.

[0374] When recognizing the position of the user's target sound, the processor (450) can recognize the target azimuth angle and target elevation angle of the head.

[0375] The processor (450) can filter the input source received through the communication unit (420) using transfer function data to generate a sound image with a three-dimensional effect and a sense of space, and control the speaker (440) to output the generated sound image.

[0376] The input source may be an input audio signal that is the target of binaural rendering.

[0377] The sound image may be an output audio signal. The output audio signal may be a binaural audio signal. For example, the output audio signal may be a two-channel audio signal in which the input audio signal is represented as a virtual sound source located in three-dimensional space.

[0378] The processor (450) recognizes whether there is a reference sound image position identical to a target sound image position among a plurality of reference sound image positions stored in the memory (460), recognizes a reference transfer function corresponding to the recognized reference sound image position based on the recognition that there is a reference sound image position identical to the target sound image position, and filters the recognized reference transfer function and an input source to generate a sound image.

[0379] The processor (450) can generate a transfer function corresponding to the target sound image position based on an input source, a target sound image position, a plurality of reference sound image positions, a pre-stored reference transfer function, and a pre-stored initial delay based on recognizing that there is no reference sound image position identical to the target sound image position, filter the generated transfer function to generate a sound image having a three-dimensional effect and a sense of space, and control the speaker (440) to output the generated sound image through the speaker (440).

[0380] The processor (450) determines first and second indices based on the target sound image position and a plurality of reference sound image positions when generating a transfer function corresponding to the target sound image position based on the recognition that there is no reference sound image position identical to the target sound image position, obtains first and second weights based on the determined first and second indices, generates a target transfer function based on the first and second reference transfer functions and the first and second initial delays corresponding to the first and second indices, and generates a sound image based on the generated target transfer function and an input source, and can control the output of the generated sound image.

[0381] The processor (450) can determine first and second directional indices and first and second altitude indices based on a target sound image position and a plurality of reference sound image positions, obtain first and second weights based on the determined first and second directional indices, obtain third and fourth weights based on the determined first and second altitude indices, and obtain first, second, third, and fourth reference transfer functions and first, second, third, and fourth initial delays corresponding to the first, second, third, and fourth indices.

[0382] The processor (450) can obtain a first size based on the first and second azimuth indices and the first and second reference transfer functions, and can obtain a second size based on the first and second altitude indices and the third and fourth reference transfer functions. Here, the first size is a size obtained for generating the first interpolation transfer function, and the second size is a size obtained for generating the second interpolation transfer function.

[0383] The processor (450) can generate a first interpolation transfer function based on the first magnitude based on the first and second weights, the first and second azimuth indices, the first and second reference transfer functions, and the first magnitude, and can generate a second interpolation transfer function based on the third and fourth weights, the first and second elevation indices, the third and fourth reference transfer functions, and the second magnitude.

[0384] The processor (450) can obtain first and second initial delays corresponding to the first and second azimuth indices and third and fourth initial delays corresponding to the first and second altitude indices based on information stored in the memory (460), obtain a first adjustment delay based on the first and second weights, the first interpolation transfer function, and the first and second initial delays, and obtain a second adjustment delay based on the third and fourth weights, the second interpolation transfer function, and the third and fourth initial delays.

[0385] The processor (450) can generate a third interpolation transfer function based on the first and second interpolation transfer functions, and can obtain a third adjustment delay based on the first and second adjustment delays.

[0386] The processor (450) can generate a target transfer function based on the third interpolation transfer function and the third adjustment delay.

[0387] The specific configuration of this processor (450) is the same as in Fig. 5, so description is omitted.

[0388] The processor (450) can perform the above-described operation using data stored in the memory (460).

[0389] The processor (450) may include hardware such as a CPU or memory, and software such as a control program. For example, the processor (150) may include one or more processor chips that perform the aforementioned operations using an algorithm for controlling the operations of components within the audio device, at least one memory that stores program-type data, and data stored in the at least one memory, or may include one or more processing cores.

[0390] The processor (450) may include a separate NPU that performs the operation of the artificial intelligence model.

[0391] The memory (460) can store a plurality of pieces of reference sound position information corresponding to a plurality of reference sound positions, a plurality of pieces of reference transfer function information corresponding to each of the plurality of reference sound positions, and a plurality of pieces of initial delay information corresponding to each of the plurality of reference sound positions.

[0392] Reference transfer function information is information that can be obtained by taking a fast Fourier transform (FFT) of a head-related impulse response (HRIR) signal. In other words, reference transfer function information can be obtained by analyzing and modifying the head impulse response (HRIR) signal in terms of frequency.

[0393] The reference transfer function information includes information about the transfer functions for the left and right ears when the input source is output at each of a plurality of reference sound image locations.

[0394] The memory (460) may be implemented as a separate chip from the processor (140). Alternatively, the memory (460) may be implemented as a single chip with the processor (450).

[0395] The memory (460) can store data for an algorithm for controlling the operation of components within the electronic device (400) or a program that reproduces the algorithm.

[0396] The memory (460) may be implemented as at least one of non-volatile memory elements such as cache, ROM (Read Only Memory), PROM (Programmable ROM), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), and flash memory, or volatile memory elements such as RAM (Random Access Memory) and DRAM (Dynamic random-access memory), but is not limited thereto.

[0397] The electronic device (400) may optionally further include at least one of a microphone (470), a display unit (480), and a power unit (490).

[0398] A microphone (470) can receive a user's voice and transmit the received voice to a processor (450). There may be one or more microphones (470). In this case, the processor (450) can transmit the received voice to an external device (500) via a communication unit (420).

[0399] Two or more microphones may be microphones for beamforming.

[0400] The display unit (480) can display information corresponding to the operating status of the electronic device (400) in response to a control command of the processor (450).

[0401] The display unit (480) can display the power on status, power off status, audio output status, audio stop status, low battery charge status, call status, etc. of the audio device.

[0402] The display unit (480) may be provided as a digital light processing (DLP) panel, a plasma display panel, a liquid crystal display (LCD) panel, an electroluminescence (EL) panel, an electrophoretic display (EPD) panel, an electrochromic display (ECD) panel, a light emitting diode (LED) panel, or an organic light emitting diode (OLED) panel, but is not limited thereto.

[0403] The power supply unit (490) can supply power to each component of the electronic device (400).

[0404] The power supply (490) may include a rechargeable battery.

[0405] At least one component may be added or deleted to correspond to the performance of the components of the electronic device illustrated in FIGS. 9 and 10. Furthermore, it will be readily apparent to those skilled in the art that the relative positions of the components may be altered to correspond to the performance or structure of the system.

[0406] Meanwhile, each component illustrated in FIGS. 9 and 10 refers to software and / or hardware components such as Field Programmable Gate Array (FPGA) and Application Specific Integrated Circuit (ASIC).

[0407] Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium storing computer-executable instructions. The instructions may be stored in the form of program code, and when executed by a processor, may generate program modules to perform the operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.

[0408] Computer-readable storage media include all types of storage media that store instructions that can be deciphered by a computer. Examples include read-only memory (ROM), random access memory (RAM), magnetic tape, magnetic disks, flash memory, and optical data storage devices.

[0409] The disclosed embodiments have been described with reference to the attached drawings as described above. Those skilled in the art will understand that the present invention can be implemented in forms other than the disclosed embodiments without altering the technical spirit or essential characteristics of the present invention. The disclosed embodiments are illustrative and should not be construed as limiting.

Claims

1. A memory storing information about a plurality of reference sound image positions and a plurality of reference transfer functions and initial delays corresponding to each of the plurality of reference sound image positions; A communication unit that receives detection information of head movement; and An electronic device including a processor which recognizes a target sound image position based on detection information of head movement received in the communication unit, determines some of the plurality of reference sound image positions as a plurality of indexes based on the recognized target sound image positions, obtains a reference transfer function and an initial delay corresponding to the determined plurality of indexes based on the information stored in the memory, obtains weights for each index based on the determined plurality of indexes, and generates a target transfer function based on the obtained weights for each index, the obtained reference transfer function, and the obtained initial delay.

2. In paragraph 1, The above plurality of indexes include a first index and a second index, The above-mentioned first and second reference transfer functions obtained include a first reference transfer function corresponding to the first index and a second reference transfer function corresponding to the second index, An electronic device in which the processor obtains a first weight for the first index and a second weight for the second index based on the first and second indices, obtains a magnitude based on the first reference transfer function, the second reference transfer function and the first and second weights, and generates an interpolation transfer function based on one of the first and second reference transfer functions and the obtained magnitude.

3. In the second paragraph, the processor, Identifying a weight having a larger size among the first and second weights, obtaining an index corresponding to the identified weight, and obtaining the phase of a reference transfer function corresponding to the obtained index among the first and second reference transfer functions as a reference phase for generating the interpolation transfer function. An electronic device that generates the interpolation transfer function based on the phase and the magnitude of the reference transfer function corresponding to the obtained index among the first and second reference transfer functions.

4. In paragraph 2, The above-mentioned acquired initial delays include a first initial delay corresponding to the first index and a second initial delay corresponding to the second index, An electronic device wherein the processor obtains an adjustment delay based on the first and second weights and the first and second initial delays, and generates the target transfer function based on the obtained adjustment delay and the generated interpolation transfer function.

5. In the first paragraph, the processor, An electronic device that obtains coordinate values of the recognized target sound location and coordinate values of each of the plurality of reference sound locations, obtains distance values between the obtained coordinate values of the recognized target sound location and coordinate values of each of the plurality of reference sound locations, and obtains weight values for each index based on the obtained distance values.

6. In paragraph 1, A sensor unit that detects the movement of the head and transmits the detected information to the processor through the communication unit; and Including more speakers, The above communication unit performs communication with an external device, An electronic device in which the processor generates a sound image based on an input source received from the external device and the generated target transfer function, and controls the speaker to output the generated sound image through the speaker.

7. In paragraph 1, The above communication unit performs communication with external devices and audio output devices, An electronic device in which the processor generates a sound image based on an input source received from the external device and the generated target transfer function, and transmits the generated sound image to the audio output device.

8. In paragraph 1, The above target sound position includes a target azimuth angle and a target elevation angle, An electronic device wherein each of the plurality of reference sound positions includes a reference azimuth angle and a reference elevation angle.

9. In the first paragraph, the processor, An electronic device for determining a predetermined number of reference azimuth angles among a plurality of reference azimuth angles in order of decreasing azimuth difference values from the target azimuth angle, determining a predetermined number of reference elevation angles among a plurality of reference elevation angles in order of decreasing altitude difference values from the target elevation angle, and determining a plurality of indices based on the determined predetermined number of reference azimuth angles and the determined predetermined number of reference elevation angles.

10. In the first paragraph, the processor, An electronic device that generates a sound image based on a reference transfer function corresponding to a reference sound image position that is identical to the target sound image position, based on the existence of a reference sound image position that is identical to the target sound image position among the plurality of reference sound image positions.

11. Recognize the target sound location based on the detection information of head movement, Based on the above recognized target sound location, some of the plurality of reference sound locations stored in the memory are determined as a plurality of indices, Obtaining a reference transfer function and an initial delay corresponding to the determined plurality of indices based on the information stored in the above memory, Obtain weights for each index based on the above-determined plurality of indices, Generate a target transfer function based on the obtained index-specific weights, the obtained reference transfer function, and the obtained initial delay, Generate a sound image based on an input source received from an external device and the generated target transfer function, A method for controlling an electronic device for controlling the output of the generated sound image.

12. In paragraph 11, The above plurality of indexes include a first index and a second index, The above-mentioned first and second reference transfer functions obtained include a first reference transfer function corresponding to the first index and a second reference transfer function corresponding to the second index, A control method of an electronic device, wherein generating the interpolation transfer function comprises obtaining a first weight for the first index and a second weight for the second index based on the first and second indices, obtaining a magnitude based on the first reference transfer function, the second reference transfer function, and the first and second weights, and generating the interpolation transfer function based on the phase of one of the first and second reference transfer functions and the obtained magnitude.

13. In paragraph 12, Identify the weight with a larger size among the first and second weights, Obtain an index corresponding to the above identified weight, Further comprising obtaining the phase of the reference transfer function corresponding to the obtained index among the first and second reference transfer functions as the reference phase of the interpolation transfer function, A control method of an electronic device, wherein generating the interpolation transfer function includes generating the interpolation transfer function based on the phase and the magnitude of a reference transfer function corresponding to the obtained index among the first and second reference transfer functions.

14. In paragraph 11, The above-mentioned acquired initial delays include a first initial delay corresponding to the first index and a second initial delay corresponding to the second index, Generating the target transfer function comprises obtaining an adjustment delay based on the first and second weights and the first and second initial delays, and generating the target transfer function based on the obtained adjustment delay and the generated interpolation transfer function. A control method of an electronic device, wherein obtaining the weights for each index comprises obtaining coordinate values of the recognized target sound location and coordinate values of each of the plurality of reference sound locations, obtaining distance values between the obtained coordinate values of the recognized target sound location and coordinate values of each of the plurality of reference sound locations, and obtaining the weights for each index based on each of the obtained distance values.

15. In Article 11, The above target sound position includes a target azimuth angle and a target elevation angle, Each of the above multiple reference sound positions includes a reference azimuth angle and a reference elevation angle, Determining the plurality of indexes includes determining a predetermined number of reference azimuth angles in the order of decreasing azimuth difference values from the target azimuth angle among the plurality of reference azimuth angles, determining a predetermined number of reference elevation angles in the order of decreasing altitude difference values from the target elevation angle among the plurality of reference elevation angles, and determining a plurality of indexes based on the determined predetermined number of reference azimuth angles and the determined predetermined number of reference elevation angles. A control method of an electronic device further comprising generating the target transfer function based on the absence of a reference sound position identical to the target sound position among the plurality of reference sound positions.

Images