HRTF acquisition method and apparatus, and electronic device

Abstract

The embodiment of the invention provides an HRTF acquisition method and device and electronic equipment. The method comprises the following steps: acquiring a plurality of candidate HRTFs from a plurality of stored HRTFs; performing at least one audition feedback experiment on a target user according to the plurality of candidate HRTFs, and generating evaluation parameters of the plurality of candidate HRTFs; and according to the evaluation parameters of the plurality of candidate HRTFs, determining a personalized HRTF of the target user from the plurality of candidate HRTFs. In the embodiment of the invention, the electronic equipment can only carry out the audition feedback experiment aiming at the candidate HRTF, so that the complexity and the workload of obtaining the personalized HRTF operation are reduced; the electronic equipment determines the personalized HRTF from the plurality of candidate HRTFs through the audition feedback experiment, the real feeling of a user is considered in the process of obtaining the personalized HRTF, and the accuracy of obtaining the personalized HRTF is improved.

Description

[Technical field]

[0001] The embodiments of the present invention relate to the field of terminal technology, and specifically to a method, device and electronic device for acquiring HRTF. [Background technology]

[0002] As users' listening needs increase, spatial audio functions are gradually embedded in various electronic devices. Spatial audio technology uses the signal processing of the head-related transfer function (HRTF) and adopts appropriate sound reproduction methods to create a real spatial orientation effect of the surrounding sound sources for users. HRTF is a key element in the realization of spatial audio (or three-dimensional virtual sound) function. The HRTF characterizes the physical process characteristics of the sound waves emitted by the sound source after being scattered by the head, auricle, etc. and reaching the ears. Since the size and shape of the head, auricle, torso and other parts of different users are different, HRTF varies from person to person and is a physical quantity with personalized characteristics.

[0003] Users need to obtain truly personalized HRTF data in a dedicated anechoic laboratory through dedicated measurement equipment, or use a high-precision 3D scanner to scan the head and torso contours and use finite element simulation to obtain truly personalized HRTF data. Using the above two methods to obtain truly personalized HRTF is very difficult and costly.

[0004] In order to solve the above-mentioned problem of high cost of obtaining personalized HRTF, the related technology can adopt the physiological parameter matching method or the subjective listening feedback method to obtain personalized HRTF. However, the physiological parameter matching method does not take the user's real feelings into consideration, and the subjective listening feedback method is complex to operate and labor-intensive. Therefore, the scheme for obtaining user personalized HRTF in the related technology is complex to operate and labor-intensive, and the accuracy of the obtained personalized HRTF is low. [Summary of the invention]

[0005] In view of this, an embodiment of the present invention provides a method, an apparatus and an electronic device for obtaining HRTF, which are used to reduce the complexity and workload of obtaining personalized HRTF operations and improve the accuracy of the obtained personalized HRTF.

[0006] A first aspect provides a method for obtaining HRTF, characterized in that the method comprises:

[0007] Acquire multiple candidate HRTFs from the stored multiple HRTFs;

[0008] Performing at least one listening feedback experiment on a target user according to the plurality of candidate HRTFs to generate evaluation parameters of the plurality of candidate HRTFs;

[0009] According to the evaluation parameters of the plurality of candidate HRTFs, a personalized HRTF for the target user is determined from the plurality of candidate HRTFs.

[0010] In a possible implementation manner, obtaining a plurality of candidate HRTFs from a plurality of stored HRTFs includes:

[0011] Acquire a set of key physiological parameters of the target user;

[0012] Based on the physiological parameter matching algorithm, a plurality of candidate HRTFs are matched from the plurality of stored HRTFs according to the key physiological parameter set.

[0013] In a possible implementation manner, obtaining a plurality of candidate HRTFs from a plurality of stored HRTFs includes:

[0014] According to the attribute parameters of the target user, selecting the HRTF of a sample user having the same attribute parameters as the target user from the stored multiple HRTFs;

[0015] The HRTF of a sample user having the same attribute parameters as the target user is determined as the candidate HRTF.

[0016] In a possible implementation, before obtaining the key physiological parameter set of the target user, the method further includes:

[0017] Based on the machine learning algorithm, a nonlinear mapping model between HRTF and physiological parameters is trained in the HRTF dataset with physiological parameter labels;

[0018] Based on the nonlinear mapping model, selecting a designated type from multiple types of physiological parameters according to importance ranking;

[0019] The step of obtaining a set of key physiological parameters of the target user includes:

[0020] Acquire physiological parameters of a specified type of the target user to form the key physiological parameter set.

[0021] In a possible implementation, the acquiring of a physiological parameter of a specified type of the target user includes:

[0022] receiving a physiological parameter of a specified type of a target user measured manually and input by a measurer; or,

[0023] Through 2D photography or 3D scanning, the physiological parameters of the target user of a specified type are measured.

[0024] In a possible implementation, performing at least one listening feedback experiment on a target user according to the plurality of candidate HRTFs to generate evaluation parameters of the plurality of candidate HRTFs includes:

[0025] Performing a listening feedback experiment on the target user according to the multiple candidate HRTFs, generating an evaluation result corresponding to the multiple candidate HRTFs of at least one of the listening feedback experiments;

[0026] According to the evaluation results corresponding to the multiple candidate HRTFs of at least one of the listening feedback experiments, multiple evaluation parameters of the candidate HRTFs are generated.

[0027] In a possible implementation, performing a listening feedback experiment on the target user according to the multiple candidate HRTFs to generate at least one evaluation result corresponding to the multiple candidate HRTFs of the listening feedback experiment includes:

[0028] Generate spatial audio for each candidate HRTF corresponding to the listening feedback experiment;

[0029] playing the spatial audio;

[0030] receiving a listening feedback result from the target user according to the spatial audio input;

[0031] According to the listening feedback result of each candidate HRTF, an evaluation result corresponding to each candidate HRTF of the listening feedback experiment is calculated.

[0032] In a possible implementation, generating evaluation parameters of the plurality of candidate HRTFs according to evaluation results corresponding to the plurality of candidate HRTFs of at least one of the listening feedback experiments includes:

[0033] The evaluation results of multiple listening feedback experiments corresponding to each candidate HRTF are weighted and summed to generate evaluation parameters of each candidate HRTF.

[0034] In a possible implementation, generating the spatial audio of each candidate HRTF corresponding to the listening feedback experiment includes:

[0035] Rendering the selected sound source to generate the spatial audio according to the candidate HRTF and the obtained spatial options;

[0036] The receiving a listening feedback result of the target user according to the spatial audio input includes:

[0037] A spatial option selected from a plurality of displayed candidate spatial options according to the spatial audio is received, which is input by the target user.

[0038] In a possible implementation manner, the spatial option includes a spatial trajectory or a spatial direction.

[0039] In a possible implementation manner, the spatial direction includes an elevation angle and / or an azimuth angle.

[0040] In a possible implementation, generating the spatial audio of each candidate HRTF corresponding to the listening feedback experiment includes:

[0041] Rendering the selected sound source according to the candidate HRTF to generate the spatial audio;

[0042] The receiving a listening feedback result of the target user according to the spatial audio input includes:

[0043] Receive a feedback score from the target user based on the spatial audio input.

[0044] In a possible implementation, the key physiological parameter set includes at least one of a one-dimensional length parameter, a one-dimensional angle parameter, and a two-dimensional area parameter of at least one part.

[0045] In a second aspect, an embodiment of the present invention provides a device for acquiring HRTF, including:

[0046] An acquisition module, used for acquiring multiple candidate HRTFs from multiple stored HRTFs;

[0047] A generating module, configured to perform at least one listening feedback experiment on a target user according to the plurality of candidate HRTFs, and generate evaluation parameters of the plurality of candidate HRTFs;

[0048] The determination module is used to determine the personalized HRTF of the target user from the multiple candidate HRTFs according to the evaluation parameters of the multiple candidate HRTFs.

[0049] The third aspect provides an electronic device, comprising: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the sending device, enable the electronic device to execute the HRTF acquisition method in the first aspect or any possible implementation of the first aspect.

[0050] The fourth aspect provides a computer-readable storage medium, which includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute the HRTF acquisition method in the first aspect or any possible implementation of the first aspect.

[0051] In the technical solution provided by the embodiment of the present invention, the electronic device obtains multiple candidate HRTFs from the stored multiple HRTFs, so that the listening feedback experiment can be performed only on the candidate HRTFs, reducing the complexity and workload of the operation of obtaining personalized HRTFs; after the electronic device obtains multiple candidate HRTFs from the multiple candidate HRTFs, it determines the personalized HRTF from the multiple candidate HRTFs through the listening feedback experiment. The process of obtaining personalized HRTFs takes into account the real feelings of the user, thereby improving the accuracy of the obtained personalized HRTFs. The embodiment of the present invention realizes a simple and accurate solution for obtaining user personalized HRTFs through the solution of obtaining candidate HRTFs from multiple HRTFs and the listening feedback experiment.

Brief Description of the Drawings

[0052] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0053] Figure 1 is a schematic diagram of a method for obtaining HRTF in the related art;

[0054] Figure 2 is a schematic diagram of another HRTF acquisition method in the related art;

[0055] Figure 3 is a schematic diagram of the hardware structure of an electronic device in some embodiments;

[0056] Figure 4 is a flowchart of a method for obtaining HRTF in some embodiments;

[0057] Figure 5 is a schematic diagram of a rapid effectiveness judgment experiment interface in some embodiments;

[0058] Figure 6 is a schematic diagram of a sound localization experiment interface in some embodiments;

[0059] Figure 7 is a schematic diagram of an interface for a hearing perception scoring experiment in some embodiments;

[0060] Figure 8 is a flow chart of generating evaluation parameters of candidate HRTFs in some embodiments;

[0061] Fig. 9 is a flow chart for generating evaluation results in some embodiments;

[0062] Fig.10It is a schematic diagram of the structure of the HRTF acquisition device in some embodiments. [Specific implementation method]

[0063] In order to better understand the technical solution of the present invention, the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0064] It should be clear that the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0065] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0066] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0067] Personalized physiological parameters are the root of personalized HRTF. Therefore, the similarity of physiological parameters can be used to match the personalized HRTF of the target user from the HRTF baseline database. This is the idea of ​​obtaining approximate personalized HRTF based on the physiological parameter matching method. Figure 1 is a schematic diagram of a method for obtaining HRTF in the related art, such as Figure 1 As shown, the method includes: (1) measuring a set of key physiological parameters of the target user, which key physiological parameters include a plurality of key physiological parameters; (2) calculating the difference between the key physiological parameters of the target user and the key physiological parameters of each sample user in the HRTF baseline database; (3) determining the sample user with the smallest difference as the matching subject; (4) using the HRTF corresponding to the sample user ID of the matching subject as the approximate personalized HRTF of the target user.

[0068] The accuracy of the physiological parameter matching method for approximate personalized HRTF mainly depends on the selection of matching factors (i.e., key physiological parameter set). Zotkin et al. directly adopted a key physiological parameter set consisting of seven ear physiological parameters; Fels et al. believed that three head physiological parameters and three ear physiological parameters had a significant impact on HRTF below 8kHz; and Spagnol studied the linear fitting relationship between the positioning error of the horizontal front half plane and the difference in physiological parameters of different subjects, and believed that the three head and trunk physiological parameters were crucial. A more common research method is to use the Pearson correlation coefficient method or linear regression model to select a key physiological parameter set. It can be seen that there is no consensus on the key physiological parameter set related to HRTF, and its selection is mainly based on the linear mapping model of HRTF and physiological parameters, which cannot cover the nonlinear physical nature of the two. These deficiencies restrict the development of spatial audio technology and the improvement of related product performance.

[0069] Therefore, the physiological parameter matching method in the related technology can only select the HRTF that is closest to a certain objective indicator based on the user's physiological parameters, and cannot obtain the user's true feelings, and thus cannot determine whether the selected HRTF is suitable for the user, resulting in the obtained personalized HRTF being not accurate enough.

[0070] The related art also provides a solution for obtaining HRTF through a subjective listening feedback method. The subjective listening feedback method starts with a general HRTF, and continuously adjusts the parameters of each spatial direction according to whether the target user's perception in each spatial direction is correct. The parameters of the spatial direction may include interaural time difference (ITD) and / or interaural level difference (ILD) to determine a personalized HRTF.

[0071] Figure 2 is a schematic diagram of another HRTF acquisition method in the related art, such as Figure 2As shown, the spatial direction selection module outputs the mono audio to the filter with the same spatial direction as the received spatial direction according to the received spatial direction; the filter performs convolution calculation on the mono audio and the filter parameters to generate the spatial audio of the spatial direction, and plays the spatial audio of the spatial direction; the target user evaluates the spatial audio of the spatial direction to obtain a feedback result; it is determined whether the feedback result is correct, and if it is determined that the feedback result is incorrect, the parameters of the spatial direction are adjusted; by adjusting the parameters of the spatial direction, the filter parameters of the filter of the spatial direction can be adjusted; and then the filter continues to perform the step of performing convolution calculation on the mono audio and the filter parameters to generate the spatial audio of the spatial direction until the feedback result output by the target user is correct. Repeat the above process, traverse the filters of the remaining spatial directions, until the feedback result output by the target user for each filter is correct. Finally, according to each spatial direction and the filter parameters of the filter of each spatial direction when the feedback result is correct, a personalized HRTF is generated. For example, the spatial direction can be 15°, 30°, 45°, etc., the filter parameters can include left ear filter parameters and right ear filter parameters, and the parameters of the spatial direction can include ITD and ILD.

[0072] For example, different filters correspond to different spatial directions, filter W1 corresponds to spatial direction 1, filter W2 corresponds to spatial direction 2, and so on. N Corresponding to the spatial direction N; filters in different spatial directions output different spatial audio, filter W1 outputs spatial audio Y1, filter W2 outputs spatial audio Y2, and so on. N Output spatial audio Y N . The spatial direction selection module outputs the mono audio to the filter W1 according to the received spatial direction; the filter W1 performs convolution calculation on the mono audio and the filter parameters to generate the spatial audio Y1 of the spatial direction, and outputs the spatial audio Y1 of the spatial direction; the target user evaluates the spatial audio Y1 of the spatial direction played to obtain a feedback result; it is determined whether the feedback result is correct, and if it is determined that the feedback result is incorrect, the parameters of the spatial direction are adjusted; by adjusting the parameters of the spatial direction, the filter parameters of the filter W1 of the spatial direction can be adjusted; until the feedback result output by the target user is correct. Repeat the above process, traversing the remaining filters W1 to filter W N Until the target user's feedback result for each filter output is correct. Finally, according to each spatial direction and the filter W1 to filter W when the feedback result is correct N The filter parameters are used to generate personalized HRTF.

[0073] Therefore, the subjective listening feedback method in the related technology requires manual and continuous adjustment of parameters, which is cumbersome to operate and has certain requirements on the professional ability of the operator. It requires repeated attempts and a large workload, so the process of obtaining personalized HRTF is very slow.

[0074] In order to solve the technical problems existing in the related art, an embodiment of the present invention provides an electronic device. In some embodiments, the electronic device includes but is not limited to a Or devices with other operating systems. Electronic devices include but are not limited to mobile phones, tablets, laptops, desktop computers, smart screens, etc.

[0075] For example, Figure 3 is a schematic diagram of the hardware structure of the electronic device in some embodiments, such as Figure 3 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195. It can be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present invention, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0076] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated into one or more processors. Among them, the controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

[0077] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. It can be understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation of the electronic device 100. In other embodiments of the present invention, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0078] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0079] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0080] The wireless communication function of the electronic device 100 can be implemented by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modulation and demodulation processor and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, antenna 1 can be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0081] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G / 6G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter, amplify and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110. The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modem processor can be an independent device. In other embodiments, the modem processor can be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0082] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0083] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), 5G and subsequent evolution standards, BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0084] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute instructions to generate or change display information. The electronic device 100 can implement a shooting function through an ISP, one or more cameras 193, a video codec, a GPU, one or more display screens 194, and an application processor.

[0085] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0086] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0087] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0088] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc. Among them, the touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0089] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0090] In order to solve the technical problems existing in the related art, the embodiment of the present invention provides a method for obtaining HRTF, which can be applied to Figure 3 The electronic device shown. The electronic device obtains multiple candidate HRTFs from multiple stored HRTFs; performs at least one listening feedback experiment on a target user according to the multiple candidate HRTFs to generate evaluation parameters of multiple candidate HRTFs; determines the personalized HRTF of the target user from the multiple candidate HRTFs according to the evaluation parameters of the multiple candidate HRTFs. In an embodiment of the present invention, the electronic device obtains multiple candidate HRTFs from multiple stored HRTFs, so that the listening feedback experiment can be performed only on the candidate HRTFs, reducing the complexity and workload of the operation of obtaining personalized HRTFs; after the electronic device obtains multiple candidate HRTFs from multiple candidate HRTFs, the personalized HRTF is determined from the multiple candidate HRTFs through the listening feedback experiment, and the process of obtaining personalized HRTFs takes into account the real feelings of the user, thereby improving the accuracy of the obtained personalized HRTF. In summary, the embodiment of the present invention realizes a simple and accurate solution for obtaining personalized HRTFs of users through the solution of obtaining candidate HRTFs from multiple HRTFs and the listening feedback experiment.

[0091] Figure 4 is a flowchart of a method for obtaining HRTF in some embodiments, such as Figure 4 As shown, the method includes:

[0092] Step 102: The electronic device obtains multiple candidate HRTFs from multiple stored HRTFs.

[0093] As an optional solution, step 102 may specifically include:

[0094] Step 1022: The electronic device obtains a set of key physiological parameters of the user.

[0095] In some embodiments, before step 1022, the method further includes:

[0096] Step S11: The electronic device trains a nonlinear mapping model between HRTF and physiological parameters in a HRTF data set with physiological parameter labels based on a machine learning algorithm.

[0097] In one possible implementation, the machine learning algorithm may include a random forest, and in step S1, the electronic device may train a nonlinear mapping model between HRTF and physiological parameters based on the random forest. In another possible implementation, the machine learning algorithm may also include a deep neural network algorithm, which is not limited in the embodiment of the present invention.

[0098] Step S12: The electronic device selects a plurality of designated types from the plurality of types of physiological parameters according to the importance ranking based on the nonlinear mapping model.

[0099] In the embodiment of the present invention, step S12 may specifically include:

[0100] Step S121: The electronic device analyzes the importance weight of each type of physiological parameter according to the nonlinear mapping model.

[0101] Step S122: The electronic device sorts the types of input physiological parameters according to importance weights.

[0102] Step S123: The electronic device selects the types of the first N physiological parameters as designated types, where N is a positive integer.

[0103] The physiological parameters of the target user may have multiple types, wherein the multiple types may include different parameter types of different parts of the target user. Therefore, the multiple types include but are not limited to one-dimensional lengths, one-dimensional angles, and two-dimensional areas of multiple parts. The specified type may include at least one of the one-dimensional length, one-dimensional angle, and two-dimensional area of ​​at least one part, and the physiological parameters of the specified type may include at least one of the one-dimensional length, one-dimensional angle parameter, and two-dimensional area parameter of at least one part. For example, the multiple types may include the one-dimensional length of the head, the one-dimensional angle of the head, the one-dimensional length of the trunk, the two-dimensional area of ​​the ear, etc. The electronic device selects the specified type from the multiple types such as the one-dimensional length of the head, the one-dimensional angle of the head, the one-dimensional length of the trunk, the two-dimensional area of ​​the ear, etc. according to the order of importance. For example, the specified type may include the one-dimensional length of the head and the two-dimensional area of ​​the ear.

[0104] In some embodiments, step 1022 specifically includes: the electronic device obtains physiological parameters of a specified type of the target user to form a set of key physiological parameters.

[0105] In a possible implementation, a measurer measures the physiological parameters of a specified type of a target user by manual measurement to obtain the physiological parameters of the specified type of the target user, and inputs the measured physiological parameters of the specified type of the target user into an electronic device, so that the electronic device can obtain the physiological parameters of the specified type of the target user. The measurer can measure the physiological parameters of the specified type of the target user by a measuring ruler, and the measurer and the target user can be the same user or different users.

[0106] In another possible implementation, the electronic device can measure the specified type of physiological parameters of the target user through 2D photography or 3D scanning to obtain the specified type of physiological parameters of the target user. The electronic device can implement 2D photography through its own shooting function to measure the specified type of physiological parameters of the target user; or the electronic device can implement 3D scanning through its own 3D scanning function to measure the specified type of physiological parameters of the target user.

[0107] For example, if the specified type may include a one-dimensional length of the head and a two-dimensional area of ​​the ear, the specified type of physiological parameter may include a length parameter of the head and an area parameter of the ear. For the specified type of physiological parameter of the ear, the specified type of physiological parameters of the two ears may be obtained respectively, and then the average value of the specified type of physiological parameters of the two ears may be calculated and the calculated average value may be used as the specified type of physiological parameter of the ear.

[0108] After acquiring the physiological parameters of the specified type of the target user, the electronic device may form a key physiological parameter set according to the physiological parameters of the specified type of the target user, and the key physiological parameter set may include the physiological parameters of the specified type. Then the key physiological parameter set includes at least one of a one-dimensional length parameter, a one-dimensional angle parameter, and a two-dimensional area parameter of at least one part.

[0109] In the embodiment of the present invention, the electronic device obtains a set of key physiological parameters based on the constructed nonlinear mapping model between HRTF and physiological parameters, so as to be more in line with the physical nature of HRTF.

[0110] Step 1024: The electronic device matches multiple candidate HRTFs from the stored multiple HRTFs based on the physiological parameter matching algorithm and the key physiological parameter set.

[0111] In an embodiment of the present invention, a database is provided, and a plurality of HRTFs are stored in the database. Then, the electronic device matches a plurality of candidate HRTFs from the plurality of HRTFs stored in the database according to a set of key physiological parameters based on a physiological parameter matching algorithm. The database may include the HRTFs of sample users and physiological parameters of multiple parts of the sample users, and the set of key physiological parameters may include physiological parameters of a specified type of the target user. The database may include an HRTF baseline database.

[0112] In a possible implementation, the electronic device calculates the difference between the physiological parameters of the specified type of the target user and the physiological parameters of each sample user based on the database and the key physiological parameter set, and uses the HRTFs corresponding to a set number of sample users with the smallest difference values ​​as candidate HRTFs, wherein the set number is greater than 1, for example, the set number includes at least two, and the number of candidate HRTFs includes at least two. As an optional solution, the set number may include at least three, and the number of candidate HRTFs includes at least three.

[0113] In a possible implementation, the difference value may be a weighted distance. Specifically, the electronic device may use the weighted distance formula: d = sqrt (∑ wi (Xi - Yi) 2 ) calculates the weighted distance between the physiological parameters of the target user and the physiological parameters of the sample users, where Xi is the physiological parameters of the specified type of the target user, Yi is the physiological parameters of the sample user, wi is the importance weight of the physiological parameters, and i=1, 2...n. Repeating the above process, the electronic device can calculate the weighted distance between the physiological parameters of the target user and the physiological parameters of each sample user, that is, calculate multiple weighted distances. The electronic device uses the HRTFs corresponding to the set number M of sample users with the smallest weighted distances as candidate HRTFs, for example, M can be greater than or equal to 3.

[0114] As another optional solution, step 102 may specifically include:

[0115] Step 1026: The electronic device selects an HRTF having the same attribute parameters as the attribute parameters of the target user from the stored multiple HRTFs according to the attribute parameters of the target user.

[0116] In an embodiment of the present invention, multiple HRTFs may be stored in a database, and the electronic device may select a sample user's HRTF having the same attribute parameters as the target user from the multiple HRTFs stored in the database. In one possible manner, the attribute parameters of the target user may include at least one of height, weight, age, gender, and race. In actual applications, the attribute parameters may also use other parameters, which are not limited in the embodiment of the present invention.

[0117] For example, if the attribute parameters of the target user include age, the electronic device may select the HRTF of a sample user who has the same age as the target user from the stored multiple HRTFs.

[0118] Step 1028: The electronic device determines the HRTF of the sample user having the same attribute parameters as the target user as the candidate HRTF.

[0119] For example, the electronic device may determine the HRTF of a sample user who has the same age as the target user as the candidate HRTF.

[0120] Step 104: The electronic device performs at least one listening feedback experiment on the target user according to the multiple candidate HRTFs to generate evaluation parameters of the multiple candidate HRTFs.

[0121] The listening feedback experiment may include a quick effectiveness judgment experiment, a listening localization experiment or a hearing perception scoring experiment, and at least one listening feedback experiment may include a quick effectiveness judgment experiment, a listening localization experiment and a hearing perception scoring experiment. Among them, the quick effectiveness judgment experiment can be used to quickly and conveniently determine whether the HRTF is effective for the target user, the listening localization experiment can be used to obtain the target user's matching degree to the HRTF with high precision, and the hearing perception scoring experiment can be used to obtain the target user's evaluation of the degree of liking for the HRTF in actual application scenarios. In the embodiment of the present invention, three listening feedback experiments, namely, the quick effectiveness judgment experiment, the listening localization experiment and the hearing perception scoring experiment, are described as examples.

[0122] To implement the above-mentioned listening feedback experiment, a corresponding listening feedback experiment interface can be designed for each listening feedback experiment, and the listening feedback experiment interface can be encapsulated as an application (APP), and the electronic device installs the APP to display the listening feedback experiment interface. If the listening feedback experiment is a rapid effectiveness judgment experiment, the listening feedback experiment interface is a rapid effectiveness judgment experiment interface; if the listening feedback experiment is a listening positioning experiment, the listening feedback experiment interface is a listening positioning experiment interface; if the listening feedback experiment is a listening perception scoring experiment, the listening feedback experiment interface is a listening perception scoring experiment interface. Target users can interact with electronic devices through the APP.

[0123] Figure 5 is a schematic diagram of a rapid effectiveness judgment experiment interface in some embodiments, such as Figure 5As shown, the quick effectiveness judgment experiment interface may include a spatial audio generation area, a spatial audio playback area, and a user feedback area. The spatial audio generation area may include icons of three databases and a "start experiment" button, wherein the three databases may include an HRTF library, a trajectory library, and a sound source library. The icon of the HRTF library is used to indicate that the electronic device is provided with an HRTF library, the icon of the trajectory library is used to indicate that the electronic device is provided with a trajectory library, and the icon of the sound source library is used to indicate that the electronic device is provided with a sound source library. The electronic device can receive the start experiment operation input by the target user through the "start experiment" button. The spatial audio playback area may include current sound information and experimental progress, wherein the current sound information may be used to represent the HRTF information, trajectory information, and sound source information used to generate the current spatial audio. To ensure the accuracy of the experimental results, the current sound information needs to be kept confidential from the target user. Therefore, the electronic device does not display the specific content of the HRTF information, trajectory information, and sound source information, but replaces the specific content of the HRTF information, trajectory information, and sound source information with "***"; the experimental progress may include the serial number of the spatial audio being played and the total number of spatial audios, wherein the serial number of the spatial audio being played is "the Xth sound is being played", and the total number of spatial audios is "a total of Y", for example, X=6, Y=106. The user feedback area may include multiple spatial trajectory graphics and multiple user operation buttons, wherein each spatial trajectory graphic may be used to represent a spatial trajectory, Figure 5 In the following, 8 spatial trajectory graphs are used as examples to describe: Figure 5 In the figure, 8 different arrows are used to represent 8 different spatial trajectory graphs. Figure 5 8 kinds of spatial trajectories are shown through 8 spatial trajectory graphics, and the spatial trajectory graphics can be selected by the target user, so the spatial trajectory represented by the spatial trajectory graphics can be an alternative spatial trajectory; the multiple user operation buttons may include a "listen to original sound" button, a "specify sound source" button, a "switch sound source" button, a "relisten" button and a "unable to judge" button.

[0124] Figure 6 is a schematic diagram of a sound localization experiment interface in some embodiments, such as Figure 6As shown, the listening localization experiment interface may include a spatial audio generation area, a spatial audio playback area, and a user feedback area. The spatial audio generation area may include icons of three databases and a "start experiment" button, wherein the three databases may include an HRTF library, a direction library, and a sound source library. The icon of the HRTF library is used to indicate that the electronic device is provided with an HRTF library, the icon of the direction library is used to indicate that the electronic device is provided with a direction library, and the icon of the sound source library is used to indicate that the electronic device is provided with a sound source library. The electronic device may receive the start experiment operation input by the target user through the "start experiment" button. The spatial audio playback area may include current sound information and experimental progress, wherein the current sound information may be used to indicate the HRTF information, trajectory information, and sound source information used to generate the current spatial audio. To ensure the accuracy of the experimental results, the current sound information needs to be kept confidential from the target user. Therefore, the electronic device does not display the specific content of the HRTF information, trajectory information, and sound source information, but replaces the specific content of the HRTF information, trajectory information, and sound source information with "***". The experimental progress may include the serial number of the spatial audio being played and the total number of spatial audios, wherein the serial number of the spatial audio being played is "playing the Xth sound", and the total number of spatial audios is "a total of Y", for example, X=6, Y=106. The user feedback area may include multiple spatial buttons and multiple user operation buttons, and the spatial buttons may include a pitch angle button and / or an azimuth angle button. The spatial buttons may be used to indicate the spatial direction. Specifically, the user feedback area may include multiple pitch angle buttons, multiple azimuth angle buttons, and multiple user operation buttons. The pitch angle button may be used to indicate the pitch angle, and the azimuth angle button may be used to indicate the azimuth angle. Figure 6 In the example, 3 pitch angle buttons and 8 azimuth angle buttons are taken as an example. For example, the 3 pitch angle buttons may include 0°, 45° and 90° buttons, and the 8 azimuth angle buttons may include 0°, -45°, -90°, -135°, 180°, 135°, 90° and 45° buttons. The pitch angle buttons and azimuth angle buttons can be used to indicate spatial directions. Figure 6 Multiple spatial directions are shown, each of which may include a pitch angle and / or an azimuth angle. The spatial direction buttons can be selected by the target user, so the spatial direction represented by the spatial direction button can be an alternative spatial direction; multiple user operation buttons may include a "listen to original sound" button, a "specify sound source" button, a "switch sound source" button, a "listen again" button and a "unable to judge" button.

[0125] Figure 7 is a schematic diagram of the hearing perception scoring experiment interface in some embodiments, such as Figure 7As shown, the hearing sense scoring experiment interface may include a spatial audio generation area and a playback feedback area. The spatial audio generation area may include icons of two databases and a "start experiment" button, wherein the two databases may include an HRTF library and a sound source / video library, the icon of the HRTF library is used to indicate that the electronic device is provided with an HRTF library, and the icon of the sound source / video library is used to indicate that the electronic device is provided with a sound source library, and the electronic device may receive the start experiment operation input by the target user through the "start experiment" button. The playback feedback area may include a video display area, an experiment progress, a set of playback feedback information, and a "next group" button. Among them, the video display area is used to display the video; the experiment progress may include the number of spatial audio groups being played and the total number of spatial audio groups, wherein the number of spatial audio groups being played is "playing the Xth group of sound", and the total number of spatial audio groups is "a total of Y", for example, X=6, Y=15. A set of playback feedback information may include multiple HRTF numbers, a scoring slider corresponding to each HRTF number, and a "listen" button corresponding to each HRTF number. In order to ensure the accuracy of the experimental results, the current sound information needs to be kept confidential from the target user. Therefore, the electronic device does not display the specific content of the HRTF number, but replaces the specific content of the HRTF number with "***"; the scoring slider is used to indicate the scoring range. The electronic device can receive the score entered by the target user through the scoring slider. The target user can slide the scoring slider to enter the score, for example, the scoring range is 0 to 5 points; the "listen" button is used to receive the audition instruction entered by the target user.

[0126] Figures 5 to 7 In the embodiment of the present invention, the position of each area in the interface can be adjusted according to the user's preferences, and the name and position of each icon, graphic and button in the interface can also be adjusted according to the user's preferences, which is not limited in this regard.

[0127] Figures 5 to 7 The interface diagram of the electronic device shown is an exemplary display of an embodiment of the present invention. The interface diagram of the electronic device may also be in other styles, which is not limited by the embodiment of the present invention.

[0128] In the embodiment of the present invention, Figure 8 is a flowchart of generating evaluation parameters of candidate HRTFs in some embodiments, such as Figure 8 As shown, step 104 may specifically include:

[0129] Step 1042: The electronic device performs a listening feedback experiment on the target user according to the multiple candidate HRTFs, and generates evaluation results corresponding to the multiple candidate HRTFs of at least one listening feedback experiment.

[0130] In the embodiment of the present invention, Fig. 9 is a flowchart of generating evaluation results in some embodiments, such as Fig. 9 As shown, step 1042 may specifically include:

[0131] Step S21: The electronic device generates spatial audio for each candidate HRTF corresponding to the listening feedback experiment.

[0132] In the embodiment of the present invention, the spatial audio may be a binaural virtual sound signal.

[0133] In an embodiment of the present invention, step S21 may specifically include: the electronic device renders the selected sound source to generate spatial audio according to the candidate HRTF and the acquired spatial options. When the listening feedback experiment is a rapid effectiveness judgment experiment, the spatial options include spatial trajectories; or when the listening feedback experiment is a listening localization experiment, the spatial options include spatial directions.

[0134] As an optional solution, the listening feedback experiment is a quick effectiveness judgment experiment. Figure 5 As shown, the HRTF library is used to store multiple candidate HRTFs, the trajectory library is used to store multiple pre-generated spatial trajectories, and the sound source library is used to store multiple sound sources selected according to the target user's usage scenario, wherein the sound source includes but is not limited to white noise, colored noise, music or voice, etc. Then step S21 may specifically include: the electronic device renders the selected sound source to generate spatial audio according to the candidate HRTF and the acquired spatial trajectory. At this time, the electronic device can randomly select a sound source from the sound source library, and render the sound source according to a candidate HRTF and a spatial trajectory to generate a spatial audio, and then the electronic device can repeat the above process to generate multiple spatial audios. As shown Figure 5 As shown, the electronic device can start the quick validity judgment experiment in response to the start experiment operation input by the target user. At this time, the electronic device can render the selected sound source to generate spatial audio according to the candidate HRTF and the acquired spatial trajectory. Figure 5 As shown, the target user can click the "Start Experiment" button to input the start experiment operation to the electronic device. In the embodiment of the present invention, the number of generated spatial audios can be the number of candidate HRTFs*the number of spatial tracks. The electronic device can reuse some or all types of spatial tracks in the track library during the process of generating spatial audio. Therefore, the number of spatial tracks is Where B is the number of spatial tracks, Ai is the number of times different types of spatial tracks are used, and the number of spatial tracks is the sum of the number of times m types of spatial tracks are used. If the number of times a spatial track is used is 1, it means that the spatial track is used once in the process of generating spatial audio and is not reused; if the number of times a spatial track is used is greater than 1, it means that the spatial track is reused in the process of generating spatial audio, and the number of times the spatial track is used is the number of repetitions. Among them, the target user can set the number of times the spatial track is used according to the needs of the experiment.

[0135] As another option, the listening feedback experiment is a listening localization experiment. Figure 6 As shown, the HRTF library is used to store multiple candidate HRTFs, the direction library is used to store multiple pre-generated spatial directions, and the sound source library is used to store multiple selected sound sources, wherein the spatial direction may include pitch angles and / or azimuth angles, and the sound sources include but are not limited to white noise, colored noise, music or speech, etc. Then step S21 may specifically include: the electronic device renders the selected sound source to generate spatial audio according to the candidate HRTF and the acquired spatial direction. At this time, the electronic device can randomly select a sound source from the sound source library, and render the sound source according to a candidate HRTF and a spatial trajectory to generate a spatial audio, and then the electronic device can repeat the above process to generate multiple spatial audios. As shown Figure 6 As shown, the electronic device can start the listening localization experiment in response to the start experiment operation input by the target user. At this time, the electronic device can render the selected sound source to generate spatial audio according to the candidate HRTF and the acquired spatial direction. Figure 6 As shown, the target user can click the "Start Experiment" button to input the start experiment operation to the electronic device. In the embodiment of the present invention, the number of generated spatial audios can be the number of candidate HRTFs*the number of spatial directions. The electronic device can reuse some or all types of spatial directions in the trajectory library during the process of generating spatial audio. Therefore, the number of spatial directions is Where D is the number of spatial directions, Ci is the number of times different types of spatial directions are used, and the number of spatial directions is the sum of the number of times l spatial directions are used. If the number of times a spatial direction is used is 1, it means that the spatial direction is used once in the process of generating spatial audio and is not reused; if the number of times a spatial direction is used is greater than 1, it means that the spatial direction is reused in the process of generating spatial audio, and the number of times the spatial direction is used is the number of repetitions. Among them, the target user can set the number of times a spatial direction is used according to the needs of the experiment.

[0136] As another option, the listening feedback experiment is a listening perception scoring experiment. Figure 7 As shown, the HRTF library is used to store multiple candidate HRTFs, and the audio / video library is used to store multiple selected audio sources, where the audio sources include but are not limited to music, voice or movies. Then step S21 may specifically include: the electronic device renders the selected audio source according to the candidate HRTF to generate spatial audio. At this time, the electronic device can randomly select a sound source from the audio source library, and render the sound source according to a candidate HRTF to generate a spatial audio, and then repeat the above process to generate multiple spatial audios. Figure 7As shown, the electronic device can start the hearing scoring experiment in response to the start experiment operation input by the target user. At this time, the electronic device can render the selected sound source according to the candidate HRTF to generate spatial audio. Figure 7 As shown, the target user can click the "start experiment" button to input the start experiment operation to the electronic device. In the embodiment of the present invention, the number of generated spatial audios can be the number of candidate HRTFs.

[0137] Step S22: The electronic device plays the spatial audio.

[0138] As an optional solution, the listening feedback experiment is a quick effectiveness judgment experiment. Figure 5 As shown, the electronic device performs experiments in a random order, so the electronic device can randomly play multiple spatial audios corresponding to each candidate HRTF, for example, Figure 5 The 6th spatial audio among 106 spatial audios is being played. In one possible implementation, during the spatial audio playback, the first spatial audio played is a spatial audio generated based on a randomly selected sound source. The target user can subsequently switch the spatial audio. Specifically, the target user can input a sound source switching operation to the electronic device, so that the electronic device responds to the sound source switching operation input by the target user, renders the switched sound source according to the candidate HRTF and the spatial trajectory to generate a new spatial audio and plays the spatial audio, thereby achieving random switching of sound sources. The sound source switching operation may include clicking a "switch sound source" button. In actual applications, the audio switching operation may also be other types of operations, such as inputting a voice "switch sound source" operation. In another possible implementation, during the process of playing spatial audio, the target user can specify the spatial audio. Specifically, the target user can input a specified sound source operation to the electronic device, so that the electronic device responds to the specified sound source operation input by the target user, renders the specified sound source according to the candidate HRTF and the spatial trajectory to generate a new spatial audio and plays the spatial audio, thereby realizing the specified sound source, wherein the specified sound source operation may include the operation of clicking a "specify sound source" button. In actual applications, the sound source switching operation may also be other types of operations, such as the operation of inputting a voice "specify sound source". For example, when the target user clicks the "specify sound source" button, the electronic device may pop up a specified sound source menu, which may include the names of multiple sound sources, and the target user may select a specified sound source name from the names of the multiple sound sources to select the specified sound source.

[0139] As another option, the listening feedback experiment is a listening localization experiment. Figure 6 As shown, the electronic device performs experiments in a random order, so the electronic device can randomly play multiple spatial audios corresponding to each candidate HRTF, for example, Figure 6The 6th spatial audio among 106 spatial audios is currently playing.

[0140] exist Figure 6 The schemes shown in the figure include switching the spatial audio scheme, specifying the spatial audio scheme, re-listening to the spatial audio scheme, and listening to the original sound scheme. Figure 5 The scheme shown is the same and will not be described again here.

[0141] As another option, the listening feedback experiment is a listening perception scoring experiment. Figure 7 As shown, the electronic device performs experiments in a random order, so the electronic device can randomly play multiple spatial audios corresponding to each candidate HRTF, for example, Figure 7 The 6th spatial audio among the 15 spatial audios is currently playing. Figure 7 The video displayed in is the video corresponding to the selected sound source. When the sound source used by the played spatial audio is changed, Figure 7 In one possible implementation, if the electronic device has generated spatial audio, the electronic device plays the spatial audio corresponding to the playback operation in the set of spatial audios according to the playback operation input by the target user, for example, Figure 7 The set of spatial audios shown in includes 3 spatial audios, each of which corresponds to a "listen" button, and the play operation is to click the "listen" button. When the user clicks a "listen" button, the electronic device plays the spatial audio corresponding to the "listen" button. In another possible implementation, the electronic device can render the selected sound source according to the candidate HRTF to generate spatial audio in response to the play operation input by the target user, and play the spatial audio. That is, the electronic device can generate and play the spatial audio only after the target user inputs the play operation.

[0142] In an embodiment of the present invention, when the electronic device plays spatial audio through headphones, the spatial audio can be played directly through the headphones; when the electronic device plays spatial audio through speakers, signal processing for eliminating crosstalk can be performed on the spatial audio, and the spatial audio that has been processed to eliminate crosstalk can be played through the speakers.

[0143] Step S23: The electronic device receives a listening feedback result from the target user based on the spatial audio input.

[0144] In an embodiment of the present invention, step S23 may specifically include: the electronic device receives a spatial option selected from a plurality of displayed candidate spatial options according to spatial audio input by the target user. Wherein, when the listening feedback experiment is a rapid effectiveness judgment experiment, the candidate spatial option includes a candidate spatial trajectory, and the spatial option includes a spatial trajectory; or, when the listening feedback experiment is a listening positioning experiment, the candidate spatial option includes a candidate spatial direction, and the spatial option includes a spatial direction.

[0145] As an optional solution, the listening feedback experiment is a quick effectiveness judgment experiment. Then step S22 may specifically include: the electronic device receives the spatial track selected by the target user from multiple displayed candidate spatial tracks according to the spatial audio. The electronic device may display multiple candidate spatial tracks through the quick effectiveness judgment experiment interface. After the electronic device plays a spatial audio, the target user listens to the played spatial audio, selects a spatial track from the multiple displayed candidate spatial tracks after listening, and inputs the selected spatial track to the electronic device. Therefore, the listening feedback result may include the selected spatial track. Figure 5 As shown, the target user can click on the spatial trajectory graphic corresponding to the alternative spatial trajectory to select a spatial trajectory, for example, Figure 5 In the figure, the target user clicks the arrow direction from bottom to top to select a spatial trajectory. In practical applications, the target user can also input the selected spatial trajectory through other input methods, for example, the target user inputs the selected spatial trajectory to the electronic device by inputting voice; or, if the electronic device includes an accelerometer gyroscope, the target user can input the selected spatial trajectory to the electronic device by rotating the electronic device; or, if the electronic device is a device with a visual motion capture function, the target user inputs the selected spatial trajectory to the electronic device by inputting visual motion to the electronic device, for example, the electronic device may include a virtual reality (VR) device or an augmented reality (AR) device, and the visual motion may include human limb motion, facial expression or hand motion.

[0146] Optionally, if the target user fails to obtain a listening feedback result after listening to the played spatial audio, the spatial audio can be listened to again. At this time, the target user inputs a re-listening operation to the electronic device, so that the electronic device replays the spatial audio according to the re-listening operation input by the target user. The re-listening operation may include clicking a "re-listening" button. In actual applications, the re-listening operation may also be other types of operations, for example, inputting a voice "re-listening" operation.

[0147] Optionally, if the target user fails to obtain a listening feedback result after listening to the played spatial audio, he or she may request to listen to the sound source (original sound) that forms the spatial audio so as to obtain a more accurate listening feedback result. At this time, the target user inputs an operation to listen to the original sound to the electronic device, so that the electronic device plays the sound source that forms the spatial audio according to the operation to listen to the original sound input by the target user. The operation to listen to the original sound may include clicking a "listen to the original sound" button. In actual applications, the operation to listen to the original sound may also be other types of operations, for example, inputting a voice operation of "listen to the original sound".

[0148] Optionally, if the target user fails to obtain a listening feedback result after listening to the played spatial audio once or multiple times, an undeterminable listening feedback result can be input into the electronic device, wherein the user can click an "unable to judge" button to input an undeterminable listening feedback result into the electronic device. In actual applications, the user can also input the voice "unable to judge" to input an undeterminable listening feedback result into the electronic device.

[0149] As another optional scheme, the listening feedback experiment is a listening positioning experiment. Then step S22 may specifically include: the electronic device receives the spatial direction selected by the target user from multiple displayed alternative spatial directions according to the spatial audio. The electronic device may display multiple spatial directions through the listening positioning experiment interface, and the spatial direction may include the pitch angle and / or the azimuth angle. After the electronic device plays a spatial audio, the target user listens to the played spatial audio, selects a spatial direction from the multiple displayed spatial directions after listening, and inputs the selected spatial direction to the electronic device. Therefore, the listening feedback result includes the selected spatial direction, and the selected spatial direction may include the pitch angle and / or the azimuth angle. Figure 6 As shown, the target user selects a pitch angle from multiple pitch angles and selects an azimuth angle from multiple azimuth angles to input the selected pitch angle and azimuth angle to the electronic device. The target user can click the pitch angle button to select a pitch angle, for example, Figure 6 The user in the middle clicks the pitch angle 45° button to select a pitch angle of 45°; the target user can click the azimuth angle button to select an azimuth angle, for example, Figure 6The target user clicks the azimuth 0° button to select the azimuth 0°. In actual applications, the target user can also input the selected spatial direction through other input methods, for example, the target user inputs the selected spatial direction to the electronic device by inputting voice; or, if the electronic device includes an accelerometer gyroscope, the target user can input the selected spatial direction to the electronic device by rotating the electronic device; or, if the electronic device is a device with a visual motion capture function, the target user can input the selected spatial direction to the electronic device by inputting visual motion to the electronic device, for example, the electronic device may include a VR device or an AR device, and the visual motion may include human limb motions, facial expressions, or hand motions.

[0150] exist Figure 6 The feedback shown is not able to judge the listening feedback results. Figure 5 The scheme shown is the same and will not be described again here.

[0151] As an optional solution, the listening feedback experiment is a listening score experiment. Then step S22 may specifically include: the electronic device receives the feedback score input by the target user based on the spatial audio. After the electronic device plays a spatial audio, the target user listens to the played spatial audio and inputs the feedback score to the electronic device after listening. The listening feedback result includes the feedback score. Figure 7 As shown, the electronic device can display a rating slider through the hearing scoring experiment interface, and the user can slide the rating slider to input the feedback rating. For example, the user slides the rating slider to 3 points and inputs a feedback rating of 3 points. In actual applications, the user can also input the feedback rating through other input methods, for example, the user inputs the feedback rating to the electronic device by inputting voice.

[0152] After the user inputs the listening feedback result to the electronic device, the electronic device plays the next spatial audio in the set of spatial audios and receives the listening feedback result of the next spatial audio input by the user. Then, the above process can be repeated until the listening feedback process of all spatial audios in the set of spatial audios is completed.

[0153] After the electronic device completes the listening feedback of a set of spatial audio, it can perform the listening feedback of the next set of spatial audio. The user inputs the spatial audio change operation to the electronic device, so that the electronic device changes the next set of spatial audio according to the audio change operation, such as Figure 7 As shown, the spatial audio changing operation may include the operation of clicking a "next group" button. In actual applications, the spatial audio changing operation may also be other types of operations, such as the operation of inputting a voice "next group". The electronic device repeatedly performs the above process until the listening feedback process of the spatial audio of all groups is completed.

[0154] In the process of executing steps S21 to S23, as an optional scheme, for a listening feedback experiment, the electronic device may execute steps S21 to S23 once to complete the generation, playback and acquisition of listening feedback results of one spatial audio, and then repeat steps S21 to S23 to complete the generation, playback and acquisition of listening feedback results of the remaining spatial audio.

[0155] In the process of executing steps S21 to S23, as another optional solution, for a listening feedback experiment, the electronic device may generate multiple spatial audios when executing step S21, and then repeat steps S22 and S23 to complete the playback of multiple spatial audios and obtain listening feedback results.

[0156] Step S24: The electronic device calculates an evaluation result corresponding to each candidate HRTF of the listening feedback experiment according to the listening feedback result of each candidate HRTF.

[0157] As an optional solution, when the listening feedback experiment is a rapid effectiveness judgment experiment, the evaluation result is an average accuracy rate, and the electronic device can calculate the average accuracy rate of each candidate HRTF of the rapid effectiveness judgment experiment based on the listening feedback result of each candidate HRTF. Specifically, the listening feedback result includes a selected spatial trajectory. For a candidate HRTF, the electronic device can determine whether the spatial trajectory input by the user is consistent with the spatial trajectory that generates the spatial audio. If they are consistent, it is determined that the spatial trajectory input by the user is correct. If they are inconsistent, it is determined that the spatial trajectory input by the user is incorrect; then, the electronic device can count the number of times the user inputs the correct spatial trajectory and the total number of times the user inputs the spatial trajectory, and divide the number of times the user inputs the correct spatial trajectory by the total number of times the user inputs the spatial trajectory to generate the average accuracy rate of the candidate HRTF. Among them, if the user inputs a listening feedback result that cannot be judged, it is determined that the spatial trajectory input by the user is incorrect. Repeat the above process to calculate the average accuracy rate of other candidate HRTFs of the rapid effectiveness judgment experiment.

[0158] As another optional solution, the listening feedback experiment is a listening localization experiment, and the evaluation result is the localization accuracy. The electronic device can calculate the localization accuracy of each candidate HRTF of the listening localization experiment based on the listening feedback result of each candidate HRTF. Specifically, the listening feedback result includes a selected spatial direction. The electronic device can determine whether the spatial direction input by the user is consistent with the spatial direction of the spatial audio generated. If they are consistent, it is determined that the spatial direction input by the user is correct. If they are inconsistent, it is determined that the spatial direction input by the user is incorrect. Then, the electronic device can count the number of times the user inputs the correct spatial direction and the total number of times the user inputs the spatial direction, and divide the number of times the user inputs the correct spatial direction by the total number of times the user inputs the spatial direction to generate the localization accuracy of the candidate HRTF. Among them, if the user inputs a listening feedback result that cannot be judged, it is determined that the spatial direction input by the user is incorrect. Repeat the above process to calculate the localization accuracy of other candidate HRTFs of the listening localization experiment.

[0159] As another optional solution, the listening feedback experiment is a hearing perception scoring experiment, and the evaluation result is an average score. The electronic device can calculate the average score of each candidate HRTF in the hearing perception scoring experiment based on the listening feedback result of each candidate HRTF. Specifically, the listening feedback result includes a feedback score, and the electronic device can calculate the average of multiple feedback scores of each candidate HRTF, and use the average as the average score.

[0160] In an embodiment of the present invention, for a listening feedback experiment, after executing steps S21 to S23 to complete the steps of generating, playing, and obtaining listening feedback results of all spatial audio of the listening feedback experiment, the electronic device may execute step S24 to calculate the evaluation result corresponding to each candidate HRTF of the listening feedback experiment.

[0161] Then, for other listening feedback experiments, steps S21 to S24 may be repeatedly performed to obtain an evaluation result corresponding to each candidate HRTF of each listening feedback experiment.

[0162] Step 1044: The electronic device generates evaluation parameters of multiple candidate HRTFs according to evaluation results corresponding to multiple candidate HRTFs of at least one listening feedback experiment.

[0163] As an optional solution, the electronic device performs weighted summation of evaluation results of multiple listening feedback experiments corresponding to each candidate HRTF to generate evaluation parameters of each candidate HRTF.

[0164] In an embodiment of the present invention, at least one listening feedback experiment includes a quick effectiveness judgment experiment, a listening localization experiment and a hearing perception scoring experiment. The electronic device may perform weighted summation on the average accuracy of the quick effectiveness judgment experiment, the positioning accuracy of the listening localization experiment and the average score of the hearing perception scoring experiment corresponding to each candidate HRTF to generate an evaluation parameter for each candidate HRTF, wherein the evaluation parameter may be a total score.

[0165] The evaluation parameters of electronic equipment can be calculated by the following formula:

[0166] S k =w r a r,k +w s a s,k +w t a t,k , k=1,……,K, where k is the number of candidate HRTFs; r is used to represent the listening localization experiment, and the evaluation indicators of the listening localization experiment include but are not limited to the head-in rate and the localization accuracy rate; s is used to represent the listening sense scoring experiment, and the evaluation indicators of the listening sense scoring experiment include but are not limited to the sense of presence and the perceived difference; t is used to represent the rapid effectiveness judgment experiment; w r is the weight of the listening localization experiment; w s is the weight of the listening score experiment; w t The weight of the experiment for rapid effectiveness judgment; a r,k is the accuracy of the sound localization experiment corresponding to the kth candidate HRTF; a s,k is the average score of the hearing score experiment corresponding to the k-th candidate HRTF; a t,k is the average accuracy of the fast validity judgment experiment corresponding to the kth candidate HRTF; S k is the evaluation parameter of the kth candidate HRTF. r 、w s and w t Can be flexibly set according to application scenarios.

[0167] Step 106: The electronic device determines a personalized HRTF for the target user from a plurality of candidate HRTFs according to the evaluation parameters of the plurality of candidate HRTFs.

[0168] The electronic device may determine the candidate HRTF with the highest evaluation parameter among the multiple candidate HRTFs as the personalized HRTF. In a possible implementation, the electronic device sorts the evaluation parameters according to size, and determines the candidate HRTF with the highest evaluation parameter as the personalized HRTF.

[0169] In an embodiment of the present invention, the electronic device obtains multiple candidate HRTFs from multiple stored HRTFs, so that a listening feedback experiment can be performed only on the candidate HRTFs, reducing the complexity and workload of the operation of obtaining personalized HRTFs; after the electronic device obtains multiple candidate HRTFs from multiple candidate HRTFs, it determines a personalized HRTF from the multiple candidate HRTFs through a listening feedback experiment, and the process of obtaining personalized HRTFs takes into account the user's real feelings, thereby improving the accuracy of the obtained personalized HRTFs. The embodiment of the present invention implements a simple and accurate solution for obtaining a user's personalized HRTF through a solution for obtaining candidate HRTFs from multiple HRTFs and a listening feedback experiment.

[0170] In the embodiment of the present invention, the electronic device obtains multiple candidate HRTFs through a physiological parameter matching algorithm, so that a listening feedback experiment can be performed only on the candidate HRTFs, reducing the complexity and workload of obtaining personalized HRTF operations; after the electronic device obtains multiple candidate HRTFs through a physiological parameter matching algorithm, it determines a personalized HRTF from the multiple candidate HRTFs through a listening feedback experiment, and the process of obtaining personalized HRTFs takes into account the user's real feelings, thereby improving the accuracy of the obtained personalized HRTFs. The embodiment of the present invention implements a simple and accurate solution for obtaining a user's personalized HRTF through a physiological parameter matching algorithm and a listening feedback experiment.

[0171] In the embodiment of the present invention, a set of key physiological parameters is determined based on a nonlinear mapping model, thereby improving the accuracy of the physiological parameter matching method; at the same time, on the basis of the physiological parameter matching method, the selection of approximate personalized HRTF is further refined through listening feedback experiments, so that the final approximate personalized HRTF is closer to the user's own personalized HRTF.

[0172] The technical solution of the embodiment of the present invention integrates an objective physiological parameter matching algorithm and a subjective listening feedback experiment, thereby improving the accuracy of physiological parameter matching.

[0173] An embodiment of the present invention provides a device for acquiring HRTF, and the device for acquiring HRTF can be applied to electronic equipment. Fig.10 is a schematic diagram of the structure of the HRTF acquisition device in some embodiments, such as Fig.10 As shown, the device includes: an acquisition module 11, a generation module 12 and a determination module 13. The acquisition module 11 is used to acquire multiple candidate HRTFs from multiple stored HRTFs; the generation module 12 is used to perform at least one listening feedback experiment on a target user based on the multiple candidate HRTFs to generate multiple evaluation parameters of the candidate HRTFs; the determination module 13 is used to determine the personalized HRTF of the target user from the multiple candidate HRTFs based on the multiple evaluation parameters of the candidate HRTFs.

[0174] In a possible implementation, the acquisition module 11 includes an acquisition submodule 111 and a matching submodule 112. The acquisition submodule 111 is used to acquire a set of key physiological parameters of the target user; the matching submodule 112 is used to match multiple candidate HRTFs from multiple stored HRTFs according to the set of key physiological parameters based on a physiological parameter matching algorithm.

[0175] In a possible implementation, the acquisition module 11 includes a selection submodule 113 and a determination submodule 114. The selection submodule 113 is used to select, according to the attribute parameters of the target user, the HRTF of a sample user having the same attribute parameters as the target user from the stored multiple HRTFs; the determination submodule 114 is used to determine the HRTF of the sample user having the same attribute parameters as the target user as the candidate HRTF.

[0176] In a possible implementation, the device further includes: a training module 14 and a screening module 15. The training module 14 is used to train a nonlinear mapping model between HRTF and physiological parameters in a HRTF data set with physiological parameter labels based on a machine learning algorithm; the screening module 15 is used to screen out a specified type from multiple types of physiological parameters according to importance based on the nonlinear mapping model; the acquisition submodule 111 is specifically used to acquire the physiological parameters of the specified type of the target user to form the key physiological parameter set.

[0177] In a possible implementation, the acquisition submodule 111 is specifically used to receive the physiological parameters of the target user of the specified type measured manually and input by the measurer; or to measure the physiological parameters of the target user of the specified type through 2D photography or 3D scanning.

[0178] In a possible implementation, the generation module 12 includes a first generation submodule 121 and a second generation submodule 122. The first generation submodule 121 is used to perform a listening feedback experiment on the target user according to the multiple candidate HRTFs, and generate evaluation results corresponding to the multiple candidate HRTFs of at least one of the listening feedback experiments; the second generation submodule 122 is used to generate evaluation parameters of the multiple candidate HRTFs according to the evaluation results corresponding to the multiple candidate HRTFs of at least one of the listening feedback experiments.

[0179] In one possible implementation, the first generation submodule 121 is specifically used to generate spatial audio for each candidate HRTF corresponding to the listening feedback experiment; play the spatial audio; receive the listening feedback results of the target user based on the spatial audio input; and calculate the evaluation results corresponding to each candidate HRTF of the listening feedback experiment based on the listening feedback results of each candidate HRTF.

[0180] In a possible implementation, the second generating submodule 122 is specifically configured to perform weighted summation on the evaluation results of multiple listening feedback experiments corresponding to each candidate HRTF to generate an evaluation parameter of each candidate HRTF.

[0181] In a possible implementation, the first generating submodule 121 is specifically used to render the selected sound source to generate the spatial audio according to the candidate HRTF and the obtained spatial options; and receive the spatial option selected by the target user from multiple displayed candidate spatial options according to the spatial audio.

[0182] In a possible implementation manner, the spatial option includes a spatial trajectory or a spatial direction.

[0183] In a possible implementation manner, the spatial direction includes an elevation angle and / or an azimuth angle.

[0184] In a possible implementation, the first generating submodule 121 is specifically configured to render the selected sound source according to the candidate HRTF to generate the spatial audio; and receive a feedback score from the target user according to the spatial audio input.

[0185] In an embodiment of the present invention, the electronic device obtains multiple candidate HRTFs from multiple stored HRTFs, so that a listening feedback experiment can be performed only on the candidate HRTFs, reducing the complexity and workload of the operation of obtaining personalized HRTFs; after the electronic device obtains multiple candidate HRTFs from multiple candidate HRTFs, it determines a personalized HRTF from the multiple candidate HRTFs through a listening feedback experiment, and the process of obtaining personalized HRTFs takes into account the user's real feelings, thereby improving the accuracy of the obtained personalized HRTFs. In summary, the embodiment of the present invention implements a simple and accurate solution for obtaining a user's personalized HRTF through a solution for obtaining candidate HRTFs from multiple HRTFs and a listening feedback experiment.

[0186] An embodiment of the present invention provides an electronic device, which includes: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to perform the various steps in the above-mentioned HRTF acquisition method embodiment.

[0187] An embodiment of the present invention provides a computer-readable storage medium, which includes a stored program, wherein when the program is executed, the electronic device where the computer-readable storage medium is located is controlled to execute each step in the above-mentioned HRTF acquisition method embodiment.

[0188] An embodiment of the present invention provides a computer program product including instructions. When the computer program product is run on a computer or any at least one processor, the computer is enabled to execute each step in the above-mentioned HRTF acquisition method embodiment.

[0189] In the embodiments of the present invention, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. A and B may be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c may be single or multiple.

[0190] Those skilled in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.

[0191] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0192] In several embodiments provided by the present invention, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., various media that can store program codes.

[0193] The above is only a specific embodiment of the present invention. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. The protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A method for obtaining a head-related transfer function HRTF, characterized in that: The method comprises: Acquire multiple candidate HRTFs from the stored multiple HRTFs; Performing at least one listening feedback experiment on a target user according to the plurality of candidate HRTFs to generate evaluation parameters of the plurality of candidate HRTFs; According to the evaluation parameters of the plurality of candidate HRTFs, a personalized HRTF for the target user is determined from the plurality of candidate HRTFs.

2. The method according to claim 1, characterized in that: The acquiring a plurality of candidate HRTFs from the stored plurality of HRTFs comprises: Acquire a set of key physiological parameters of the target user; Based on the physiological parameter matching algorithm, a plurality of candidate HRTFs are matched from the plurality of stored HRTFs according to the key physiological parameter set.

3. The method according to claim 1, characterized in that The acquiring a plurality of candidate HRTFs from the stored plurality of HRTFs comprises: According to the attribute parameters of the target user, selecting the HRTF of a sample user having the same attribute parameters as the target user from the stored multiple HRTFs; The HRTF of a sample user having the same attribute parameters as the target user is determined as the candidate HRTF.

4. The method according to claim 2, characterized in that: Before obtaining the key physiological parameter set of the target user, the method further includes: Based on the machine learning algorithm, a nonlinear mapping model between HRTF and physiological parameters is trained in the HRTF dataset with physiological parameter labels; Based on the nonlinear mapping model, selecting a designated type from multiple types of physiological parameters according to importance ranking; The step of obtaining a set of key physiological parameters of the target user includes: Acquire physiological parameters of a specified type of the target user to form the key physiological parameter set.

5. The method according to claim 4, characterized in that The step of obtaining a physiological parameter of a specified type of the target user includes: receiving a physiological parameter of a specified type of a target user measured manually and input by a measurer; or, Through 2D photography or 3D scanning, the physiological parameters of the target user of a specified type are measured.

6. The method according to claim 1, characterized in that The step of performing at least one listening feedback experiment on a target user according to the plurality of candidate HRTFs to generate evaluation parameters of the plurality of candidate HRTFs includes: Performing a listening feedback experiment on the target user according to the multiple candidate HRTFs, generating an evaluation result corresponding to the multiple candidate HRTFs of at least one of the listening feedback experiments; According to the evaluation results corresponding to the multiple candidate HRTFs of at least one of the listening feedback experiments, multiple evaluation parameters of the candidate HRTFs are generated.

7. The method according to claim 6, characterized in that The performing a listening feedback experiment on the target user according to the plurality of candidate HRTFs to generate at least one evaluation result corresponding to the plurality of candidate HRTFs of the listening feedback experiment includes: Generate spatial audio for each candidate HRTF corresponding to the listening feedback experiment; playing the spatial audio; receiving a listening feedback result from the target user according to the spatial audio input; According to the listening feedback result of each candidate HRTF, an evaluation result corresponding to each candidate HRTF of the listening feedback experiment is calculated.

8. The method according to claim 6, characterized in that The step of generating evaluation parameters of the candidate HRTFs according to the evaluation results corresponding to the candidate HRTFs of at least one of the listening feedback experiments comprises: The evaluation results of multiple listening feedback experiments corresponding to each candidate HRTF are weighted and summed to generate evaluation parameters of each candidate HRTF.

9. The method according to claim 7, characterized in that: The generating of spatial audio of each candidate HRTF corresponding to the listening feedback experiment includes: Rendering the selected sound source to generate the spatial audio according to the candidate HRTF and the obtained spatial options; The receiving a listening feedback result of the target user according to the spatial audio input includes: A spatial option selected from a plurality of displayed candidate spatial options according to the spatial audio is received, which is input by the target user.

10. The method according to claim 7, characterized in that The spatial options include a spatial trajectory or a spatial direction.

11. The method according to claim 10, characterized in that The spatial direction includes an elevation angle and / or an azimuth angle.

12. The method according to claim 7, characterized in that The generating of spatial audio of each candidate HRTF corresponding to the listening feedback experiment includes: Rendering the selected sound source according to the candidate HRTF to generate the spatial audio; The receiving a listening feedback result of the target user according to the spatial audio input includes: Receive a feedback score from the target user based on the spatial audio input.

13. The method according to any one of claims 1 to 12, characterized in that: The key physiological parameter set includes at least one of a one-dimensional length parameter, a one-dimensional angle parameter and a two-dimensional area parameter of at least one part.

14. A device for acquiring HRTF, characterized in that: include: An acquisition module, used for acquiring multiple candidate HRTFs from multiple stored HRTFs; A generating module, configured to perform at least one listening feedback experiment on a target user according to the plurality of candidate HRTFs, and generate evaluation parameters of the plurality of candidate HRTFs; The determination module is used to determine the personalized HRTF of the target user from the multiple candidate HRTFs according to the evaluation parameters of the multiple candidate HRTFs.

15. An electronic device, characterized in that: include: one or more processors; Memory; And one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to execute the HRTF acquisition method described in any one of claims 1 to 13.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the electronic device where the computer-readable storage medium is located is controlled to execute the HRTF acquisition method according to any one of claims 1 to 13.

Images