A method, device and system for testing audio spatial awareness of a head-mounted display device

Abstract

The application discloses a kind of head-mounted display device audio spatial sense test method, device and system, comprising: control virtual sound source sends excitation signal at preset space orientation and by the SPK of head-mounted display device the excitation signal is played, the signal that simulation person's left and right ears respectively receive simultaneously is obtained;According to the signal that simulation person's left and right ears respectively receive simultaneously, the multiple spatial audio effect parameters of virtual sound source are calculated;Determine whether multiple spatial audio effect parameters are in the respective preset standard value range corresponding to the preset space orientation, if all spatial audio effect parameters are in the respective preset standard value range, then determine that spatial audio effect test is qualified at preset space orientation;If a certain spatial audio effect parameter is not in the preset standard value range, then determine that the spatial audio effect test of virtual sound source at the preset space orientation is unqualified.The application realizes the objective test to the audio spatial sense of head-mounted display device.

Description

Technical Field

[0001] This invention relates to the field of virtual spatial sound technology, and more specifically, to a method, apparatus, and system for testing the audio spatial sense of a head-mounted display device. Background Technology

[0002] Since the rise of the metaverse concept, VR (Virtual Reality), AR (Augmented Reality), and MR (Mixed Reality) products have proliferated, both domestically and internationally, involving large and small companies, established enterprises and startups, creating a wave of industry immersion. For users to be fully immersed in VR / AR / MR content, both image quality and sound effects are indispensable. From refresh rates to head tracking latency, from field of view to resolution, the detail and viewing comfort of VR / AR / MR images are constantly being improved by new technologies. However, simply feeling visually immersive is far from enough. Even if VR / AR / MR content is incredibly realistic, if the accompanying sound effects are inadequate, it will inevitably create a sense of disconnect. Therefore, VR / AR / MR must also be immersive in sound, with precise sense of direction and distance, mimicking how people react to sounds in real life, to truly maintain a high degree of immersion for users.

[0003] However, current audio spatial perception testing for VR / AR / MR head-mounted displays relies more on subjective feelings and lacks objective testing methods. Summary of the Invention

[0004] This invention provides a method, apparatus, and system for testing the audio spatial sense of head-mounted display devices, which addresses the current bottleneck that the audio spatial sense of head-mounted display devices can only be subjectively perceived without objective testing.

[0005] According to a first aspect of the present invention, a method for testing the audio spatial sense of a head-mounted display device is provided, the method comprising:

[0006] The head-mounted display device to be tested was worn normally on the head of the simulated human, and the virtual sound source was controlled by software commands to be located in different preset spatial positions in sequence;

[0007] The virtual sound source is controlled to send an excitation signal at a preset spatial location, and the SPK of the head-mounted display device plays the excitation signal to obtain the signals received simultaneously by the left and right ears of the simulated human.

[0008] The virtual sound source is calculated based on the signals received simultaneously by the left and right ears of the simulated human. The spatial sound effect parameters include the binaural time difference, the binaural sound level difference, and the normalized spectral curves of the left and right ear transfer functions.

[0009] Determine whether the calculated spatial sound effect parameters are within their respective preset standard value ranges at the corresponding preset spatial locations. If all spatial sound effect parameters are within their respective preset standard value ranges, the spatial sound effect test of the virtual sound source at the preset spatial location is deemed qualified; if a certain spatial sound effect parameter is not within the preset standard value range, the spatial sound effect test of the virtual sound source at the preset spatial location is deemed unqualified.

[0010] According to a second aspect of the present invention, a testing apparatus for the audio spatial sense of a head-mounted display device is provided, the apparatus comprising:

[0011] The spatial orientation control unit is used to properly place the head-mounted display device under test on the head of the simulated human and control the virtual sound source to be located in different preset spatial orientations through software commands;

[0012] The signal acquisition unit is used to control the virtual sound source to send an excitation signal at the preset spatial location and for the SPK of the head-mounted display device to play the excitation signal, thereby acquiring the signals received simultaneously by the left and right ears of the simulated human.

[0013] The spatial sound effect parameter calculation unit is used to calculate multiple spatial sound effect parameters of the virtual sound source based on the signals simultaneously received by the left and right ears of the simulated human. The spatial sound effect parameters include the binaural time difference, the binaural sound level difference, and the normalized spectral curves of the left and right ear transfer functions.

[0014] The spatial sound effect parameter qualification and failure judgment unit is used to determine whether the calculated multiple spatial sound effect parameters are within their respective preset standard value ranges at the corresponding preset spatial orientations. If all spatial sound effect parameters are within their respective preset standard value ranges, the spatial sound effect test of the virtual sound source at the preset spatial orientation is determined to be qualified; if a certain spatial sound effect parameter is not within the preset standard value range, the spatial sound effect test of the virtual sound source at the preset spatial orientation is determined to be unqualified.

[0015] According to a third aspect of the present invention, a testing system for the audio spatial sense of a head-mounted display device is provided, comprising a human simulator, a speaker, a control console, and a head-mounted display device to be tested. The control console performs spatial sound effect testing on the head-mounted display device to be tested using the aforementioned testing method for the audio spatial sense of a head-mounted display device.

[0016] The beneficial effects of the various embodiments of the present invention are as follows:

[0017] In various embodiments of the present invention, software instructions are used to control a virtual sound source to be sequentially located at different preset spatial orientations, control the virtual sound source to transmit an excitation signal at the preset spatial orientation, and cause the speaker (SPK) of a head-mounted display device to play the excitation signal. The purpose of this is to acquire signals simultaneously received by the left ear and right ear of a dummy head respectively, so as to calculate a plurality of spatial audio parameters of the virtual sound source according to the signals simultaneously received by the left ear and right ear of the dummy head respectively, and further determine whether the calculated plurality of spatial audio parameters of the virtual sound source fall within respective preset standard value ranges at the corresponding preset spatial orientations. During determination, if all spatial audio parameters fall within their respective preset standard value ranges, it is determined that the spatial audio test of the virtual sound source at the preset spatial orientation is qualified; if a certain spatial audio parameter does not fall within the preset standard value range, it is determined that the spatial audio test of the virtual sound source at the preset spatial orientation is unqualified. Since whether the spatial audio test is qualified depends on whether the plurality of spatial audio parameters fall within the corresponding respective preset standard value ranges, the solutions of various embodiments of the present invention achieve an objective test on the audio spatial perception of head-mounted display devices, solve the current bottleneck that only subjective perception is available and no objective test exists, and the obtained test result is more authentic and reliable. Description of Drawings

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings described below are only some embodiments recorded in the present invention, and those skilled in the art can obtain other accompanying drawings based on these accompanying drawings. In the accompanying drawings:

[0019] Figure 1 shows a schematic diagram of a spatial sphere, wherein the center position of the sphere is the head center of a dummy head or a user;

[0020] Figure 2 shows a schematic diagram of a virtual sound source at different orientation angles;

[0021] Figure 3 shows a schematic diagram of a virtual sound source at different horizontal angles;

[0022] Figure 4 shows a schematic flow diagram of a method for testing audio spatial perception of a head-mounted display device according to an embodiment of the present invention;

[0023] Figure 5 shows a schematic diagram of the logical relationship between a received signal and an excitation signal;

[0024] Figs. 6(a) to 6(d) show a schematic comparison diagram of left and right ear transfer functions when the horizontal angle of test points is 0 degree and orientation angles are 0 degree, 30 degrees, 60 degrees and 90 degrees respectively according to one embodiment of the present invention;

[0025] Figure 7 (a) shows the time difference Δτ between the left and right ears under the H000E000 scenario corresponding to Figure 6(a). Figure 7 (b) shows the time difference Δτ between the left and right ears under the H000E090 scenario corresponding to Figure 6(d);

[0026] Figure 8(a) shows the frequency response FR of the left and right ears under the H000E000 scenario corresponding to Figure 6(a), and Figure 8(b) shows the frequency response FR of the left and right ears under the H000E090 scenario corresponding to Figure 6(d).

[0027] Figure 9 The normalized spectrum curves of the right ear transfer function are shown for the two scenarios corresponding to H000E000 in Figure 6(a) and H000E090 in Figure 6(d), respectively.

[0028] Figure 10 A schematic diagram of the structure of a test apparatus for audio spatial perception of a head-mounted display device according to an embodiment of the present invention is shown;

[0029] Figure 11 A schematic diagram of the structure of a test system for audio spatial perception of a head-mounted display device according to an embodiment of the present invention is shown. Detailed Implementation

[0030] Embodiments of the present invention will now be described in more detail with reference to the accompanying drawings. These embodiments are provided so that this invention will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Although exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention may be implemented in various forms and should not be limited to the embodiments set forth herein.

[0031] Generally speaking, three important factors influence binaural spatial localization: interaural time difference (ITD), interaural level difference (ILD), and spectral effects.

[0032] (1) Binaural Time Difference (ITD): There is a time difference in the transmission of sound from a sound source to a person's left and right ears. This time difference is called the binaural time difference, and it is a crucial factor in directional sound source localization. When the sound source is located in the hypotenuse of the head, its distance to both ears is equal. However, when the sound source deviates from the hypotenuse, its distance to both ears differs, resulting in the ITD. This change is detected by the ears, making ITD a very important factor in ear-based localization.

[0033] (2) Binaural Sound Level Difference (ILD): When a point sound source deviates from the vertical plane of the head, the head casts shadows and scatters sound waves (especially in the high-frequency range). The sound pressure at the ear opposite the sound source is attenuated, while the sound pressure at the ear on the same side as the sound source is increased, thus creating a binaural sound level difference. For higher frequency sound waves, the wavelength is smaller than the head size. When the sound source is not on the vertical plane connecting the two ears, the sound waves are blocked by the head and cannot diffract to the distant ear canals, causing a difference in sound levels reaching the two ears. The greater the deviation of the sound source from the vertical plane, or the higher the frequency, the greater the sound level difference between the two ears. The greater the sound level difference, the stronger the localization ability. At the same time, different frequencies exhibit different sound level difference characteristics. The sound level difference generated between the two ears by a low-frequency sound source changes less with the azimuth angle of the sound source, meaning that the binaural localization ability for low-frequency sounds is poor. As the frequency of the sound source increases, the sound level difference between the two ears increases with the change in azimuth angle, and the localization ability of the sound gradually improves.

[0034] (3) Spectral effect: The essence of the spectral effect is that the auricle effect changes the spectral characteristics of sound in different spatial directions. The change in spectral characteristics mainly applies to high-frequency signals. Because high-frequency signals have short wavelengths, the various reflected waves refracted by the auricle into the ear canal will exhibit interference phenomena such as in-phase addition, out-of-phase subtraction, or even mutual cancellation, forming peaks and valleys in the spectrum, which is the effect of the auricle on high-frequency sound waves. Based on the spectral effect, spatial positioning can be achieved using the spectral curves of the transfer functions of the left and right ears.

[0035] Figure 1 A schematic diagram of a spatial sphere is shown, wherein the center of the sphere is located at the center of the head of the simulated human or user. Figure 2 The diagram shows the virtual sound source at different azimuth angles; Figure 3 The diagram illustrates virtual sound sources at different horizontal angles. For head-mounted display devices, the distance between the virtual sound source and the center of the simulated human or user's head is the same, which is the radius of a sphere; only the horizontal and azimuth angles change.

[0036] Before conducting objective testing of the audio spatial sense of the head-mounted display device of this invention, a test environment needs to be set up in a soundproof room, and the test equipment includes a human simulator and speakers.

[0037] The testing process involves placing speakers one by one at test points corresponding to various preset spatial locations. The speakers are then controlled to emit excitation signals at each test point, acquiring the signals simultaneously received by the left and right ears of the simulated human. Based on these signals, the standard value ranges of multiple spatial sound effect parameters for each preset spatial location are pre-calculated. The test points are selected according to the testing requirements.

[0038] Figure 4A schematic flowchart illustrating a method for testing the audio spatial sense of a head-mounted display device according to an embodiment of the present invention is shown. See also Figure 4 As shown, the method of the present invention includes the following steps S410 to S450:

[0039] Step S410: The head-mounted display device to be tested is worn normally on the head of the simulated human, and the virtual sound source is controlled by software commands to be located in different preset spatial positions in sequence.

[0040] The spatial orientation information of the virtual sound source includes distance, horizontal angle, and azimuth angle.

[0041] The test distance is usually selected based on the actual test requirements. Considering that the spatial audio of head-mounted display devices is often near-field, the near-field distance (the radius of the near-field sphere around the listener's head) is usually defined as about 0.5-1.0m.

[0042] Step S420: Control the virtual sound source to send an excitation signal at the preset spatial location and have the SPK of the head-mounted display device play the excitation signal to obtain the signals received simultaneously by the left and right ears of the simulated human.

[0043] Microphones can be placed at the left and right ears of the simulated human, and the signals received by the left and right ears of the simulated human can be obtained from the signals collected by the microphones.

[0044] Figure 5 A schematic diagram illustrating the logical relationship between the received signal and the excitation signal is shown. For example... Figure 5 As shown, the acoustic transmission path between the excitation signal and the received signal is represented by a transfer function.

[0045] Figures 6(a) to 6(d) show a comparison of the left and right ear transfer functions at test points with a horizontal angle of 0 degrees and azimuth angles of 0 degrees, 30 degrees, 60 degrees, and 90 degrees, respectively, according to an embodiment of the present invention. The upper track represents the left channel (corresponding to the left ear), and the lower track represents the right channel (corresponding to the right ear). H000E000 indicates a horizontal angle of 0 degrees and an azimuth angle of 0 degrees; H000E030 indicates a horizontal angle of 0 degrees and an azimuth angle of 30 degrees; H000E060 indicates a horizontal angle of 0 degrees and an azimuth angle of 60 degrees; and H000E090 indicates a horizontal angle of 0 degrees and an azimuth angle of 90 degrees. As can be seen from the comparison of the upper and lower tracks in Figures 6(a) to 6(d), when the excitation signal is played at different test points, the transfer functions of the left and right ears differ due to the difference in the signals received by the left and right ears.

[0046] Step S430: Calculate multiple spatial sound effect parameters of the virtual sound source based on the signals simultaneously received by the left and right ears of the simulated human. The spatial sound effect parameters include the binaural time difference, the binaural sound level difference, and the normalized spectral curves of the left and right ear transfer functions.

[0047] In one embodiment, calculating the binaural time difference of a virtual sound source based on the signals simultaneously received by the left and right ears of a simulated human includes: convolving the signals simultaneously received by the left and right ears of the simulated human with an excitation signal to obtain the time τ when the excitation signal arrives at the left and right ears of the simulated human respectively; and obtaining the binaural time difference of the virtual sound source based on the time difference Δτ between the left and right ears.

[0048] Figure 7 (a) shows the time difference Δτ between the left and right ears under the H000E000 scenario corresponding to Figure 6(a). Figure 7 (b) shows the time difference Δτ between the left and right ears under the H000E090 scenario corresponding to Figure 6(d). Figure 7 (a) and Figure 7 (b) The comparison shows that in the case of H000E000, the time difference between the left and right ears is Δτ≈0, while in the case of H000E090, the time difference between the left and right ears is Δτ≈0.68ms. It can be seen that the time difference between the two ears differs under different spatial orientation scenarios.

[0049] In one embodiment, calculating the binaural sound level difference of the virtual sound source based on the signals simultaneously received by the left and right ears of the simulated human includes: performing a Fast Fourier Transform (FFT) on the signals simultaneously received by the left and right ears of the simulated human to convert them to the frequency domain to obtain the frequency responses FR of the left and right ears; and obtaining the binaural sound level difference of the virtual sound source based on the difference ΔFR between the frequency responses of the left and right ears.

[0050] Figure 8(a) shows the frequency response (FR) of the left and right ears under the H000E000 scenario corresponding to Figure 6(a), and Figure 8(b) shows the frequency response (FR) of the left and right ears under the H000E090 scenario corresponding to Figure 6(d). Comparing Figure 8(a) and Figure 8(b), it can be seen that in the H000E000 scenario, the FR curves of the left and right ears basically overlap, while in the H000E090 scenario, there is a significant difference between the FR curves of the left and right ears. This indicates that the binaural sound level difference differs under different spatial orientation scenarios.

[0051] In one embodiment, calculating the normalized spectral curves of the left and right ear transfer functions of the virtual sound source based on the signals simultaneously received by the left and right ears of the simulated human includes: performing FFT transformation on the excitation signal and the signals simultaneously received by the left and right ears of the simulated human to convert them to the frequency domain; dividing the received signals of the left and right ears by the excitation signal in the frequency domain to obtain the spectral curves of the left and right ear transfer functions; and normalizing the spectral curves of the left and right ear transfer functions at low-frequency points to obtain the normalized spectral curves of the left and right ear transfer functions of the virtual sound source.

[0052] To facilitate comparison with the standard value range, the obtained spectral curves of the left and right ear transfer functions need to be normalized at the low-frequency point to obtain the normalized spectral curves of the left and right ear transfer functions of the virtual sound source.

[0053] Figure 9 The figures shown are the normalized spectral curves of the right ear transfer function under two scenarios: H000E000 in Figure 6(a) and H000E090 in Figure 6(d). Figure 9 It can be seen that the normalized spectral curves of the transfer function of a virtual sound source differ significantly under different spatial orientations, even for the same channel. Therefore, the spatial perception of audio can be judged based on the spectral curves of the transfer functions of the left and right ears. Since the positions of the left and right ears are inherently different, it is also necessary to judge the normalized spectral curves of the transfer functions of the left and right ears separately.

[0054] Step S440: Determine whether the calculated spatial sound effect parameters are within their respective preset standard value ranges at the corresponding preset spatial locations. If all spatial sound effect parameters are within their respective preset standard value ranges, the spatial sound effect test of the virtual sound source at the preset spatial location is deemed qualified. If a certain spatial sound effect parameter is not within the preset standard value range, the spatial sound effect test of the virtual sound source at the preset spatial location is deemed unqualified.

[0055] The specific judgment process is as follows:

[0056] The first step is to determine the standard ranges of the binaural time difference, binaural sound level difference, and spectral amplitude of the left and right ear transfer functions at the corresponding preset spatial locations of the virtual sound source. These standard ranges were obtained beforehand using simulated humans and speakers in a test environment built in an anechoic chamber before conducting the spatial sound effect test.

[0057] The second step is to determine whether the calculated binaural time difference of the virtual sound source is within the preset standard value range of binaural time difference. If it is within the standard value range, the binaural time difference parameter is deemed to be qualified; otherwise, the binaural time difference parameter is deemed to be unqualified.

[0058] In the third step, it is judged frequency point by frequency point whether the calculated interaural level difference of the virtual sound source is within the preset standard value range of interaural level difference. Only when the interaural level difference of all frequency points are within the standard value range, the interaural level difference parameter is determined to be qualified; otherwise, the interaural level difference parameter is determined to be unqualified; and,

[0059] In the fourth step, for the normalized spectral curves of the calculated left ear / right ear transfer function of the virtual sound source, it is judged frequency point by frequency point respectively whether the spectral amplitude is within the standard value range of the spectral amplitude of the left ear / right ear transfer function. Only when the spectral amplitudes of the left ear and right ear transfer functions of all frequency points are within the standard value range, the spectral curve parameters of the left and right ear transfer functions are determined to be qualified; otherwise, the spectral curve parameters of the left and right ear transfer functions are determined to be unqualified.

[0060] It is easy to understand that the above-mentioned second step to fourth step can be judged in parallel or sequentially, and when judged sequentially, the order of the second step to fourth step can be adjusted arbitrarily.

[0061] Furthermore, when outputting the result of whether the audio spatial perception test of the head-mounted display device is qualified, the method of the present invention further comprises:

[0062] If the spatial sound effect test of the virtual sound source at a preset spatial orientation is unqualified, ending the audio spatial perception test of the head-mounted display device and outputting a result that the audio spatial perception test of the head-mounted display device is unqualified;

[0063] If the spatial sound effect test of the virtual sound source at a preset spatial orientation is qualified, controlling the virtual sound source to change to another preset spatial orientation through software instructions, and then starting a new round of testing process for the virtual sound source after the spatial orientation is changed;

[0064] If the spatial sound effect test of the virtual sound source at all preset spatial orientations is qualified, outputting a result that the audio spatial perception test of the head-mounted display device is qualified.

[0065] It can be known from the above steps that the qualification test condition for the audio spatial perception of the head-mounted display device of the present invention is not only objective but also quite rigorous. At all preset spatial orientations, the three spatial sound effect parameters, namely interaural time difference, interaural level difference, and the normalized spectral curve of left and right ear transfer functions, are all required to be within their respective preset standard value ranges to output the result that the audio spatial perception test of the head-mounted display device is qualified. If at a certain preset spatial orientation, any one of the three spatial sound effect parameters, namely interaural time difference, interaural level difference, and the normalized spectral curve of left and right ear transfer functions, is not within the preset standard value range, the result that the audio spatial perception test of the head-mounted display device is unqualified is output.

[0066] In summary, the audio spatial perception test method for head-mounted display devices provided by this invention achieves objective testing of the audio spatial perception of head-mounted display devices by determining whether the spatial sound effect test is qualified based on whether multiple spatial sound effect parameters are within their respective preset standard value ranges. This solves the bottleneck of the current situation where only subjective perception is possible without objective testing, and the obtained test results are more realistic and reliable.

[0067] Similar to the aforementioned method for testing the audio spatial sense of head-mounted display devices, this invention also provides a testing device for the audio spatial sense of head-mounted display devices. Figure 10 A schematic diagram of a test apparatus for audio spatial perception of a head-mounted display device according to an embodiment of the present invention is shown. See also Figure 10 As shown, the apparatus of the present invention includes:

[0068] The spatial orientation control unit 110 is used to properly place the head-mounted display device to be tested on the head of the simulated human and control the virtual sound source to be located in different preset spatial orientations through software instructions.

[0069] The receiving signal acquisition unit 120 is used to control the virtual sound source to send an excitation signal at the preset spatial orientation and for the SPK of the head-mounted display device to play the excitation signal, thereby acquiring the signals received simultaneously by the left and right ears of the simulated human.

[0070] The spatial sound effect parameter calculation unit 130 is used to calculate multiple spatial sound effect parameters of the virtual sound source based on the signals received simultaneously by the left and right ears of the simulated human. The spatial sound effect parameters include the binaural time difference, the binaural sound level difference, and the normalized spectrum curves of the left and right ear transfer functions.

[0071] The spatial sound effect parameter qualification and failure judgment unit 140 is used to determine whether the calculated multiple spatial sound effect parameters are within their respective preset standard value ranges at the corresponding preset spatial orientations. If all spatial sound effect parameters are within their respective preset standard value ranges, the spatial sound effect test of the virtual sound source at the preset spatial orientation is determined to be qualified; if a certain spatial sound effect parameter is not within the preset standard value range, the spatial sound effect test of the virtual sound source at the preset spatial orientation is determined to be unqualified.

[0072] Furthermore, when outputting the result of whether the audio spatial perception test of the head-mounted display device is qualified, the device of the present invention further includes:

[0073] The test result output unit 150 is used to terminate the audio spatial perception test of the head-mounted display device and output the result of the audio spatial perception test of the head-mounted display device failing if the spatial sound effect test of the virtual sound source at a certain preset spatial location fails; if the spatial sound effect test of the virtual sound source at a certain preset spatial location passes, the virtual sound source is controlled to change to another preset spatial location through software instructions, and a new round of testing is started for the virtual sound source after the spatial location is changed; if the spatial sound effect test of the virtual sound source at all preset spatial locations passes, the result of the audio spatial perception test of the head-mounted display device passes is output.

[0074] Understandably, see still Figure 10 Before the spatial orientation control unit 110, the device of the present invention further includes:

[0075] The standard value range determination unit 100 is used to, in an anechoic chamber, before controlling the virtual sound source to be located in different preset spatial positions sequentially via software instructions, place the speaker one by one at the test points corresponding to each preset spatial position using a human simulator and a speaker, control the speaker to emit excitation signals at each test point, and obtain the signals simultaneously received by the left and right ears of the human simulator; based on the signals simultaneously received by the left and right ears of the human simulator at each test point, pre-determine the standard value range of all the spatial sound effect parameters corresponding to each preset spatial position.

[0076] In some embodiments, the spatial sound effect parameter calculation unit 130 described above is specifically used for:

[0077] The signals received simultaneously by the left and right ears of the simulated human are convolved with the excitation signal to obtain the time τ when the excitation signal arrives at the left and right ears of the simulated human, respectively. The binaural time difference of the virtual sound source is obtained based on the time difference Δτ between the left and right ears.

[0078] The signals simultaneously received by the left and right ears of the simulated human are transformed to the frequency domain using FFT, yielding the frequency responses FR of the left and right ear signals. Based on the difference ΔFR between the frequency responses of the left and right ear signals, the binaural sound level difference of the virtual sound source is obtained; and...

[0079] The excitation signal and the signals simultaneously received by the left and right ears of the simulated human are transformed into the frequency domain by FFT. In the frequency domain, the received signals of the left and right ears are divided by the excitation signal to obtain the spectral curves of the transfer functions of the left and right ears. The spectral curves of the transfer functions of the left and right ears are normalized at the low frequency point to obtain the normalized spectral curves of the transfer functions of the virtual sound source.

[0080] In one embodiment, the aforementioned spatial sound effect parameter qualification / failure determination unit 140 is specifically used for:

[0081] Searching for the standard value range of interaural time difference, the standard value range of interaural level difference and the standard value range of spectral amplitude of the left and right ear transfer functions respectively at the corresponding preset spatial orientation of the virtual sound source;

[0082] Determining whether the calculated interaural time difference of the virtual sound source falls within the preset standard value range of interaural time difference; if it falls within the standard value range, determining that the interaural time difference parameter is qualified, otherwise determining that the interaural time difference parameter is unqualified;

[0083] Determining, frequency point by frequency point, whether the calculated interaural level difference of the virtual sound source falls within the preset standard value range of interaural level difference; only when the interaural level difference of all frequency points falls within the standard value range, determining that the interaural level difference parameter is qualified, otherwise determining that the interaural level difference parameter is unqualified; and,

[0084] For the normalized spectral curves of the calculated left ear / right ear transfer functions of the virtual sound source, determining, frequency point by frequency point respectively, whether the spectral amplitude falls within the standard value range of spectral amplitude of the left ear / right ear transfer function; only when the spectral amplitudes of the left ear and right ear transfer functions at all frequency points fall within the standard value range, determining that the spectral curve parameters of the left and right ear transfer functions are qualified, otherwise determining that the spectral curve parameters of the left and right ear transfer functions are unqualified.

[0085] For the implementation process of each unit in the testing apparatus for audio spatial perception of a head-mounted display device of the present invention, reference may be made to the foregoing method embodiments, and details are not described herein again.

[0086] Belonging to the same technical concept as the foregoing method and apparatus for testing audio spatial perception of a head-mounted display device, the present invention further provides a testing system for audio spatial perception of a head-mounted display device. Figure 11 There is shown a structural schematic diagram of a testing system for audio spatial perception of a head-mounted display device according to an embodiment of the present invention. See Figure 10 , the testing system of the present invention comprises a dummy human, a sound box, a console and a head-mounted display device to be tested, wherein the console performs spatial audio testing on the head-mounted display device to be tested by adopting the foregoing method for testing audio spatial perception of a head-mounted display device, and can further output a result whether the audio spatial perception test of the head-mounted display device is qualified.

[0087] At the hardware level, the console includes a processor, memory for storing computer program instructions, and a display panel. The console may also include a communication module. The entire test system is housed in an anechoic chamber. The various components within the test system are interconnected via an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus, etc. The bus can be categorized into address bus, data bus, and control bus, etc. For ease of representation, Figure 11 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0088] Those skilled in the art will understand that the various embodiments of the present invention can be provided as methods, systems, electronic devices, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or a combination of software and hardware embodiments. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer programs.

[0089] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0090] The above are merely embodiments of the present invention and are not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principle of the present invention should be included within the scope of the claims of the present invention.

Claims

1. A method for testing the audio spatial sense of a head-mounted display device, characterized in that, The method comprises: normally wearing the head-mounted display device to be tested on the head of a dummy, and controlling virtual sound sources to be sequentially located at different preset spatial orientations through software instructions; controlling the virtual sound source to send an excitation signal at the preset spatial orientation, playing the excitation signal through a SPK of the head-mounted display device, and acquiring signals simultaneously received by the left ear and the right ear of the dummy respectively; calculating a plurality of spatial audio parameters of the virtual sound source according to the signals simultaneously received by the left ear and the right ear of the dummy respectively, wherein the spatial audio parameters comprise interaural time difference, interaural level difference and frequency spectrum curves obtained after normalizing left and right ear transfer functions; judging whether the calculated plurality of spatial audio parameters are within respective preset standard value ranges corresponding to the preset spatial orientation, if all the spatial audio parameters are within the respective preset standard value ranges, determining that the spatial audio test of the virtual sound source at the preset spatial orientation is qualified; if any spatial audio parameter is not within the preset standard value range, determining that the spatial audio test of the virtual sound source at the preset spatial orientation is unqualified; the spatial orientation information of the virtual sound source comprises distance, horizontal angle and azimuth angle; the step of judging whether the calculated plurality of spatial audio parameters are within the respective preset standard value ranges corresponding to the preset spatial orientation comprises: searching for the standard value range of interaural time difference, the standard value range of interaural level difference and the respective standard value ranges of spectrum amplitude of left and right ear transfer functions corresponding to the virtual sound source at the preset spatial orientation; judging whether the calculated interaural time difference of the virtual sound source is within the preset standard value range of interaural time difference, if yes, determining that the interaural time difference parameter is qualified, otherwise determining that the interaural time difference parameter is unqualified; judging whether the calculated interaural level difference of the virtual sound source is within the preset standard value range of interaural level difference frequency point by frequency point, only when the interaural level differences of all frequency points are within the standard value range, determining that the interaural level difference parameter is qualified, otherwise determining that the interaural level difference parameter is unqualified; and for the calculated frequency spectrum curves obtained after normalizing the left ear / right ear transfer function of the virtual sound source, respectively judging whether the spectrum amplitude is within the standard value range of spectrum amplitude of the left ear / right ear transfer function frequency point by frequency point, only when the spectrum amplitudes of the left ear transfer function and the right ear transfer function of all frequency points are within the standard value range, determining that the frequency spectrum curve parameters of the left and right ear transfer functions are qualified, otherwise determining that the frequency spectrum curve parameters of the left and right ear transfer functions are unqualified.

2. The method according to claim 1, characterized in that, before controlling the virtual sound sources to be sequentially located at different preset spatial orientations through software instructions, the method further comprises: in an anechoic chamber, by using a dummy and a sound box, placing the sound box at test points corresponding to various preset spatial orientations one by one, controlling the sound box to send excitation signals at each test point, and acquiring signals simultaneously received by the left ear and the right ear of the dummy respectively; pre-determining the respective standard value ranges of all the spatial audio parameters corresponding to each preset spatial orientation according to the signals simultaneously received by the left ear and the right ear of the dummy at each test point respectively.

3. The method according to claim 2, characterized in that, The binaural time difference of the virtual sound source is calculated based on the signals simultaneously received by the left and right ears of the simulated human, including: The signals simultaneously received by the left and right ears of the simulated human are convolved with the excitation signal to obtain the time τ when the excitation signal arrives at the left and right ears of the simulated human, respectively. The binaural time difference of the virtual sound source is obtained based on the time difference ∆τ between the left and right ears.

4. The method according to claim 2, characterized in that, The binaural sound level difference of the virtual sound source is calculated based on the signals simultaneously received by the left and right ears of the simulated human, including: The signals simultaneously received by the left and right ears of the simulated human were transformed into the frequency domain by FFT transformation to obtain the frequency response FR of the signals received by the left and right ears. The binaural sound level difference of the virtual sound source is obtained based on the difference in frequency response ∆FR between the signals received by the left and right ears.

5. The method according to claim 2, characterized in that, The normalized spectral curves of the left and right ear transfer functions of the virtual sound source are calculated based on the signals simultaneously received by the left and right ears of the simulated human, including: The excitation signal and the signals simultaneously received by the left and right ears of the simulated human were converted to the frequency domain by FFT transformation. In the frequency domain, the received signals from the left and right ears are divided by the excitation signal respectively to obtain the spectral curves of the transfer functions of the left and right ears; The spectral curves of the left and right ear transfer functions are normalized at the low-frequency point to obtain the normalized spectral curves of the left and right ear transfer functions of the virtual sound source.

6. The method according to claim 1, characterized in that, The method further includes: If the virtual sound source fails the spatial sound effect test at a preset spatial location, the audio spatial perception test of the head-mounted display device ends, and the result of the audio spatial perception test of the head-mounted display device failing is output. If the virtual sound source passes the spatial sound effect test at a certain preset spatial location, the virtual sound source is controlled by software commands to change to another preset spatial location, and then a new round of testing is started for the virtual sound source after the spatial location is changed. If the virtual sound source passes the spatial sound effect test at all preset spatial locations, the result of the head-mounted display device's audio spatial perception test is output as qualified.

7. A testing device for the audio spatial sense of a head-mounted display device, characterized in that, The device includes: The spatial orientation control unit is used to properly place the head-mounted display device under test on the head of the simulated human and control the virtual sound source to be located in different preset spatial orientations through software commands; The signal acquisition unit is used to control the virtual sound source to send an excitation signal at the preset spatial location and for the SPK of the head-mounted display device to play the excitation signal, thereby acquiring the signals received simultaneously by the left and right ears of the simulated human. The spatial sound effect parameter calculation unit is used to calculate multiple spatial sound effect parameters of the virtual sound source based on the signals simultaneously received by the left and right ears of the simulated human. The spatial sound effect parameters include the binaural time difference, the binaural sound level difference, and the normalized spectral curves of the left and right ear transfer functions. a spatial sound effect parameter qualification judging unit, configured to judge whether the plurality of calculated spatial sound effect parameters are within respective preset standard value ranges at the corresponding preset spatial position, if all the spatial sound effect parameters are within the respective preset standard value ranges, judge that the spatial sound effect test of the virtual sound source at the preset spatial position is qualified; if any spatial sound effect parameter is not within the preset standard value range, judge that the spatial sound effect test of the virtual sound source at the preset spatial position is unqualified; the spatial position information of the virtual sound source comprises distance, horizontal angle and azimuth angle; the spatial sound effect parameter qualification judging unit is specifically configured to: search for the standard value range of interaural time difference, the standard value range of interaural level difference and the standard value range of spectrum amplitude of each of left and right ear transfer functions of the virtual sound source at the corresponding preset spatial position; judge whether the calculated interaural time difference of the virtual sound source is within the preset standard value range of the interaural time difference, if yes, judge that the interaural time difference parameter is qualified, otherwise judge that the interaural time difference parameter is unqualified; judge frequency point by frequency point whether the calculated interaural level difference of the virtual sound source is within the preset standard value range of the interaural level difference, only when the interaural level differences of all frequency points are within the standard value range, judge that the interaural level difference parameter is qualified, otherwise judge that the interaural level difference parameter is unqualified; and for the normalized spectrum curve of the calculated left ear / right ear transfer function of the virtual sound source, judge frequency point by frequency point respectively whether the spectrum amplitude is within the standard value range of the spectrum amplitude of the left ear / right ear transfer function, only when the spectrum amplitudes of the left ear and right ear transfer functions at all frequency points are within the standard value range, judge that the spectrum curve parameters of the left and right ear transfer functions are qualified, otherwise judge that the spectrum curve parameters of the left and right ear transfer functions are unqualified.

8. The apparatus according to claim 7, characterized in that, the device further comprises: a test result output unit, configured to end the audio spatial sense test of the head-mounted display device and output a result that the audio spatial sense test of the head-mounted display device is unqualified if the spatial sound effect test of the virtual sound source at a preset spatial position is unqualified; control the virtual sound source to switch to another preset spatial position through software instructions if the spatial sound effect test of the virtual sound source at the preset spatial position is qualified, and then start a new round of test process for the virtual sound source after the spatial position is switched; output a result that the audio spatial sense test of the head-mounted display device is qualified if the spatial sound effect tests of the virtual sound source at all preset spatial positions are all qualified.

9. A testing system for the audio spatial sense of a head-mounted display device, comprising a mannequin, speakers, a control console, and a head-mounted display device to be tested, characterized in that, the console performs a spatial sound effect test on the head-mounted display device to be tested by using the head-mounted display device audio spatial sense testing method according to any one of claims 1 to 6.

Images