Method, apparatus and system for testing sense of spatial audio of head-mounted display device

Abstract

Disclosed in the present invention are a method, apparatus and system for testing the sense of spatial audio of a head-mounted display device. The method comprises: controlling a virtual sound source to send an excitation signal at a preset spatial orientation, playing the excitation signal by means of an SPK of a head-mounted display device, and acquiring signals which are respectively and simultaneously received by the left ear and the right ear of an android; calculating a plurality of spatial sound effect parameters of the virtual sound source according to the signals which are respectively and simultaneously received by the left ear and the right ear of the android; determining whether the plurality of spatial sound effect parameters are within respective preset standard value ranges corresponding to the preset spatial orientation, and if all the spatial sound effect parameters are within the respective preset standard value ranges, determining that the spatial sound effect at the preset spatial orientation is tested to be qualified; and if a certain spatial sound effect parameter is not within the preset standard value range, determining that the spatial sound effect of the virtual sound source at the preset spatial orientation is tested to be unqualified. The present invention realizes an objective test for the sense of spatial audio of a head-mounted display device.

Description

A method, device and system for testing audio spatial perception of head-mounted display equipment

[0001] This application is filed with the Patent Office of China on June 29, 2023, with application number 202310788577.2 and the name of the invention being “A method, device and system for testing audio spatial perception of a head-mounted display device”, all contents of which are incorporated herein by reference. Technical Field

[0002] The present invention relates to the field of virtual spatial sound technology, and in particular to a method, device and system for testing the audio spatial sense of a head-mounted display device. Background Art

[0003] Since the concept of the metaverse gained popularity, VR (Virtual Reality), AR (Augmented Reality), and MR (Mixed Reality) products have emerged in droves, both domestically and internationally, from large and small companies, and from established enterprises to startups. This has set off a wave of industry activity. Fully immersing users in VR / AR / MR content requires both visual quality and sound quality. From refresh rates and head tracking latency to field of view and resolution, new technologies are continuously improving the sophistication and viewing comfort of VR / AR / MR images. However, simply feeling immersive visually is far from enough. Even if VR / AR / MR content is incredibly realistic, if the accompanying sound effects are subpar, the experience will inevitably feel out of place. Therefore, VR / AR / MR must also deliver immersive sound, providing a precise sense of direction and distance, similar to how people react to sounds in real life, to truly maintain a high level of user immersion.

[0004] However, the audio spatial perception test of head-mounted display devices for VR / AR / MR products is currently based more on subjective feelings, and there is no objective testing method.

[0005] Summary of the Invention

[0006] Embodiments of the present invention provide a method, device, and system for testing the audio spatial perception of a head-mounted display device, which are used to address the current bottleneck that the audio spatial perception of a head-mounted display device can only be perceived subjectively but cannot be objectively tested.

[0007] According to a first aspect of the present invention, a method for testing audio spatial perception of a head-mounted display device is provided, the method comprising:

[0008] The head-mounted display device to be tested is normally worn on the simulated person's head, and the virtual sound source is controlled by software instructions to be positioned in different preset spatial directions in sequence;

[0009] Controlling the virtual sound source to send an excitation signal at the preset spatial orientation and having the SPK of the head-mounted display device play the excitation signal to obtain signals received simultaneously by the left and right ears of the simulated person;

[0010] Calculating a plurality of spatial sound effect parameters of the virtual sound source based on the signals simultaneously received by the left and right ears of the simulated person, wherein the spatial sound effect parameters include interaural time difference, interaural level difference, and a spectrum curve after normalization of left and right ear transfer functions;

[0011] Determine whether the calculated multiple spatial sound effect parameters are within the respective preset standard value ranges corresponding to the preset spatial orientations. If all the spatial sound effect parameters are within the respective preset standard value ranges, it is determined that the spatial sound effect test of the virtual sound source at the preset spatial orientation is qualified; if a certain spatial sound effect parameter is not within the preset standard value range, it is determined that the spatial sound effect test of the virtual sound source at the preset spatial orientation is unqualified.

[0012] According to a second aspect of the present invention, a device for testing audio spatial perception of a head-mounted display device is provided, the device comprising:

[0013] A spatial orientation control unit is used to place the head-mounted display device to be tested on the simulated person's head normally, and to control the virtual sound source to be located in different preset spatial orientations in sequence through software instructions;

[0014] a received signal acquisition unit, configured to control the virtual sound source to send an excitation signal at the preset spatial orientation and have the SPK of the head mounted display device play the excitation signal, thereby acquiring signals simultaneously received by the left and right ears of the simulated person;

[0015] a spatial sound effect parameter calculation unit, configured to calculate a plurality of spatial sound effect parameters of the virtual sound source based on signals simultaneously received by the left and right ears of the simulated person, the spatial sound effect parameters including interaural time difference, interaural level difference, and a spectrum curve after normalization of left and right ear transfer functions;

[0016] The spatial sound effect parameter qualification judgment unit is used to judge whether the calculated multiple spatial sound effect parameters are within the respective preset standard value ranges corresponding to the preset spatial orientations. If all the spatial sound effect parameters are within the respective preset standard value ranges, it is determined that the spatial sound effect test of the virtual sound source at the preset spatial orientation is qualified; if a certain spatial sound effect parameter is not within the preset standard value range, it is determined that the spatial sound effect test of the virtual sound source at the preset spatial orientation is unqualified.

[0017] According to a third aspect of the present invention, a system for testing the audio spatial sense of a head-mounted display device is provided, comprising a simulator, a speaker, a console, and a head-mounted display device to be tested. The console uses the aforementioned head-mounted display device audio spatial sense testing method to perform a spatial sound effect test on the head-mounted display device to be tested.

[0018] The beneficial effects of the embodiments of the present invention are:

[0019] In various embodiments of the present invention, software instructions are used to control a virtual sound source to sequentially locate at different preset spatial locations. The virtual sound source is controlled to transmit excitation signals at these preset spatial locations, which are then played by the SPK of a head-mounted display device. The purpose is to obtain signals simultaneously received by the left and right ears of a simulated person, calculate multiple spatial sound effect parameters of the virtual sound source based on the signals received by the left and right ears of the simulated person, and then determine whether the calculated multiple spatial sound effect parameters of the virtual sound source are within the respective preset standard value ranges at the preset spatial locations. During the determination, if all spatial sound effect parameters are within the respective preset standard value ranges, the virtual sound source is deemed to have passed the spatial sound effect test at the preset spatial location. If any spatial sound effect parameter is not within the preset standard value range, the virtual sound source is deemed to have failed the spatial sound effect test at the preset spatial location. Because the pass / fail of the spatial sound effect test is determined based on whether multiple spatial sound effect parameters are within the respective preset standard value ranges, the solutions of various embodiments of the present invention achieve objective testing of the audio spatiality of a head-mounted display device, resolving the current bottleneck of subjective perception without objective testing. The resulting test results are more reliable and authentic. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments described in the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings. In the drawings:

[0021] FIG1 shows a schematic diagram of a spatial sphere, wherein the center of the sphere is the center of the head of a simulated person or user;

[0022] FIG2 is a schematic diagram showing virtual sound sources at different azimuth angles;

[0023] FIG3 is a schematic diagram showing a virtual sound source at different horizontal angles;

[0024] FIG4 is a schematic flow chart showing a method for testing audio spatial perception of a head-mounted display device according to an embodiment of the present invention;

[0025] FIG5 shows a schematic diagram of a logical relationship between a receiving signal and an excitation signal;

[0026] FIG6(a) to FIG6(d) are schematic diagrams showing comparisons of left and right ear transfer functions when the horizontal angle of the test point is 0 degrees and the azimuth angles are 0 degrees, 30 degrees, 60 degrees, and 90 degrees, respectively, according to an embodiment of the present invention;

[0027] FIG7( a ) shows the time difference Δτ between the left and right ears obtained in the H000E000 scenario corresponding to FIG6( a ), and FIG7( b ) shows the time difference Δτ between the left and right ears obtained in the H000E090 scenario corresponding to FIG6( d );

[0028] FIG8( a ) shows the frequency responses FR of the left and right ears obtained in the H000E000 scenario corresponding to FIG6( a ), and FIG8( b ) shows the frequency responses FR of the left and right ears obtained in the H000E090 scenario corresponding to FIG6( d );

[0029] FIG9 shows the normalized spectrum curves of the right ear transfer function under two scenarios, H000E000 corresponding to FIG6( a ) and H000E090 corresponding to FIG6( d );

[0030] FIG10 is a schematic diagram showing the structure of a testing device for audio spatial perception of a head-mounted display device according to an embodiment of the present invention;

[0031] FIG11 shows a schematic structural diagram of a system for testing audio spatial perception of a head-mounted display device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0032] Embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. These embodiments are provided to facilitate a more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art. Although exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention may be implemented in various forms and should not be limited by the embodiments set forth herein.

[0033] Generally speaking, there are three important factors that affect binaural auditory spatial localization: interaural time difference (ITD), interaural level difference (ILD) and spectral effect.

[0034] (1) Interaural Time Difference (ITD): There is a time difference between the transmission of sound waves from the sound source to the left and right ears, and this time difference is the interaural time difference (ITD), which is an important factor in locating the direction of the sound source. When the sound source is located in the median vertical plane of the head, the distance from it to both ears is equal. However, when the sound source deviates from the median vertical plane, the distance from it to both ears will be different, resulting in a time difference (ITD) between the sound waves transmitting to the two ears. This change is detected by the ears, so ITD is a very important factor in the ears achieving positioning.

[0035] (2) Interaural level difference (ILD): When a point sound source deviates from the median vertical plane of the head, the head will cast a shadow and scatter the sound waves (especially in the high-frequency part). The sound pressure at the ear on the opposite side of the sound source will be attenuated, while the sound pressure at the ear on the same side as the sound source will be increased to a certain extent, thus forming an interaural level difference. For sound waves with relatively high frequencies, the wavelength of the sound wave is smaller than the head size. When the sound source is not on the median vertical line connecting the two ears, the sound wave is blocked by the head and cannot be diffracted to the ear canal farther away, resulting in a difference in the sound level reaching the two ears. The more the sound source deviates from the median vertical line, or the higher the frequency, the greater the sound level difference between the two ears. The greater the sound level difference, the stronger the localization ability. At the same time, there are different sound level difference manifestations for different frequencies. The sound level difference between the two ears caused by low-frequency sound sources changes less with the azimuth of the sound source, that is, the two ears have poor localization ability for low-frequency sounds. As the frequency of the sound source increases, the sound level difference between the two ears increases with the change of azimuth, and the localization ability of the sound gradually increases.

[0036] (3) Spectral effect: The essence of the spectral effect is that the auricle effect changes the spectral characteristics of sounds in different spatial directions. The change in spectral characteristics is mainly aimed at high-frequency signals. Due to the short wavelength of high-frequency signals, the various reflected waves reflected from the auricle to the ear canal will add in phase, subtract in opposite phase, or even cancel each other out, forming peaks and valleys in the spectrum. This is the effect of the auricle on high-frequency sound waves. Based on the spectral effect, the spectrum curve of the left and right ear transfer function can be used to perform spatial positioning.

[0037] Figure 1 shows a schematic diagram of a spatial sphere, where the center of the sphere is the center of the emulated person's or user's head. Figure 2 shows a schematic diagram of a virtual sound source at different azimuth angles; Figure 3 shows a schematic diagram of a virtual sound source at different horizontal angles. For a head-mounted display, the distance of the virtual sound source from the center of the emulated person's or user's head remains constant, representing the radius of the sphere; only the horizontal and azimuth angles change.

[0038] Before starting the objective test of the audio spatial perception of the head-mounted display device of the present invention, it is necessary to set up a test environment in an anechoic room in advance. The test equipment includes a simulator and a speaker.

[0039] The testing process involves placing speakers at test points corresponding to each preset spatial location, controlling the speakers to emit excitation signals at each test point, and obtaining signals simultaneously received by the simulator's left and right ears. Based on the signals simultaneously received by the simulator's left and right ears at each test point, the standard value ranges for multiple spatial sound parameters corresponding to each preset spatial location are pre-calculated. The test points are selected based on the test requirements.

[0040] FIG4 is a flow chart showing a method for testing audio spatial perception of a head-mounted display device according to an embodiment of the present invention. Referring to FIG4 , the method of the present invention includes the following steps S410 to S450:

[0041] Step S410: The head-mounted display device to be tested is normally worn on the head of the simulated person, and the virtual sound source is controlled by software instructions to be located in different preset spatial directions in sequence.

[0042] The spatial orientation information of the virtual sound source includes distance, horizontal angle, and azimuth angle.

[0043] The test distance is generally selected based on actual test requirements. Considering that the spatial audio of head-mounted display devices is often a near-field sound field, the near-field distance (the radius of the near-field sphere surrounding the listener's head) is usually defined as approximately 0.5-1.0m.

[0044] Step S420 , controlling the virtual sound source to send an excitation signal at the preset spatial orientation and having the SPK of the head mounted display device play the excitation signal to obtain signals simultaneously received by the left and right ears of the simulated person.

[0045] Microphones may be provided at the left and right ears of the simulated person, respectively, and signals simultaneously received by the left and right ears of the simulated person may be obtained based on the signals collected by the microphones.

[0046] Figure 5 shows a schematic diagram of a logical relationship between a receiving signal and an excitation signal. As shown in Figure 5, the acoustic transmission path between the excitation signal and the receiving signal is represented by a transfer function.

[0047] Figures 6(a) to 6(d) show schematic diagrams comparing the left and right ear transfer functions when the test points are at a horizontal angle of 0 degrees and azimuth angles of 0 degrees, 30 degrees, 60 degrees, and 90 degrees, respectively, according to one embodiment of the present invention. The upper track represents the left channel (corresponding to the left ear), and the lower track represents the right channel (corresponding to the right ear). H000E000 indicates a horizontal angle of 0 degrees and an azimuth of 0 degrees, H000E030 indicates a horizontal angle of 0 degrees and an azimuth of 30 degrees, H000E060 indicates a horizontal angle of 0 degrees and an azimuth of 60 degrees, and H000E090 indicates a horizontal angle of 0 degrees and an azimuth of 90 degrees. Comparing the upper and lower tracks in Figures 6(a) to 6(d) shows that when the sound source plays the excitation signal at different test points, the transfer functions of the left and right ears differ due to the differences in the signals received by the left and right ears.

[0048] Step S430 , calculating multiple spatial sound effect parameters of the virtual sound source based on the signals simultaneously received by the left and right ears of the simulated person, wherein the spatial sound effect parameters include interaural time difference, interaural level difference, and a normalized spectrum curve of the left and right ear transfer function.

[0049] In one embodiment, the interaural time difference of a virtual sound source is calculated based on signals simultaneously received by the left and right ears of a simulated person, including: convolving the signals simultaneously received by the left and right ears of the simulated person with an excitation signal to obtain the time τ when the excitation signal reaches the left and right ears of the simulated person respectively; and obtaining the interaural time difference of the virtual sound source based on the time difference Δτ between the left and right ears.

[0050] Figure 7(a) shows the left-right ear time difference Δτ obtained for the H000E000 scenario (corresponding to Figure 6(a), and Figure 7(b) shows the left-right ear time difference Δτ obtained for the H000E090 scenario (corresponding to Figure 6(d)). Comparing Figures 7(a) and 7(b) reveals that in the H000E000 scenario, the left-right ear time difference Δτ is approximately 0, while in the H000E090 scenario, the left-right ear time difference Δτ is approximately 0.68 ms. This indicates that interaural time difference varies under different spatial orientation scenarios.

[0051] In one embodiment, the binaural level difference of a virtual sound source is calculated based on signals simultaneously received by the left and right ears of a simulated person, including: performing a Fast Fourier Transform (FFT) on the signals simultaneously received by the left and right ears of the simulated person to convert them into the frequency domain to obtain frequency responses FR of the left and right ears; and obtaining the binaural level difference of the virtual sound source based on the difference ΔFR between the frequency responses of the left and right ears.

[0052] Figure 8(a) shows the left and right ear frequency responses (FR) for the H000E000 scenario (corresponding to Figure 6(a), while Figure 8(b) shows the left and right ear frequency responses (FR) for the H000E090 scenario (corresponding to Figure 6(d)). Comparing Figures 8(a) and 8(b) reveals that in the H000E000 scenario, the left and right ear FR curves largely overlap, while in the H000E090 scenario, there are significant differences. This demonstrates that binaural level differences vary under different spatial orientations.

[0053] In one embodiment, the normalized spectrum curves of the left and right ear transfer functions of the virtual sound source are calculated based on the signals simultaneously received by the left and right ears of the simulated person, including: performing FFT transformation on the excitation signal and the signals simultaneously received by the left and right ears of the simulated person, respectively, to convert them into the frequency domain; dividing the received signals of the left and right ears by the excitation signal in the frequency domain to obtain the spectrum curves of the left and right ear transfer functions; and normalizing the spectrum curves of the left and right ear transfer functions at low frequency points to obtain the normalized spectrum curves of the left and right ear transfer functions of the virtual sound source.

[0054] To facilitate comparison with the standard value range, the obtained spectrum curves of the left and right ear transfer functions need to be normalized at low frequency points to obtain the normalized spectrum curves of the left and right ear transfer functions of the virtual sound source.

[0055] Figure 9 shows the normalized spectra of the right ear transfer function for the two scenarios, H000E000 in Figure 6(a) and H000E090 in Figure 6(d). Figure 9 shows that even for the same channel, the normalized spectra of the transfer function can differ significantly when the virtual sound source is positioned differently. Therefore, the audio spatial perception can be determined based on the spectra of the left and right ear transfer functions. Due to the inherent differences in left and right ear position, it is necessary to assess the normalized spectra of the left and right ear transfer functions separately.

[0056] Step S440, determine whether the calculated multiple spatial sound effect parameters are within the respective preset standard value ranges corresponding to the preset spatial orientations. If all the spatial sound effect parameters are within the respective preset standard value ranges, it is determined that the spatial sound effect test of the virtual sound source at the preset spatial orientation is qualified; if a certain spatial sound effect parameter is not within the preset standard value range, it is determined that the spatial sound effect test of the virtual sound source at the preset spatial orientation is unqualified.

[0057] The specific judgment process is as follows:

[0058] The first step is to find the standard ranges for interaural time difference, interaural level difference, and spectral amplitudes of the left and right ear transfer functions for the virtual sound source at the preset spatial location. These standard ranges were obtained using a human simulator and speakers in a test environment set up in an anechoic chamber prior to the spatial acoustics test.

[0059] The second step is to determine whether the calculated interaural time difference of the virtual sound source is within a preset interaural time difference standard value range. If it is within the standard value range, the interaural time difference parameter is determined to be qualified; otherwise, the interaural time difference parameter is determined to be unqualified.

[0060] The third step is to determine, frequency by frequency, whether the calculated binaural level difference of the virtual sound source is within a preset standard value range of the binaural level difference. Only when the binaural level differences of all frequency points are within the standard value range, the binaural level difference parameter is determined to be qualified; otherwise, the binaural level difference parameter is determined to be unqualified; and

[0061] The fourth step is to determine whether the spectrum amplitude of the normalized spectrum curve of the left ear / right ear transfer function of the calculated virtual sound source is within the standard value range of the spectrum amplitude of the left ear / right ear transfer function for each frequency point. Only when the spectrum amplitudes of the left ear and right ear transfer functions of all frequency points are within the standard value range, the spectrum curve parameters of the left and right ear transfer functions are determined to be qualified; otherwise, the spectrum curve parameters of the left and right ear transfer functions are determined to be unqualified.

[0062] It is easy to understand that the above-mentioned second to fourth steps can be judged in parallel or in sequence, and when judging in sequence, the order of the second to fourth steps can be adjusted arbitrarily.

[0063] Furthermore, when outputting the result of whether the audio spatial perception test of the head mounted display device is qualified, the method of the present invention further includes:

[0064] If the spatial sound effect test of the virtual sound source at a certain preset spatial orientation fails, terminating the audio spatial perception test of the head-mounted display device and outputting a result indicating that the audio spatial perception test of the head-mounted display device fails;

[0065] If the spatial sound effect test of the virtual sound source at a certain preset spatial orientation is qualified, the virtual sound source is controlled to change to another preset spatial orientation through software instructions, and then a new round of testing process is started for the virtual sound source at the changed spatial orientation;

[0066] If the spatial sound effect test of the virtual sound source at all preset spatial positions is qualified, the result of the head mounted display device audio spatial sense test being qualified is output.

[0067] According to the above steps, the qualified test conditions for the audio spatial perception of the head-mounted display device of the present invention are not only objective but also quite rigorous. At all preset spatial orientations, the three spatial sound effect parameters of interaural time difference, interaural sound level difference, and the spectrum curve after the normalization of the left and right ear transfer function must all be within their respective preset standard value ranges before a result of the head-mounted display device passing the audio spatial perception test will be output. If any of the three spatial sound effect parameters of interaural time difference, interaural sound level difference, and the spectrum curve after the normalization of the left and right ear transfer function is outside the preset standard value range at any preset spatial orientation, a result of failing the audio spatial perception test of the head-mounted display device will be output.

[0068] In summary, the method for testing the audio spatial sense of a head-mounted display device provided by the present invention realizes an objective test of the audio spatial sense of a head-mounted display device, because the qualification of the spatial sound effect test is based on whether multiple spatial sound effect parameters are within the corresponding preset standard value ranges. This solves the bottleneck of the current situation where only subjective perception is available but no objective test is available, and the obtained test results are more real and reliable.

[0069] The present invention also provides a device for testing the audio spatiality of a head-mounted display device, sharing the same technical concept as the aforementioned method for testing the audio spatiality of a head-mounted display device. FIG10 shows a schematic structural diagram of a device for testing the audio spatiality of a head-mounted display device according to one embodiment of the present invention. Referring to FIG10 , the device of the present invention comprises:

[0070] The spatial orientation control unit 110 is used to normally wear the head-mounted display device to be tested on the head of the simulated person, and control the virtual sound source to be located in different preset spatial orientations in sequence through software instructions;

[0071] A received signal acquisition unit 120 is configured to control the virtual sound source to send an excitation signal at the preset spatial orientation and have the SPK of the head mounted display device play the excitation signal to obtain signals simultaneously received by the left and right ears of the simulated person;

[0072] A spatial sound effect parameter calculation unit 130 is configured to calculate a plurality of spatial sound effect parameters of the virtual sound source based on the signals simultaneously received by the left and right ears of the simulated person, wherein the spatial sound effect parameters include interaural time difference, interaural level difference, and a spectrum curve after normalization of the left and right ear transfer functions;

[0073] The spatial sound effect parameter qualification judgment unit 140 is used to judge whether the calculated multiple spatial sound effect parameters are within the respective preset standard value ranges corresponding to the preset spatial orientations. If all the spatial sound effect parameters are within the respective preset standard value ranges, it is determined that the spatial sound effect test of the virtual sound source at the preset spatial orientation is qualified; if a certain spatial sound effect parameter is not within the preset standard value range, it is determined that the spatial sound effect test of the virtual sound source at the preset spatial orientation is unqualified.

[0074] Furthermore, when outputting the result of whether the audio spatial perception test of the head mounted display device is qualified, the apparatus of the present invention further includes:

[0075] The test result output unit 150 is used to terminate the audio spatial perception test of the head-mounted display device and output the result of the head-mounted display device failing the audio spatial perception test if the virtual sound source fails the spatial sound effect test at a certain preset spatial orientation; if the virtual sound source passes the spatial sound effect test at a certain preset spatial orientation, control the virtual sound source to change to another preset spatial orientation through software instructions, and then start a new round of testing process for the virtual sound source after the spatial orientation is changed; if the virtual sound source passes the spatial sound effect test at all preset spatial orientations, output the result of the head-mounted display device passing the audio spatial perception test.

[0076] It is understood that, still referring to FIG10 , before the spatial orientation control unit 110 , the apparatus of the present invention further includes:

[0077] The standard value range determination unit 100 is used to use a simulated person and a speaker to place the speaker at a test point corresponding to each preset spatial orientation one by one in an anechoic room before controlling the virtual sound source to be located in different preset spatial orientations in sequence through software instructions, control the speaker to emit an excitation signal at each test point, and obtain the signal received simultaneously by the left and right ears of the simulated person; based on the signal received simultaneously by the left and right ears of the simulated person at each test point, pre-determine the standard value range of all the spatial sound effect parameters corresponding to each preset spatial orientation.

[0078] In some embodiments, the spatial sound effect parameter calculation unit 130 is specifically configured to:

[0079] Convolving the signals simultaneously received by the left and right ears of the simulated person with the excitation signal respectively to obtain the time τ when the excitation signal reaches the left and right ears of the simulated person respectively, and obtaining the interaural time difference of the virtual sound source based on the time difference Δτ between the left and right ears;

[0080] Performing FFT transformation on the signals simultaneously received by the left and right ears of the simulated person to convert them into the frequency domain, obtaining frequency responses FR of the signals received by the left and right ears, and obtaining the binaural sound level difference of the virtual sound source based on the difference ΔFR between the frequency responses of the signals received by the left and right ears; and

[0081] The excitation signal and the signals simultaneously received by the left and right ears of the simulated person are respectively converted into the frequency domain by FFT transformation. The received signals of the left and right ears are respectively divided by the excitation signal in the frequency domain to obtain the spectrum curves of the left and right ear transfer functions. The spectrum curves of the left and right ear transfer functions are respectively normalized at the low frequency point to obtain the normalized spectrum curves of the left and right ear transfer functions of the virtual sound source.

[0082] In one embodiment, the spatial sound effect parameter qualification determination unit 140 is specifically configured to:

[0083] Finding the standard value range of the interaural time difference, the standard value range of the interaural level difference, and the standard value range of the spectrum amplitude of the left and right ear transfer functions of the virtual sound source at the preset spatial orientation;

[0084] Determining whether the calculated interaural time difference of the virtual sound source is within a preset interaural time difference standard value range, and if so, determining that the interaural time difference parameter is qualified; otherwise, determining that the interaural time difference parameter is unqualified;

[0085] determining, frequency by frequency, whether the calculated binaural level difference of the virtual sound source is within a preset standard value range of the binaural level difference; and determining that the binaural level difference parameter is qualified only if the binaural level differences of all frequency points are within the standard value range; otherwise, determining that the binaural level difference parameter is unqualified; and

[0086] For the normalized spectrum curve of the calculated left ear / right ear transfer function of the virtual sound source, determine whether the spectrum amplitude is within the standard value range of the spectrum amplitude of the left ear / right ear transfer function for each frequency point. Only when the spectrum amplitudes of the left ear and right ear transfer functions of all frequency points are within the standard value range, are the spectrum curve parameters of the left and right ear transfer functions determined to be qualified; otherwise, the spectrum curve parameters of the left and right ear transfer functions are determined to be unqualified.

[0087] The implementation process of each unit in the device for testing audio spatial perception of a head-mounted display device of the present invention can be found in the aforementioned method embodiment and will not be described in detail here.

[0088] The present invention also provides a system for testing the audio spatial sense of a head-mounted display device, sharing the same technical concept as the aforementioned method and apparatus for testing the audio spatial sense of a head-mounted display device. FIG11 shows a schematic structural diagram of a system for testing the audio spatial sense of a head-mounted display device according to an embodiment of the present invention. Referring to FIG10 , the test system of the present invention includes a simulator, a speaker, a console, and a head-mounted display device to be tested. The console uses the aforementioned method for testing the audio spatial sense of a head-mounted display device to perform a spatial sound effect test on the head-mounted display device to be tested, and can further output a result indicating whether the head-mounted display device's audio spatial sense test has passed.

[0089] At the hardware level, the console includes a processor, a memory for storing computer program instructions, and a display panel. It may also include a communication module, etc. The entire test system is set up in an anechoic chamber. The various components within the test system are interconnected via an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus. Buses can be divided into address buses, data buses, control buses, etc. For ease of illustration, Figure 11 only uses a single bidirectional arrow, but this does not mean that there is only one bus or one type of bus.

[0090] Those skilled in the art will appreciate that various embodiments of the present invention may be provided as methods, systems, electronic devices, or computer program products. Thus, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing a computer program.

[0091] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0092] The above are merely embodiments of the present invention and are not intended to limit the present invention. It will be apparent to those skilled in the art that various modifications and variations of the present invention are possible. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention are intended to be included within the scope of the claims of the present invention.

Claims

1. A method for testing audio spatial perception of a head mounted display device, characterized in that: The method comprises: The head mounted display device to be tested is normally worn on the head of the simulated person, and the virtual sound source is controlled by software instructions to be located in different preset spatial positions in sequence; Controlling the virtual sound source to send an excitation signal at the preset spatial orientation and having the SPK of the head mounted display device play the excitation signal to obtain signals simultaneously received by the left and right ears of the simulated person; Calculate multiple spatial sound effect parameters of the virtual sound source according to the signals simultaneously received by the left and right ears of the simulated person, wherein the spatial sound effect parameters include binaural time difference, binaural level difference and a spectrum curve after normalization of left and right ear transfer function; Determine whether the calculated multiple spatial sound effect parameters are within the respective preset standard value ranges corresponding to the preset spatial positions; if all the spatial sound effect parameters are within the respective preset standard value ranges, then it is determined that the spatial sound effect test of the virtual sound source at the preset spatial position has passed; if a certain spatial sound effect parameter is not within the preset standard value range, then it is determined that the spatial sound effect test of the virtual sound source at the preset spatial position has failed.

2. The method according to claim 1, characterized in that: Before controlling the virtual sound sources to be located in different preset spatial positions in sequence through software instructions, the method further includes: In the anechoic chamber, a simulator and a speaker are placed one by one at the test points corresponding to each preset spatial orientation, and the speaker is controlled to send an excitation signal at each test point to obtain signals received simultaneously by the left and right ears of the simulator; According to the signals simultaneously received by the left and right ears of the simulated person at each test point, the standard value ranges of all the spatial sound effect parameters corresponding to each preset spatial orientation are predetermined.

3. The method according to claim 2, characterized in that: Calculating the interaural time difference of the virtual sound source according to the signals simultaneously received by the left and right ears of the simulated person, including: Convolving the signals simultaneously received by the left and right ears of the simulated person with the excitation signal respectively, to obtain the time τ when the excitation signal reaches the left and right ears of the simulated person respectively; According to the time difference Δτ between the left and right ears, the binaural time difference of the virtual sound source is obtained.

4. The method according to claim 2, characterized in that: Calculating the binaural sound level difference of the virtual sound source according to the signals simultaneously received by the left and right ears of the simulated person, including: The signals received simultaneously by the left and right ears of the simulated person are converted into the frequency domain by FFT transformation respectively. The frequency response FR of the received signal; According to the difference ΔFR between the frequency responses of the left and right ear received signals, the binaural sound level difference of the virtual sound source is obtained.

5. The method according to claim 2, characterized in that: Calculating the normalized spectrum curve of the left and right ear transfer function of the virtual sound source according to the signals simultaneously received by the left and right ears of the simulated person, including: The excitation signal and the signals simultaneously received by the left and right ears of the simulated person are respectively converted into the frequency domain by FFT transformation; In the frequency domain, the received signals of the left and right ears are divided by the excitation signal respectively to obtain the spectrum curves of the left and right ear transfer functions; The frequency spectrum curves of the left and right ear transfer functions are normalized at low frequency points respectively to obtain the normalized frequency spectrum curves of the left and right ear transfer functions of the virtual sound source.

6. The method according to claim 1, characterized in that: The determining whether the calculated multiple spatial sound effect parameters are within respective preset standard value ranges corresponding to the preset spatial orientations includes: Finding the standard value range of the interaural time difference, the standard value range of the interaural sound level difference, and the standard value range of the spectrum amplitude of the left and right ear transfer functions of the virtual sound source at the corresponding preset spatial orientation; Determine whether the calculated interaural time difference of the virtual sound source is within a preset standard value range of the interaural time difference, if so, determine that the interaural time difference parameter is qualified, otherwise, determine that the interaural time difference parameter is unqualified; Determining whether the calculated binaural sound level difference of the virtual sound source is within a preset standard value range of the binaural sound level difference for each frequency point, and only when the binaural sound level differences of all frequency points are within the standard value range, the binaural sound level difference parameters are determined to be qualified, otherwise the binaural sound level difference parameters are determined to be unqualified; and, For the normalized spectrum curve of the calculated left ear / right ear transfer function of the virtual sound source, determine whether the spectrum amplitude is within the standard value range of the spectrum amplitude of the left ear / right ear transfer function for each frequency point. Only when the spectrum amplitudes of the left ear and right ear transfer functions of all frequency points are within the standard value range, the spectrum curve parameters of the left and right ear transfer functions are determined to be qualified. Otherwise, the spectrum curve parameters of the left and right ear transfer functions are determined to be unqualified.

7. The method according to claim 1 or 6, characterized in that: The method further comprises: If the spatial sound effect test of the virtual sound source at a certain preset spatial position fails, ending the audio spatial sense test of the head mounted display device, and outputting a result that the audio spatial sense test of the head mounted display device fails; If the spatial sound effect test of the virtual sound source at a preset spatial position is qualified, the virtual sound source is controlled to change to another preset spatial position through software instructions, and then a new spatial sound effect test is started for the virtual sound source after the spatial position is changed. Round testing process; If the spatial sound effect test of the virtual sound source at all preset spatial positions is qualified, the result that the audio spatial sense test of the head mounted display device is qualified is output.

8. A device for testing the audio spatial sense of a head mounted display device, characterized in that: The device comprises: A spatial orientation control unit, used to normally wear the head-mounted display device to be tested on the head of the simulated person, and control the virtual sound source to be located in different preset spatial orientations in sequence through software instructions; A received signal acquisition unit, used to control the virtual sound source to send an excitation signal at the preset spatial orientation and to play the excitation signal through the SPK of the head mounted display device, so as to obtain signals simultaneously received by the left and right ears of the simulated person; A spatial sound effect parameter calculation unit, used to calculate a plurality of spatial sound effect parameters of the virtual sound source according to the signals simultaneously received by the left and right ears of the simulated person, wherein the spatial sound effect parameters include binaural time difference, binaural level difference and a spectrum curve after normalization of left and right ear transfer functions; The spatial sound effect parameter qualification judgment unit is used to judge whether the calculated multiple spatial sound effect parameters are within the respective preset standard value ranges corresponding to the preset spatial orientation. If all the spatial sound effect parameters are within the respective preset standard value ranges, it is judged that the spatial sound effect test of the virtual sound source at the preset spatial orientation is qualified; if a spatial sound effect parameter is not within the preset standard value range, it is judged that the spatial sound effect test of the virtual sound source at the preset spatial orientation is unqualified.

9. The device according to claim 8, characterized in that: The spatial sound effect parameter qualification judgment unit is specifically used for: Finding the standard value range of the interaural time difference, the standard value range of the interaural sound level difference, and the standard value range of the spectrum amplitude of the left and right ear transfer functions of the virtual sound source at the corresponding preset spatial orientation; Determine whether the calculated interaural time difference of the virtual sound source is within a preset standard value range of the interaural time difference, if so, determine that the interaural time difference parameter is qualified, otherwise, determine that the interaural time difference parameter is unqualified; Determining whether the calculated binaural sound level difference of the virtual sound source is within a preset standard value range of the binaural sound level difference for each frequency point, and only when the binaural sound level differences of all frequency points are within the standard value range, the binaural sound level difference parameters are determined to be qualified, otherwise the binaural sound level difference parameters are determined to be unqualified; and, For the normalized spectrum curve of the left ear / right ear transfer function of the virtual sound source calculated, the spectrum amplitude is judged at each frequency point whether it is within the standard value range of the spectrum amplitude of the left ear / right ear transfer function. Only when the spectrum amplitudes of the left ear and right ear transfer functions of all frequency points are within the standard value range, the spectrum curve parameters of the left and right ear transfer functions are determined to be suitable. Otherwise, the spectrum curve parameters of the left and right ear transfer functions are judged to be unqualified.

10. The device according to claim 8 or 9, characterized in that: The device also includes: The test result output unit is used to terminate the audio spatial sense test of the head-mounted display device and output the result of the head-mounted display device audio spatial sense test failing if the spatial sound effect test of the virtual sound source at a certain preset spatial orientation fails; if the spatial sound effect test of the virtual sound source at a certain preset spatial orientation passes, control the virtual sound source to change to another preset spatial orientation through software instructions, and then start a new round of testing process for the virtual sound source after the spatial orientation is changed; if the spatial sound effect test of the virtual sound source at all preset spatial orientations passes, output the result of the head-mounted display device audio spatial sense test passing.

11. A test system for audio spatial perception of a head-mounted display device, comprising a simulator, a sound box, a console, and a head-mounted display device to be tested, characterized in that: The console uses the head-mounted display device audio spatial sense testing method described in any one of claims 1 to 7 to perform a spatial sound effect test on the head-mounted display device to be tested.

Images