Evaluation method and device for space sense of sound equipment and electronic equipment

By acquiring and analyzing the angle matrix of the spatial audio signal of the vehicle-mounted spatial audio system and calculating objective indicators of positioning and immersion, the problem of difficulty in evaluating the vehicle-mounted spatial audio system in the prior art is solved, and efficient and objective audio evaluation is achieved.

CN119729296AActive Publication Date: 2025-03-28NIO TECH ANHUI CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411842345.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-13
Publication Date
2025-03-28
Estimated Expiration
2044-12-13

AI Technical Summary

Technical Problem

The existing audio evaluation criteria are difficult to effectively evaluate the spatial audio effect of vehicle-mounted spatial audio systems, especially in the absence of reference to original audio, and the existing methods require manual subjective evaluation, which is inefficient.

Method used

By obtaining the spatial audio signal output by the audio, determining its angle matrix, and calculating objective indicators of positioning and immersion based on the angle matrix, including static and dynamic positioning and surrounding sense.

Benefits of technology

It realizes objective, fast and efficient evaluation of the spatial audio effects of the vehicle-mounted space audio system, which can reflect the user's subjective listening experience and assist in the optimization and update of the audio system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119729296A_ABST
    Figure CN119729296A_ABST
Patent Text Reader

Abstract

The invention is suitable for the technical field of audio evaluation, and provides a sound equipment space sense evaluation method and device and electronic equipment. The sound equipment space sense evaluation method provided by the invention comprises the following steps: acquiring a space audio signal output by a sound equipment; determining an angle matrix of the spatial audio signal according to the spatial audio signal; and according to the angle matrix of the spatial audio signal, determining a space sense objective index, the space sense objective index including at least any one of the following items: a localization sense objective index and an immersion sense objective index. According to the method, a set of reasonable objective evaluation indexes is constructed, the objective evaluation indexes can be close to the subjective feeling of the user as much as possible, the advantages that the objective evaluation method is convenient to operate and high in repeatability and the advantage that the subjective evaluation method is highly related to the hearing feeling are combined, and greater benefits can be brought to evaluation of sound equipment (such as a vehicle-mounted immersion sound system).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the technical field of audio evaluation, and in particular, relates to a method, device and electronic equipment for evaluating sound spatial perception. Background Art

[0002] With the continuous development of electric vehicles, their endurance and reliability have been continuously improved. The potential of electric vehicles as a means of transportation for long-distance travel is emerging. As a window for the interaction between the car and the user, the comfort of the car cockpit directly affects the user experience. A comfortable car cockpit can greatly improve the experience of long-distance car travel, which has promoted the advancement of in-car multimedia systems, and the in-car spatial audio system has become the focus of consumer attention. Compared with common listening spaces, the car cockpit has the disadvantages of small size, many obstacles, and asymmetric seats. Compared with traditional multi-channel audio systems, the in-car speaker system has a fixed position, unsatisfactory cabinet conditions, and limited power. Therefore, the design of the in-car audio system is a very challenging technical problem. Evaluating the audio output by the in-car audio system is also another challenging technical problem.

[0003] At present, the more mature audio evaluation standards in the world mainly focus on speech quality evaluation, especially the sound quality evaluation of coding, decoding and transmission impairment, such as subjective MOS (Mean Opinion Score), objective PESQ (Perceptual Evaluation of Speech Quality), POLQA (Perceptual Objective Listening Quality Assessment), etc., and the typical application scenario is the evaluation of smartphone calls. Audio quality evaluation is still mainly subjective, such as ITU-R BS.1116 (a standard number, ITU-R refers to the radio communication department of the International Telecommunication Union) and subjective MUSHRA (Multi-Stimulus Test with Hidden Reference and Anchor) scoring, and the typical application scenario is the evaluation of indoor multi-channel surround sound or headphone audio quality. The only international objective audio evaluation standard PEAQ (Perceptual Evaluation of Audio Quality) is only applicable to monophonic music signals, and the current effect is not good. The above standard methods all require reference original audio to be compared with the audio to be tested, but for immersive audio systems, it is difficult to find reference original audio. Although ITU-R recently proposed BS.2132 (another standard number) for subjective evaluation criteria for comparing multiple renderers, there are still many constraints in actual implementation. For example, it is necessary to listen to and compare multiple different comparison items repeatedly, which is not suitable for a single test object.

[0004] The current subjective evaluation method is time-consuming and laborious. Subjective evaluation must be done manually in the car. Relying solely on listening and scoring will reduce the efficiency of technology development or product comparison. The current objective evaluation method cannot reflect the perceptual characteristics of the in-vehicle spatial audio system. Overall, the existing evaluation standards or methods are not suitable for efficient measurement of the in-vehicle spatial audio playback effect, and it is urgent to establish an evaluation system for in-vehicle spatial audio. Summary of the invention

[0005] The embodiments of the present application provide a method, device and electronic device for evaluating the sense of acoustic space, which can solve the technical problem that there is a lack of an effective method for evaluating spatial audio effects in the prior art.

[0006] In a first aspect, an embodiment of the present application provides a method for evaluating a sense of acoustic space, comprising:

[0007] Obtaining a spatial audio signal output by a speaker;

[0008] Determine an angle matrix of the spatial audio signal according to the spatial audio signal;

[0009] An objective index of spatial sense is determined according to the angle matrix of the spatial audio signal, where the objective index of spatial sense includes at least one of the following: an objective index of positioning sense and an objective index of immersion sense.

[0010] In a possible implementation manner of the first aspect, the spatial audio signal includes a spatial audio signal in a first-order Ambisonics A format, and determining an angle matrix of the spatial audio signal according to the spatial audio signal includes:

[0011] Performing format conversion on the spatial audio signal in the first-order Ambisonics A format to obtain a spatial audio signal in the FOA-B format;

[0012] An angle matrix of the spatial audio signal is determined according to the spatial audio signal in the FOA-B format.

[0013] In a possible implementation manner of the first aspect, the spatial audio signal includes a single sound source static spatial audio signal, the positioning sense objective indicator includes a static positioning sense objective indicator, and determining the spatial sense objective indicator according to an angle matrix of the spatial audio signal includes:

[0014] Determining a sound source direction of the single-source static spatial audio signal according to the angle matrix of the single-source static spatial audio signal;

[0015] According to the angle matrix of the single-source static spatial audio signal and the sound source direction, the variance of the angle matrix is ​​calculated as an objective indicator of static localization.

[0016] In a possible implementation manner of the first aspect, the spatial audio signal includes a single sound source motion spatial audio signal, the positioning sense objective index includes a dynamic positioning sense objective index, and determining the spatial sense objective index according to an angle matrix of the spatial audio signal includes:

[0017] Determining the azimuth coordinates of the single sound source moving spatial audio signal in each time period according to the angle matrix of the single sound source moving spatial audio signal;

[0018] According to the azimuth coordinates of the single sound source motion space audio signal in each time period, an objective index of dynamic positioning sense is determined, and the objective index of dynamic positioning sense includes at least any one of the following: a first objective index of dynamic positioning sense and a second objective index of dynamic positioning sense. The first objective index of dynamic positioning sense is the error of the single sound source motion space audio signal, and the second objective index of dynamic positioning sense is the first-order difference of the single sound source motion space audio signal.

[0019] In a possible implementation manner of the first aspect, the dynamic positioning sense objective indicator includes a first dynamic positioning sense objective indicator, and determining the dynamic positioning sense objective indicator according to the azimuth coordinates of the single sound source motion space audio signal in each time period includes:

[0020] According to the azimuth coordinates of the single sound source moving spatial audio signal in each time period and the time series distribution of the reference trajectory, an error of the single sound source moving spatial audio signal is determined as the first dynamic positioning sense objective indicator.

[0021] In a possible implementation manner of the first aspect, the dynamic positioning sense objective indicator includes a second dynamic positioning sense objective indicator, and determining the dynamic positioning sense objective indicator according to the azimuth coordinates of the single sound source motion space audio signal in each time period includes:

[0022] According to the azimuth coordinates of the single sound source moving spatial audio signal in each time period, a first-order difference of the single sound source moving spatial audio signal is determined as the second dynamic positioning sense objective indicator.

[0023] In a possible implementation manner of the first aspect, the spatial audio signal includes a multi-channel orthogonal spatial audio signal, the immersive objective indicator includes an enveloping objective indicator, and determining the spatial objective indicator according to an angle matrix of the spatial audio signal includes:

[0024] Determine at least two of the following energy distribution objective indicators according to the angle matrix of the multi-channel orthogonal spatial audio signal: a front energy distribution objective indicator, a rear energy distribution objective indicator, a left energy distribution objective indicator, a right energy distribution objective indicator, an upper energy distribution objective indicator, and a lower energy distribution objective indicator;

[0025] An objective envelopment index is determined according to the at least two objective energy distribution indexes, wherein the objective envelopment index includes at least one of the following: an objective front and rear envelopment index, an objective horizontal envelopment index, and an objective vertical envelopment index.

[0026] In a possible implementation manner of the first aspect, the method further includes:

[0027] Determine a spatial audio signal forward component and a spatial audio signal backward component according to the multi-channel orthogonal spatial audio signal in the first-order Ambisonics A format;

[0028] Determining correlation information as an objective indicator of information independence according to the forward component of the spatial audio signal and the backward component of the spatial audio signal;

[0029] An objective indicator of immersion is determined according to the objective indicator of envelopment and the objective indicator of information independence.

[0030] In a second aspect, an embodiment of the present application provides a device for evaluating a sense of acoustic space, comprising:

[0031] A signal acquisition module, used to acquire a spatial audio signal output by a speaker;

[0032] A matrix determination module, used to determine an angle matrix of a spatial audio signal according to the spatial audio signal;

[0033] The indicator determination module is used to determine an objective indicator of spatial perception according to the angle matrix of the spatial audio signal, wherein the objective indicator of spatial perception includes at least one of the following: an objective indicator of positioning sense and an objective indicator of immersion sense.

[0034] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the electronic device implements the method for evaluating the sense of acoustic space as described in the first aspect above.

[0035] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for evaluating the sense of acoustic space as described in the first aspect above is implemented.

[0036] In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the method for evaluating the acoustic spatial sense of the first aspect.

[0037] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0038] The present application obtains a spatial audio signal output by a sound system, determines an angle matrix of the spatial audio signal according to the spatial audio signal, and determines an objective index of spatial sense according to the angle matrix of the spatial audio signal, wherein the objective index of spatial sense includes at least one of the following: an objective index of positioning sense and an objective index of immersion sense. The present application constructs a set of reasonable objective evaluation indicators, and can be as close to the subjective feelings of users as possible, combining the advantages of the objective evaluation method being convenient to operate and highly repeatable, and the advantages of the subjective evaluation method being highly correlated with the sense of hearing, which can bring greater benefits to the evaluation of sound systems (such as vehicle-mounted immersive sound systems). The present application can reflect the subjective sense of hearing of spatial audio signals through objectively measured spatial sense indicators in a process-based manner. The present application more clearly reveals the relationship between the subjective and objective perceptual evaluation of spatial audio signals to assist in the optimization and update iteration of sound systems. In addition, the sound spatial sense evaluation method proposed in the present application is a non-invasive method, which does not require the modification of the hardware environment of the sound system (for example, the vehicle environment where the sound system is located does not need to be modified), thus avoiding a large amount of modification costs, and is convenient to operate and process-based, and can quickly perform signal analysis, providing an important tool for the design, tuning, acceptance, and comparison of related products of the sound system, and can be conveniently used for comparison of related products. It can greatly save engineers' time and energy and improve efficiency during the design and tuning stages.

[0039] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0041] Figure 1 is a flow chart of a method for evaluating a sense of acoustic space provided by an embodiment of the present application;

[0042] Figure 2 is a flow chart of a method for evaluating a sense of acoustic space provided by an application embodiment of the present application;

[0043] Figure 3 is a schematic diagram of the structure of an apparatus for evaluating the sense of acoustic space provided by an embodiment of the present application;

[0044] Figure 4 It is a schematic diagram of the structure of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0045] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0046] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0047] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0048] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0049] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0050] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0051] The method for evaluating the sense of acoustic space provided in the embodiment of the present application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc. The embodiment of the present application does not impose any restrictions on the specific types of electronic devices.

[0052] For example, the electronic device may be a station (STAION, ST) in a WLAN, a cellular phone, a cordless phone, a Session Initiation Protocol (SIP) phone, a Wireless Local Loop (WLL) station, a Personal Digital Assistant (PDA) device, a handheld device with wireless communication function, a computing device or other processing device connected to a wireless modem, a vehicle-mounted device, a vehicle networking terminal, a computer, a laptop computer, a handheld communication device, a handheld computing device, a satellite wireless device, a wireless modem card, a TV set top box (STB), a customer premises equipment (CPE) and / or other devices for communicating on a wireless system and a next generation communication system, for example, a mobile terminal in a 5G network or a mobile terminal in a future evolved Public Land Mobile Network (PLMN) network, etc.

[0053] Figure 1 It is a flowchart of a method for evaluating the sense of acoustic space provided in one embodiment of the present application.

[0054] S11, obtaining a spatial audio signal output by a speaker.

[0055] Here, the spatial audio signal output by the sound system can be recorded by a microphone or other device. Alternatively, the spatial audio signal output by the recorded sound system can be obtained by file transfer. The microphone includes but is not limited to a FOA (First-Order Ambisonics) microphone and other devices. The FOA microphone has relatively mature technology and corresponding commercial plug-ins, which can obtain the sound field information of the entire space.

[0056] Spatial audio signals are synonymous with three-dimensional sound specifications. Compared with traditional multi-channel, spatial audio signals not only have more channels than stereo, but also may allow object-based sound information. These sounds are not simply panned to a certain channel, but accurately record the position (static) or even displacement (dynamic) of the sound source relative to the listener in cylindrical coordinates. On the user terminal, in conjunction with local or cloud decoders and renderers, the amplitude-frequency response (timbre) and phase-frequency response (spatial sense) of these sound objects in the channel (sound bed) can be accurately calculated and played back.

[0057] Spatial audio signals can provide more accurate sound source location information and more immersive environmental information. All spatial audio signal content can be regarded as a combination of sound source and environment. Based on this, the spatial audio signals obtained from the sound output include but are not limited to single-source spatial audio signals and surround spatial audio signals. Single-source spatial audio signals include but are not limited to single-source static spatial audio signals, single-source moving spatial audio signals, etc. Surround spatial audio signals include but are not limited to multi-channel orthogonal spatial audio signals, and other non-completely orthogonal spatial audio signals.

[0058] Since the sense of space is mainly determined by the spatial distribution of spatial audio signals, it has little to do with the loudness of the sound. However, sufficient loudness is a necessary condition for improving the signal-to-noise ratio and fully reflecting the audio details. Therefore, the loudness of all spatial audio signals should be increased as much as possible without exceeding the microphone range.

[0059] The definitions of a single-source static spatial audio signal, a single-source moving spatial audio signal, and a multi-channel orthogonal spatial audio signal are shown in the following Table 1:

[0060]

[0061] Table 1

[0062] Those skilled in the art should understand that the above method of using the car audio system for playback is only an example. The present application scheme is mostly exemplified by the application scenario of the in-car audio environment, and the present application scheme can also be applied to the scenarios of playback by the audio system in other environments, such as various indoor scenes such as home indoor scenes, cinema indoor scenes, and outdoor scenes.

[0063] S12: Determine an angle matrix of the spatial audio signal according to the spatial audio signal.

[0064] The angle matrix of the spatial audio signal includes but is not limited to a plane azimuth angle matrix and a pitch angle matrix.

[0065] Among them, the plane azimuth matrix θ is composed of θ k,nComposition, θ represents the plane azimuth, θ∈[-π,π), k represents the frequency point, n represents the time frame sequence (referred to as time sequence), θ k,n Indicates the plane azimuth angle value at frequency k and time frame n. The plane azimuth angle values ​​θ under different frequency k and different time frame n are k,n Form the plane azimuth matrix Θ.

[0066] The pitch angle matrix Φ is given by φ k,n Composition, φ represents the pitch angle, k represents the frequency point, n represents the time frame sequence (referred to as time sequence), φ k,n Indicates the pitch angle value at frequency k and time frame n. The pitch angle values ​​φ at different frequency k and time frame n are k,n Form the pitch angle matrix Φ.

[0067] In one embodiment, the spatial audio signal comprises a spatial audio signal in a first-order Ambisonics A format, and determining the angle matrix of the spatial audio signal according to the spatial audio signal comprises:

[0068] Performing format conversion on the spatial audio signal in the first-order Ambisonics A format to obtain a spatial audio signal in the first-order Ambisonics B format; and determining an angle matrix of the spatial audio signal according to the spatial audio signal in the first-order Ambisonics B format.

[0069] The spatial audio signal of the First-Order Ambisonics A-format (FOA-A format) includes but is not limited to at least any one of the following: left front signal LF, left rear signal LB, right front signal RF, and right rear signal RB. The spatial audio signal of the First-Order Ambisonics B-format (FOA-B format) includes but is not limited to at least any one of the following: omnidirectional signal W, front-back depth signal X, left-right width signal Y, and top-bottom height signal Z.

[0070] Methods of converting the spatial audio signal in FOA-A format to obtain the spatial audio signal in FOA-B format include but are not limited to the following two methods.

[0071] (1) Substitute the spatial audio signal in FOA-A format as an input into the following calculation formula to obtain the spatial audio signal in FOA-B format.

[0072]

[0073] Among them, LF, LB, RF, and RB are spatial audio signals in FOA-A format, LF represents the left front signal, LB represents the left rear signal, RF represents the right front signal, and RB represents the right rear signal. W, X, Y, and Z are spatial audio signals in FOA-B format, W represents the omnidirectional signal, X represents the front and back depth signal, Y represents the left and right width signal, and Z represents the top and bottom height signal.

[0074] (2) The spatial audio signal in FOA-A format is converted through the Audition plug-in of the FOA microphone to obtain the spatial audio signal in FOA-B format.

[0075] After acquiring the spatial audio signal in the FOA-B format, the angle matrix of the spatial audio signal may be determined. The angle matrix of the spatial audio signal includes but is not limited to a plane azimuth angle matrix and a pitch angle matrix.

[0076] Plane azimuth angle value θ at different frequency points k and different time frame sequences n k,n The plane azimuth matrix θ is formed. k,n It can be calculated based on the following formula:

[0077]

[0078] in, The conjugate operation result value of the omnidirectional signal value at frequency point k and time frame sequence n, x y (k,n) represents the left and right width signal value of frequency point k and time frame sequence n, x x (k,n) represents the depth signal value before and after frequency point k and time frame sequence n. Express The complex result (the complex result includes the real part and the imaginary part) is calculated by taking the real part. Express The complex result (the complex result includes the real part and the imaginary part) is calculated by taking the real part.

[0079] Pitch angle values ​​φ at different frequency points k and different time frames n k,n The pitch angle matrix Φ is formed. Among them, φ k,n It can be calculated based on the following formula:

[0080]

[0081] in, The conjugate operation result value of the omnidirectional signal value at frequency point k and time frame sequence n, x z (k,n) represents the upper and lower height signal values ​​of frequency point k and time frame sequence n, x x (k,n) represents the depth signal value before and after frequency point k and time frame sequence n, xy (k,n) represents the left and right width signal value of frequency point k and time frame sequence n. Express The complex result (the complex result includes the real part and the imaginary part) is calculated by taking the real part. Express The complex result (the complex result includes the real part and the imaginary part) is calculated by taking the real part. Express The complex result (the complex result includes the real part and the imaginary part) is calculated by taking the real part. Express The complex result (the complex result includes the real part and the imaginary part) is calculated by taking the real part.

[0082] S13, determining an objective index of spatial sense according to the angle matrix of the spatial audio signal, where the objective index of spatial sense includes at least one of the following: an objective index of positioning sense and an objective index of immersion sense.

[0083] Through the study of spatial hearing, we have obtained the information that spatial hearing can provide. That is, when the human auditory system hears a sound, in addition to the content of the sound itself, it can also obtain a lot of information about the listening space. Based on this information, the spatial hearing is decoupled and decomposed into two major categories: sense of positioning and sense of immersion. Therefore, the objective indicators of spatial sense determined in this application include at least one of the following: objective indicators of sense of positioning, objective indicators of sense of immersion. Among them, the objective indicators of sense of positioning are used to describe the objective presentation ability of the position of each sound element when the speaker system plays. The objective indicators of sense of positioning include static objective indicators of sense of positioning and dynamic objective indicators of sense of positioning. The objective indicators of sense of positioning can be expressed as a comprehensive expression of the two characteristics of the above-mentioned static objective indicators of sense of positioning and dynamic objective indicators of sense of positioning.

[0084] In one embodiment, the spatial audio signal includes a single-source static spatial audio signal, the localization objective index includes a static localization objective index, and determining the spatial objective index according to the angle matrix of the spatial audio signal includes:

[0085] According to the angle matrix of the single-source static spatial audio signal, the sound source direction of the single-source static spatial audio signal is determined; according to the angle matrix of the single-source static spatial audio signal and the sound source direction, the variance of the angle matrix is ​​calculated as an objective indicator of static positioning sense.

[0086] The static sense of localization objective index can be used to measure the directional accuracy. By defining the difference between the channel direction perceived by the listener in the car and the standard (reference) direction, the static sense of localization objective index can measure the difference in the sense of sound orientation between the in-car spatial audio system and the standard listening environment. The static sense of localization objective index can be used to evaluate whether the orientation of the sound elements displayed during multi-channel playback of in-car audio is accurate. Since the speaker layout in the car is different from the standard multi-channel home theater and listening room layout, it is necessary to create an orientation that meets the standard layout by synthesizing virtual sources. This means that directly measuring the speaker orientation cannot represent the sound source position in the auditory sense. Accurate channel orientation is the basis for ensuring the accuracy of the overall orientation of spatial sound. This is because multi-channel audio content is basically produced in a standard recording studio. The more standard the orientation of each channel in the car is, the better it can present the spatial audio signal content. Among them, the synthetic virtual source refers to a virtual sound source synthesized using two or more real sources. The sound is imaged at this position, but the sound source does not actually exist.

[0087] During measurement, a single-source static spatial audio signal can be used according to the number of audio channels supported by the in-vehicle audio system, and measured and recorded through a FOA microphone to obtain a single-source static spatial audio signal in the FOA-A format of the static virtual sound source output by the in-vehicle spatial audio system. The single-source static spatial audio signal in the FOA-A format is format-converted to obtain a single-source static spatial audio signal in the FOA-B format. Based on the single-source static spatial audio signal in the FOA-B format, the angle matrix of the single-source static spatial audio signal is determined. The test point can be, for example, the middle position of the car and the driver's seat, and the height of the measurement point can be flush with the user's head position.

[0088] The plane azimuth matrix θ of a single sound source static spatial audio signal is composed of the plane azimuth angle values ​​θ at different frequency points k and different time frame sequences n. k,n Since the angle data has rotation symmetry, the variance cannot be directly calculated, so the angle value θ k,n Transformed to the complex domain, that is, θ k,n →(cosθ k,n , sinθ k,n ).

[0089] According to the angle matrix of the single-source still spatial audio signal, the probability that the single-source still spatial audio signal in FOA-B format comes from various directions can be obtained by statistically analyzing the angle distribution columns, and the sound source direction of the single-source still spatial audio signal can be obtained by taking the mean.

[0090]

[0091] Wherein, mean(Θ) represents the sound source direction of a single-source static spatial audio signal.

[0092] According to the angle matrix and the sound source direction of the single-source static spatial audio signal, the variance of the angle matrix can be calculated based on the following formula as an objective indicator of static positioning sense.

[0093]

[0094] Among them, θ represents the plane azimuth, θ∈[-π,π), k represents the frequency point, n represents the time frame sequence (referred to as time sequence), θ k,n Indicates the plane azimuth angle value at frequency k and time frame n. The plane azimuth angle values ​​θ under different frequency k and different time frame n are k,n The plane azimuth matrix Θ is formed. K is the total number of frequency bands and N is the total number of time frames. var(Θ) represents the variance of the angle matrix.

[0095] The variance of the angle matrix is ​​used as an objective indicator of static localization. The objective indicator of static localization can reflect the degree of concentration of the sound direction of the vehicle audio system and characterize the quality of the static sound source orientation localization. The smaller the value of the objective indicator of static localization, the more concentrated the sound image is and the better the static localization is.

[0096] In one embodiment, the spatial audio signal includes a single sound source motion spatial audio signal, the positioning sense objective index includes a dynamic positioning sense objective index, and determining the spatial sense objective index according to the angle matrix of the spatial audio signal includes:

[0097] According to the angle matrix of the single sound source moving space audio signal, the azimuth coordinates of the single sound source moving space audio signal in each time period are determined; according to the azimuth coordinates of the single sound source moving space audio signal in each time period, the dynamic positioning sense objective index is determined, and the dynamic positioning sense objective index includes at least any one of the following: a first dynamic positioning sense objective index, a second dynamic positioning sense objective index, the first dynamic positioning sense objective index is the error of the single sound source moving space audio signal, and the second dynamic positioning sense objective index is the first-order difference of the single sound source moving space audio signal.

[0098] Dynamic positioning defines whether the in-car spatial audio system can ensure the accuracy and clarity of the trajectory when outputting moving sound sources.

[0099] During measurement, a single-source motion spatial audio signal can be used according to the number of audio channels supported by the in-vehicle audio system, and measured through a FOA microphone to obtain a single-source motion spatial audio signal in the FOA-A format of the motion sound source output by the in-vehicle spatial audio system. The single-source motion spatial audio signal in the FOA-A format is format-converted to obtain a single-source motion spatial audio signal in the FOA-B format. Based on the single-source motion spatial audio signal in the FOA-B format, the angle matrix of the single-source motion spatial audio signal is determined. The test point can be, for example, the middle position of the car and the driver's seat, and the height of the measurement point can be flush with the user's head position.

[0100] Since the single sound source motion spatial audio signal requires the sound source to move slowly, the sound source can be understood as static in a shorter time frame. Therefore, the single sound source motion spatial audio signal can be segmented to determine the azimuth coordinates of the single sound source motion spatial audio signal in each time period. The plane azimuth angle matrix θ of the single sound source motion spatial audio signal is composed of the plane azimuth angle values ​​θ at different frequency points k and different time frame sequences n. k,n Since the angle data has rotation symmetry, the variance cannot be directly calculated, so the angle value θ k,n Transformed to the complex domain, that is, θ k,n →(cosθ k,n , sinθ k,n ). The azimuth coordinates of the single-source moving spatial audio signal in each time period can be determined based on the following formula according to the angle matrix of the single-source moving spatial audio signal.

[0101]

[0102] Among them, Θ t represents the angle matrix of each time period t, and N′ represents the number of frames in each segment. mean(Θ t ) represents the azimuth coordinates of the single sound source motion spatial audio signal in each time period t. t ) is written as trace(X(t))=mean(Θ t ).

[0103] According to the angle matrix of the single-source moving spatial audio signal, the angular distribution variance of the single-source moving spatial audio signal in each time period can be determined based on the following formula.

[0104]

[0105] Among them, Θ t represents the angle matrix of each time segment t, and N′ represents the number of frames in each segment. t) represents the angular distribution variance of the single sound source moving spatial audio signal in each time period t.

[0106] In one embodiment, determining the objective index of dynamic positioning sense according to the azimuth coordinates of the single sound source motion spatial audio signal in each time period includes:

[0107] According to the azimuth coordinates of the single sound source moving spatial audio signal in each time period and the time series distribution of the reference trajectory, an error of the single sound source moving spatial audio signal is determined as the first dynamic positioning sense objective indicator.

[0108] Here, the error of the single sound source moving spatial audio signal can be determined as the first dynamic positioning sense objective indicator based on the following formula according to the azimuth coordinates of the single sound source moving spatial audio signal in each time period and the temporal distribution of the reference trajectory.

[0109]

[0110] in, represents the time series distribution of the reference trajectory, Err represents the error of the single sound source motion spatial audio signal, and the error characterizes the accuracy of the dynamic sound source trajectory. The error of the single sound source motion spatial audio signal is used as the first dynamic positioning sense objective indicator. The smaller the value of the first dynamic positioning sense objective indicator, the better the continuity of the dynamic change and the better the dynamic positioning sense.

[0111] In one embodiment, determining the objective index of dynamic positioning sense according to the azimuth coordinates of the single sound source motion spatial audio signal in each time period includes:

[0112] According to the azimuth coordinates of the single sound source moving spatial audio signal in each time period, a first-order difference of the single sound source moving spatial audio signal is determined as the second dynamic positioning sense objective indicator.

[0113] Here, the first-order difference of the single sound source moving spatial audio signal can be determined as the second dynamic positioning sense objective indicator based on the following formula according to the azimuth coordinates of the single sound source moving spatial audio signal in each time period.

[0114]

[0115] Diff represents the first-order difference of the single-source moving spatial audio signal, which can reflect the continuity of the change. The first-order difference of the single-source moving spatial audio signal is used as the second dynamic positioning sense objective indicator, and the smaller the value of the second dynamic positioning sense objective indicator, the better the continuity.

[0116] In one embodiment, the spatial audio signal includes a multi-channel orthogonal spatial audio signal, the immersive objective index includes an enveloping objective index, and determining the spatial objective index according to the angle matrix of the spatial audio signal includes:

[0117] Determine at least two of the following energy distribution objective indicators according to the angle matrix of the multi-channel orthogonal spatial audio signal: a front energy distribution objective indicator, a rear energy distribution objective indicator, a left energy distribution objective indicator, a right energy distribution objective indicator, an upper energy distribution objective indicator, and a lower energy distribution objective indicator;

[0118] An objective envelopment index is determined according to the at least two objective energy distribution indexes, wherein the objective envelopment index includes at least one of the following: an objective front and rear envelopment index, an objective horizontal envelopment index, and an objective vertical envelopment index.

[0119] One of the most important experiences in spatial audio signals is the feeling of being "immersed in the sound field", which comes from: 1) the feeling of being surrounded by surrounding sound energy, that is, the sense of envelopment; 2) the information independence between sound information in different directions. Among them, the sense of envelopment of sound energy distribution is relatively important, while the role of information independence is to identify the potential possibility of the head effect after the uniformity of distribution is basically guaranteed. The sense of immersion can be expressed as a comprehensive expression of the two characteristics of envelopment and information independence.

[0120] Among them, the sense of surround defines the uniformity of the distribution of sound energy in all directions in the cabin when the car audio system plays surround sound sources.

[0121] During measurement, you can use a multi-channel orthogonal spatial audio signal according to the number of audio channels supported by the in-vehicle audio system, and measure it through a FOA microphone to obtain a multi-channel orthogonal spatial audio signal in the FOA-A format output by the in-vehicle spatial audio system. Convert the multi-channel orthogonal spatial audio signal in the FOA-A format to obtain a multi-channel orthogonal spatial audio signal in the FOA-B format. According to the multi-channel orthogonal spatial audio signal in the FOA-B format, determine the angle matrix of the multi-channel orthogonal spatial audio signal. For example, the test point can be selected from the middle position of the car and the driver's seat, and the height of the measurement point can be flush with the user's head position.

[0122] The angle matrix of the multi-channel orthogonal spatial audio signal includes but is not limited to a plane azimuth angle matrix and a pitch angle matrix.

[0123] Among them, the plane azimuth matrix θ is composed of θ k,n Composition, θ represents the plane azimuth, θ∈[-π,π), k represents the frequency point, n represents the time frame sequence (referred to as time sequence), θ k,nIndicates the plane azimuth angle value at frequency k and time frame n. The plane azimuth angle values ​​θ under different frequency k and different time frame n are k,n Form the plane azimuth matrix Θ.

[0124] The pitch angle matrix Φ is given by φ k,n Composition, φ represents the pitch angle, k represents the frequency point, n represents the time frame sequence (referred to as time sequence), φ k,n Indicates the pitch angle value at frequency k and time frame n. The pitch angle values ​​φ at different frequency k and time frame n are k,n Form the pitch angle matrix Φ.

[0125] Calculate θ by P(·) k,n The statistical probability of the plane azimuth angle is obtained by P(·) to calculate φ k,n The statistical probability of the plane azimuth angle is obtained to obtain the angular distribution probability P(φ).

[0126] According to the angle matrix of the multi-channel orthogonal spatial audio signal, at least two of the following energy distribution objective indicators are determined based on the following formula: a front energy distribution objective indicator, a rear energy distribution objective indicator, a left energy distribution objective indicator, a right energy distribution objective indicator, an upper energy distribution objective indicator, and a lower energy distribution objective indicator:

[0127]

[0128] Among them, P Front Represents the objective index of energy distribution ahead, P Back Represents the objective index of rear energy distribution, P Left Represents the objective index of energy distribution on the left, P Right Represents the objective index of energy distribution on the right, P Up It represents the objective index of energy distribution above, P Down It represents an objective indicator of energy distribution below.

[0129] According to at least two objective indicators of energy distribution, an objective indicator of envelopment is determined based on the following formula, wherein the objective indicator of envelopment includes at least one of the following: an objective indicator of front and rear envelopment, an objective indicator of horizontal envelopment, and an objective indicator of vertical envelopment.

[0130]

[0131]

[0132] Among them, Ev F-B Indicates the objective index of front and rear envelopment, Ev A-R Represents the objective index of horizontal envelopment, EvU-D Indicates the objective index of vertical envelopment. Ev, the objective index of front and rear envelopment F-B , horizontal envelopment objective index Ev A-R , vertical envelopment objective index Ev U-D The closer the value is to 1, the stronger the sense of envelopment is.

[0133] In one embodiment, the method for evaluating the acoustic spatial sense further includes:

[0134] Determine a spatial audio signal forward component and a spatial audio signal backward component according to the multi-channel orthogonal spatial audio signal in the first-order Ambisonics A format;

[0135] Determining correlation information as an objective indicator of information independence according to the forward component of the spatial audio signal and the backward component of the spatial audio signal;

[0136] An objective indicator of immersion is determined according to the objective indicator of envelopment and the objective indicator of information independence.

[0137] Since the sound source angle distribution is weighted and summed (the weights are trigonometric functions) in the process of determining the objective index of envelopment, the objective index of envelopment can also reflect the energy ratio. Under the condition of meeting a certain energy uniformity, the sound from all directions can be heard by the listener. At this time, the problem of the head effect needs to be considered. Since there are few coherent sound sources under natural conditions, when the sound content from relative directions is very similar, the listener will feel very strange, resulting in the head effect. If the objective index of envelopment is close to 1, the existence of the head effect can be determined based on the objective index of information independence, so as to more accurately determine the objective index of immersion, which is used to better determine the immersion.

[0138] During the measurement, the multi-channel orthogonal spatial audio signal can be used according to the number of audio channels supported by the in-car audio system, and the FOA microphone can be used to measure the multi-channel orthogonal spatial audio signal in the FOA-A format output by the in-car spatial audio system. The test point can be the middle of the car and the driver's seat, for example, and the height of the measurement point can be flush with the user's head position.

[0139] The multi-channel orthogonal spatial audio signal in FOA-A format (First-Order Ambisonics A-format) includes but is not limited to at least one of the following: left front signal LF, left rear signal LB, right front signal RF, and right rear signal RB. Since the FOA microphone uses a cardioid microphone, and the content measured by the cardioid microphone can be approximately considered as a sound vector pointing in the same direction as the cardioid microphone, the forward component of the spatial audio signal and the backward component of the spatial audio signal can be determined by the vector summation method based on the following formula:

[0140]

[0141] Among them, f Front represents the forward component of the spatial audio signal, f Back Represents the backward component of the spatial audio signal.

[0142] The correlation of information is characterized by the logarithmic weighted modified IACC (Interaural cross-correlation). According to the forward component of the spatial audio signal and the backward component of the spatial audio signal, the correlation information is determined as an objective indicator of information independence based on the following formula:

[0143]

[0144] FIACC=max|FIACF|

[0145] where k 1 represents the lower limit of the frequency band, k 2 Represents the upper limit of the frequency band, which is determined by the upper and lower limits of the dual-channel signal time difference, and is generally ±1ms. Front represents the forward component of the spatial audio signal, f Back Represents the backward component of the spatial audio signal, Represents the conjugate operation result value of the backward component of the spatial audio signal, Express The complex result (the complex result includes the real part and the imaginary part) is calculated by taking the real part.

[0146] If the objective index of envelopment is close to 1, and the objective index of information independence FIACC is large, it is determined that the objective index of immersion decreases and the immersion weakens. If the objective index of envelopment is large (for example, greater than 3), the impact of the head effect represented by the objective index of information independence FIACC is small, and it can be considered that there is no impact on the objective index of immersion.

[0147] The present application obtains a spatial audio signal output by a sound system, determines an angle matrix of the spatial audio signal according to the spatial audio signal, and determines an objective index of spatial sense according to the angle matrix of the spatial audio signal, wherein the objective index of spatial sense includes at least one of the following: an objective index of positioning sense and an objective index of immersion sense. The present application constructs a set of reasonable objective evaluation indicators, and can be as close to the subjective feelings of users as possible, combining the advantages of the objective evaluation method being convenient to operate and highly repeatable, and the advantages of the subjective evaluation method being highly correlated with the sense of hearing, which can bring greater benefits to the evaluation of sound systems (such as vehicle-mounted immersive sound systems). The present application can reflect the subjective sense of hearing of spatial audio signals through objectively measured spatial sense indicators in a process-based manner. The present application more clearly reveals the relationship between the subjective and objective perceptual evaluation of spatial audio signals to assist in the optimization and update iteration of sound systems. In addition, the sound spatial sense evaluation method proposed in the present application is a non-invasive method, which does not require the modification of the hardware environment of the sound system (for example, the vehicle environment where the sound system is located does not need to be modified), thus avoiding a large amount of modification costs, and is convenient to operate and process-based, and can quickly perform signal analysis, providing an important tool for the design, tuning, acceptance, and comparison of related products of the sound system, and can be conveniently used for comparison of related products. It can greatly save engineers' time and energy and improve efficiency during the design and tuning stages.

[0148] The applicant studied the perception mechanism of the auditory system and found the mapping from physical acoustics to perception indicators to obtain the final perception indicators. The perception indicators include: static directional accuracy, dynamic directional accuracy, static sound source clarity, dynamic sound source clarity, energy distribution uniformity, information independence, etc. The introduction of these indicators solves the problem that spatial audio signals are too general in the evaluation process. The objective indicators of positioning sense and immersion sense decoupled from spatial sense can accurately and comprehensively describe the quality of spatial audio signals.

[0149] The applicant comprehensively considers the needs, costs and calculation requirements of perception indicators to determine the required test signals and sound collection equipment. The test signals include single-source static spatial audio signals, single-source moving spatial audio signals, and multi-channel orthogonal spatial audio signals. The playback process only requires an in-vehicle audio playback system, without the need to install additional speakers or modify the car. The sound collection environment equipment is simple to set up and low-cost.

[0150] The applicant obtained the specific calculation method of the above indicators through the study of cognitive models and psychoacoustic models, and calculated the perception indicators through the measured data. This evaluation method retains the advantages of traditional objective evaluation methods, which are repeatable and low-cost, and combines the advantages of subjective evaluation (i.e., highly correlated with hearing perception), which can accurately reflect the user experience of the product.

[0151] Figure 2It is a flowchart of a method for evaluating the sense of acoustic space provided in an application embodiment of the present application.

[0152] like Figure 2 As shown, the FOA (First-Order Ambisonics, first-order high-fidelity stereophonic replication) microphone device can obtain the spatial audio signal output by the sound system through signal acquisition. The spatial audio signal includes orthogonal pure test sounds of each channel played by the in-car speaker (that is, a multi-channel orthogonal spatial audio signal), a single-source static test sound played by the in-car speaker (that is, a single-source static spatial audio signal), and a single-source motion test sound played by the in-car speaker (that is, a single-source motion spatial audio signal). Then, according to the spatial audio signal, the angle matrix of the spatial audio signal is determined. Subsequently, the objective index of information independence is determined by calculating the auditory mutual correlation coefficient. By calculating the sound energy-azimuth distribution, the objective index of envelopment, the objective index of static positioning, and the objective index of dynamic positioning are determined. Then, the objective index of positioning is obtained based on the objective index of static positioning and the objective index of dynamic positioning. The objective index of immersion is obtained based on the objective index of envelopment and the objective index of information independence. The objective index of spatial sense is determined based on the objective index of positioning and the objective index of immersion, which is used for objective evaluation of spatial sense.

[0153] Figure 3 It is a schematic diagram of the structure of a device for evaluating the sense of acoustic space provided in one embodiment of the present application.

[0154] like Figure 3 As shown, the evaluation device 3 includes:

[0155] A signal acquisition module 31 is used to acquire a spatial audio signal output by a speaker;

[0156] A matrix determination module 32, configured to determine an angle matrix of a spatial audio signal according to the spatial audio signal;

[0157] The indicator determination module 33 is used to determine an objective indicator of spatial perception according to the angle matrix of the spatial audio signal, where the objective indicator of spatial perception includes at least one of the following: an objective indicator of positioning sense and an objective indicator of immersion sense.

[0158] Another embodiment of the present invention discloses an evaluation device 3. Figure 3 On the basis of the corresponding embodiment, the spatial audio signal comprises a spatial audio signal in a first-order Ambisonics A format, and the matrix determination module 32 is used for:

[0159] Performing format conversion on the spatial audio signal in the first-order Ambisonics A format to obtain a spatial audio signal in the first-order Ambisonics B format;

[0160] According to the spatial audio signal in the first-order Ambisonics B format, an angle matrix of the spatial audio signal is determined.

[0161] Another embodiment of the present invention discloses an evaluation device 3. Figure 3 On the basis of the corresponding embodiment, the spatial audio signal includes a single sound source static spatial audio signal, the positioning sense objective index includes a static positioning sense objective index, and the index determination module 33 is used to:

[0162] Determining a sound source direction of the single-source static spatial audio signal according to the angle matrix of the single-source static spatial audio signal;

[0163] According to the angle matrix of the single-source static spatial audio signal and the sound source direction, the variance of the angle matrix is ​​calculated as an objective indicator of static localization.

[0164] Another embodiment of the present invention discloses an evaluation device 3. Figure 3 On the basis of the corresponding embodiment, the spatial audio signal includes a single sound source motion spatial audio signal, the positioning sense objective index includes a dynamic positioning sense objective index, and the index determination module 33 is used to:

[0165] Determining the azimuth coordinates of the single sound source moving spatial audio signal in each time period according to the angle matrix of the single sound source moving spatial audio signal;

[0166] According to the azimuth coordinates of the single sound source motion space audio signal in each time period, an objective index of dynamic positioning sense is determined, and the objective index of dynamic positioning sense includes at least any one of the following: a first objective index of dynamic positioning sense and a second objective index of dynamic positioning sense. The first objective index of dynamic positioning sense is the error of the single sound source motion space audio signal, and the second objective index of dynamic positioning sense is the first-order difference of the single sound source motion space audio signal.

[0167] Another embodiment of the present invention discloses an evaluation device 3. Figure 3 On the basis of the corresponding embodiment, the dynamic positioning sense objective indicator includes a first dynamic positioning sense objective indicator, and the indicator determination module 33 is used to:

[0168] According to the azimuth coordinates of the single sound source moving spatial audio signal in each time period and the time series distribution of the reference trajectory, an error of the single sound source moving spatial audio signal is determined as a first dynamic positioning sense objective indicator.

[0169] Another embodiment of the present invention discloses an evaluation device 3. Figure 3On the basis of the corresponding embodiment, the dynamic positioning sense objective indicator includes a second dynamic positioning sense objective indicator, and the indicator determination module 33 is used for:

[0170] According to the azimuth coordinates of the single sound source moving spatial audio signal in each time period, a first-order difference of the single sound source moving spatial audio signal is determined as the second dynamic positioning sense objective indicator.

[0171] Another embodiment of the present invention discloses an evaluation device 3. Figure 3 On the basis of the corresponding embodiment, the spatial audio signal includes a multi-channel orthogonal spatial audio signal, the immersive objective index includes an enveloping objective index, and the index determination module 33 is used to:

[0172] Determine at least two of the following energy distribution objective indicators according to the angle matrix of the multi-channel orthogonal spatial audio signal: a front energy distribution objective indicator, a rear energy distribution objective indicator, a left energy distribution objective indicator, a right energy distribution objective indicator, an upper energy distribution objective indicator, and a lower energy distribution objective indicator;

[0173] An objective envelopment index is determined according to the at least two objective energy distribution indexes, wherein the objective envelopment index includes at least one of the following: an objective front and rear envelopment index, an objective horizontal envelopment index, and an objective vertical envelopment index.

[0174] Another embodiment of the present invention discloses an evaluation device 3. Figure 3 On the basis of the corresponding embodiment, the evaluation device 3 further includes:

[0175] a front and rear component determination module, configured to determine a spatial audio signal forward component and a spatial audio signal backward component according to the multi-channel orthogonal spatial audio signal in the first-order Ambisonics A format;

[0176] An independent indicator determination module, configured to determine correlation information as an objective indicator of information independence according to the forward component of the spatial audio signal and the backward component of the spatial audio signal;

[0177] The immersion index determination module is used to determine the immersion objective index according to the envelopment objective index and the information independence objective index.

[0178] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0179] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0180] The present application also provides an electronic device, such as Figure 4 As shown, the electronic device 4 includes: at least one processor 40, a memory 41, and a computer program 42 stored in the memory 41 and executable on the at least one processor 40, and when the processor 40 executes the computer program 42, the steps in any of the above-mentioned method embodiments are implemented.

[0181] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0182] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0183] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of the above-mentioned various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the camera / electronic device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0184] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0185] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0186] In the embodiments provided in the present application, it should be understood that the disclosed devices / electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0187] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0188] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for evaluating acoustic spatial perception, characterized in that: include: Obtaining a spatial audio signal output by a speaker; Determine an angle matrix of the spatial audio signal according to the spatial audio signal; An objective index of spatial sense is determined according to the angle matrix of the spatial audio signal, where the objective index of spatial sense includes at least one of the following: an objective index of positioning sense and an objective index of immersion sense.

2. The method for evaluating acoustic spatial perception according to claim 1, wherein: The spatial audio signal comprises a spatial audio signal in a first-order Ambisonics A format, and determining an angle matrix of the spatial audio signal according to the spatial audio signal comprises: Performing format conversion on the spatial audio signal in the first-order Ambisonics A format to obtain a spatial audio signal in the first-order Ambisonics B format; According to the spatial audio signal in the first-order Ambisonics B format, an angle matrix of the spatial audio signal is determined.

3. The method for evaluating acoustic spatial perception according to claim 1 or 2, wherein: The spatial audio signal includes a single sound source static spatial audio signal, the positioning sense objective index includes a static positioning sense objective index, and determining the spatial sense objective index according to the angle matrix of the spatial audio signal includes: Determining a sound source direction of the single-source static spatial audio signal according to the angle matrix of the single-source static spatial audio signal; According to the angle matrix of the single-source static spatial audio signal and the sound source direction, the variance of the angle matrix is ​​calculated as an objective indicator of static localization.

4. The method for evaluating acoustic spatial perception according to claim 1 or 2, wherein: The spatial audio signal includes a single sound source motion spatial audio signal, the positioning sense objective index includes a dynamic positioning sense objective index, and determining the spatial sense objective index according to the angle matrix of the spatial audio signal includes: Determining the azimuth coordinates of the single sound source moving spatial audio signal in each time period according to the angle matrix of the single sound source moving spatial audio signal; According to the azimuth coordinates of the single sound source motion space audio signal in each time period, an objective index of dynamic positioning sense is determined, and the objective index of dynamic positioning sense includes at least any one of the following: a first objective index of dynamic positioning sense and a second objective index of dynamic positioning sense. The first objective index of dynamic positioning sense is the error of the single sound source motion space audio signal, and the second objective index of dynamic positioning sense is the first-order difference of the single sound source motion space audio signal.

5. The method for evaluating acoustic spatial perception according to claim 4, wherein: The dynamic positioning sense objective index includes a first dynamic positioning sense objective index, and the dynamic positioning sense objective index is determined according to the azimuth coordinates of the single sound source motion space audio signal in each time period, including: According to the azimuth coordinates of the single sound source moving spatial audio signal in each time period and the time series distribution of the reference trajectory, an error of the single sound source moving spatial audio signal is determined as the first dynamic positioning sense objective indicator.

6. The method for evaluating acoustic spatial perception according to claim 4, wherein: The dynamic positioning sense objective index includes a second dynamic positioning sense objective index, and the dynamic positioning sense objective index is determined according to the azimuth coordinates of the single sound source motion space audio signal in each time period, including: According to the azimuth coordinates of the single sound source moving spatial audio signal in each time period, a first-order difference of the single sound source moving spatial audio signal is determined as the second dynamic positioning sense objective indicator.

7. The method for evaluating acoustic spatial perception according to claim 1 or 2, wherein: The spatial audio signal includes a multi-channel orthogonal spatial audio signal, the immersive objective index includes an enveloping objective index, and determining the spatial objective index according to the angle matrix of the spatial audio signal includes: Determine at least two of the following energy distribution objective indicators according to the angle matrix of the multi-channel orthogonal spatial audio signal: a front energy distribution objective indicator, a rear energy distribution objective indicator, a left energy distribution objective indicator, a right energy distribution objective indicator, an upper energy distribution objective indicator, and a lower energy distribution objective indicator; An objective envelopment index is determined according to the at least two objective energy distribution indexes, wherein the objective envelopment index includes at least one of the following: an objective front and rear envelopment index, an objective horizontal envelopment index, and an objective vertical envelopment index.

8. The method for evaluating acoustic spatial perception according to claim 7, wherein: The method further includes: Determine a spatial audio signal forward component and a spatial audio signal backward component according to the multi-channel orthogonal spatial audio signal in the first-order Ambisonics A format; Determining correlation information as an objective indicator of information independence according to the forward component of the spatial audio signal and the backward component of the spatial audio signal; An objective indicator of immersion is determined according to the objective indicator of envelopment and the objective indicator of information independence.

9. An evaluation device for acoustic spatial perception, characterized in that: include: A signal acquisition module, used to acquire a spatial audio signal output by a speaker; A matrix determination module, used to determine an angle matrix of a spatial audio signal according to the spatial audio signal; The indicator determination module is used to determine an objective indicator of spatial perception according to the angle matrix of the spatial audio signal, wherein the objective indicator of spatial perception includes at least one of the following: an objective indicator of positioning sense and an objective indicator of immersion sense.

10. An electronic device comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the electronic device implements the method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Method and device for processing audio data of sound field

    CN106993249A

  • Method and system for objectively evaluating sense of space of sound equipment in vehicle, equipment and storage medium

    CN111935624A

  • Acquisition method, device and equipment of listening space perception information and storage medium

    CN117135530A

  • Sound quality evaluation device and method for vehicle

    JP2008298474A