A method and apparatus for constructing a personal sound field in a vehicle

By obtaining the number and location of in-vehicle speakers, determining the virtual speaker positions and transformation functions, and utilizing NFC-HOA decoding and VBAP gain, the problem of poor in-vehicle sound field reconstruction quality was solved, thus improving the user experience.

CN115734149BActive Publication Date: 2026-04-28BEIJING TWIRLING IN TIME CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
BEIJING TWIRLING IN TIME CO LTD
Filing Date
2022-10-31
Publication Date
2026-04-28

AI Technical Summary

Technical Problem

Existing technologies reconstruct the in-vehicle sound field by using the vehicle's geometric center as the sound field center. This results in poor sound field quality and a poor user experience for non-central listening points within the vehicle.

Method used

By acquiring the number and location of the vehicle speakers and the target location of the user inside the vehicle, the position and transformation function of the virtual speakers are determined. Then, using NFC-HOA decoding and VBAP gain, the sound field centered on the user inside the vehicle is reconstructed.

Benefits of technology

It achieves high-quality sound field reconstruction centered on the in-vehicle user, enhancing the user's auditory experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115734149B_ABST
    Figure CN115734149B_ABST
Patent Text Reader

Abstract

The application discloses a method for constructing a personal sound field in a vehicle, which comprises the following steps: acquiring the number of vehicle-mounted loudspeakers, the positions of the vehicle-mounted loudspeakers and the target position of a user in the vehicle; determining the positions of virtual loudspeakers and conversion functions of the virtual loudspeakers according to the positions of the vehicle-mounted loudspeakers and the target position of the user in the vehicle; determining the positions of secondary sound sources in NFC-HOA decoding according to the number of the vehicle-mounted loudspeakers; determining NFC-HOA driving functions and VBAP gains of the secondary sound sources according to the positions of the secondary sound sources and the positions of the virtual loudspeakers; and obtaining an audio signal of a target sound field of the user in the vehicle according to the conversion functions of the virtual loudspeakers, the VBAP gains of the secondary sound sources and the NFC-HOA driving functions. Thus, the sound field in the vehicle is reconstructed with the target position of the user in the vehicle as the center of the sound field, the user in the vehicle is located at the center position of the reconstructed sound field in the vehicle, and the quality of the reconstructed sound field in the vehicle is ensured, thereby providing a good user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the technical field of constructing a personal sound field inside a vehicle, and in particular to a method and apparatus for constructing a personal sound field inside a vehicle. Background Technology

[0002] A sound field refers to the region within a medium where sound waves exist. When people hear sound output based on 3D audio technology, they can perceive a clear directional characteristic in the sound, thus providing a more three-dimensional auditory experience. To reproduce the directionality of sound as accurately as possible, sound field reconstruction technology is often used to reconstruct a sound field space that meets the requirements.

[0003] Existing technologies reconstruct sound fields using Vector Based Amplitude Panning (VBAP) technology. Specifically, this sound field reconstruction method first determines the location of a sphere's center, then sets the physical positions of multiple speakers on the same sphere's surface at that center, thereby combining the sound output from multiple speakers into a virtual sound source to achieve sound localization. Alternatively, sound fields can be reconstructed based on derivative technologies of VBAP.

[0004] Existing technologies such as High-Order Ambisonics (HOA) and Near Field Compensation-Higher Order Ambisonics (NFC-HOA) are another technique for reconstructing the sound field. HOA technology is designed for uniformly distributed speaker layouts, but in practice, the sound field reconstruction method suffers from problems such as excessive complexity, spatial aliasing, and limited listening area.

[0005] In higher-quality spatial sound reproduction, virtual sound sources at different distances are also crucial factors for more realistic spatial auditory rendering; therefore, rendering cannot be limited to the direction of the virtual sound source alone. Secondly, in a free-field environment, if a near-field target sound source's sound field can be synthesized in the area near the listener's head, the reflections and scattering from the listener's head and part of their torso can provide the listener with location factors for judging distance, thus achieving a more realistic near-field listening experience. Furthermore, considering that obstacles and enclosed spaces in a vehicle environment also significantly affect the synthesized sound field, limiting the synthesized sound field to a smaller area to a certain extent better approximates the acoustic free-field assumptions in HOA theory.

[0006] In particular, when constructing the in-vehicle sound field, using the vehicle's geometric center as the sound field center to reconstruct the in-vehicle sound field results in poor sound field quality for non-central listening points within the vehicle, leading to a poor user experience. Summary of the Invention

[0007] Based on this, and in response to the aforementioned technical problems, a method and apparatus for constructing a personal sound field inside a vehicle are provided. This method can solve the problem that existing technologies, when constructing a sound field inside a vehicle, use the geometric center of the vehicle as the sound field center to reconstruct the sound field, resulting in poor sound field quality and a poor user experience for non-central listening points inside the vehicle.

[0008] In a first aspect, a method for constructing a personal sound field within a vehicle, the method comprising:

[0009] Obtain the number of vehicle speakers, the location of the vehicle speakers, and the target location of the user inside the vehicle;

[0010] Based on the location of the vehicle speaker and the target location of the user inside the vehicle, determine the location of the virtual speaker and the transformation function of the virtual speaker;

[0011] The location of the secondary sound source in NFC-HOA decoding is determined based on the number of vehicle speakers.

[0012] Based on the location of the secondary sound source and the location of the virtual speaker, determine the NFC-HOA driving function and the VBAP gain of the secondary sound source;

[0013] The audio signal of the target sound field is obtained based on the transformation function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function.

[0014] Optionally, in the above scheme, determining the position of the virtual speaker and the transformation function of the virtual speaker based on the position of the vehicle speaker and the target position of the user inside the vehicle includes:

[0015] Based on the target position of the user inside the vehicle, determine the position of the center point of the audio signal used to obtain the target sound field;

[0016] Construct a virtual sphere with the center point as the center and a preset distance as the radius;

[0017] The position of the vehicle speaker is determined by mapping the position of the vehicle speaker to a point on the virtual sphere.

[0018] The conversion function of the virtual speaker is determined based on the position of the virtual speaker and the position of the vehicle speaker.

[0019] In the above scheme, optionally, the position of the vehicle speaker is mapped to a spherical point on the virtual sphere as the position point of the virtual speaker, including:

[0020] Establish a ray from the center point to the location of the vehicle speaker, and take the intersection point between the ray and the virtual sphere as the location point of the virtual speaker.

[0021] In the above scheme, optionally, the number of vehicle speakers is N, where N is a positive integer and N≥3.

[0022] In the above scheme, optionally, the number of secondary sound sources in the NFC-HOA decoding is equal to the number of vehicle speakers, and N secondary sound sources are evenly distributed on the virtual sphere.

[0023] In the above scheme, optionally further, determining the NFC-HOA driving function and the VBAP gain of the secondary sound source based on the location of the secondary sound source and the location of the virtual speaker includes:

[0024] Based on the location of the secondary sound source and the location of the virtual speaker, the NFC-HOA driving function is obtained through NFC-HOA decoding;

[0025] The VBAP gain of the secondary sound source is obtained using the VBAP algorithm based on the location of the secondary sound source and the location of the virtual speaker.

[0026] In the above scheme, optionally further, obtaining the audio signal of the target sound field based on the transformation function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function includes:

[0027] The conversion function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function are combined to obtain a filter bank;

[0028] The virtual sound source content is filtered and rendered using the filter bank to obtain the audio signal of the target sound field.

[0029] Secondly, an apparatus for constructing a personal sound field within a vehicle, the apparatus comprising:

[0030] The first acquisition module is used to acquire the number of vehicle speakers, the location of the vehicle speakers, and the target location of the user inside the vehicle.

[0031] The first determining module is used to determine the position of the virtual speaker and the conversion function of the virtual speaker based on the position of the vehicle speaker and the target position of the user in the vehicle.

[0032] The second determining module is used to determine the location of the secondary sound source in NFC-HOA decoding based on the number of vehicle speakers;

[0033] The third determining module is used to determine the NFC-HOA driving function and the VBAP gain of the secondary sound source based on the position of the secondary sound source and the position of the virtual speaker;

[0034] The fourth determining module is used to obtain the audio signal of the target sound field based on the conversion function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function.

[0035] Thirdly, a computer device includes a memory and a processor, the memory storing a computer program, the processor executing the computer program to perform the following steps:

[0036] Obtain the number of vehicle speakers, the location of the vehicle speakers, and the target location of the user inside the vehicle;

[0037] Based on the location of the vehicle speaker and the target location of the user inside the vehicle, determine the location of the virtual speaker and the transformation function of the virtual speaker;

[0038] The location of the secondary sound source in NFC-HOA decoding is determined based on the number of vehicle speakers.

[0039] Based on the location of the secondary sound source and the location of the virtual speaker, determine the NFC-HOA driving function and the VBAP gain of the secondary sound source;

[0040] The audio signal of the target sound field is obtained based on the transformation function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function.

[0041] Fourthly, a computer-readable storage medium having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0042] Obtain the number of vehicle speakers, the location of the vehicle speakers, and the target location of the user inside the vehicle;

[0043] Based on the location of the vehicle speaker and the target location of the user inside the vehicle, determine the location of the virtual speaker and the transformation function of the virtual speaker;

[0044] The location of the secondary sound source in NFC-HOA decoding is determined based on the number of vehicle speakers.

[0045] Based on the location of the secondary sound source and the location of the virtual speaker, determine the NFC-HOA driving function and the VBAP gain of the secondary sound source;

[0046] The audio signal of the target sound field is obtained based on the transformation function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function.

[0047] The present invention has at least the following beneficial effects:

[0048] This invention, based on further analysis and research into the problems of existing technologies, recognizes that when constructing an in-vehicle sound field, using the vehicle's geometric center as the sound field center results in poor sound field quality and a poor user experience for non-central listening points within the vehicle. This invention addresses this by acquiring the number and location of the in-vehicle speakers and the target location of the user. Based on these factors, it determines the location and transformation function of virtual speakers. Furthermore, based on the number of in-vehicle speakers, it determines the location of secondary sound sources in NFC-HOA decoding. Based on the locations of the secondary sound sources and virtual speakers, it determines the NFC-HOA driving function and the VBAP gain of the secondary sound sources. Finally, based on the transformation function of the virtual speakers, the VBAP gain of the secondary sound sources, and the NFC-HOA driving function, it obtains the audio signal of the target sound field for the user. This achieves the reconstruction of the in-vehicle sound field with the user's target location as the sound field center, ensuring the user is at the center of the reconstructed sound field and thus guaranteeing high-quality sound field reconstruction and a better user experience. Attached Figure Description

[0049] Figure 1 A schematic diagram illustrating the application environment of a method for constructing a personal sound field inside a vehicle according to an embodiment of the present invention;

[0050] Figure 2 This is a flowchart illustrating a method for constructing a personal sound field inside a vehicle according to an embodiment of the present invention.

[0051] Figure 3 This is a schematic diagram of the target sound field synthesis of a method for constructing an in-vehicle personal sound field according to an embodiment of the present invention;

[0052] Figure 4 A schematic diagram illustrating the framework of a method for constructing a personal sound field inside a vehicle according to an embodiment of the present invention;

[0053] Figure 5 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0054] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0055] The method for constructing a personal sound field inside a vehicle provided in this application can be applied to, for example... Figure 1 The application environment shown.

[0056] In one embodiment, such as Figure 2 As shown, a method for constructing a personal sound field inside a vehicle is provided, which can be applied to... Figure 1 Taking the environment in the example, the following steps are included:

[0057] Obtain the number of vehicle speakers, the location of the vehicle speakers, and the target location of the user inside the vehicle;

[0058] Based on the location of the vehicle speaker and the target location of the user inside the vehicle, determine the location of the virtual speaker and the transformation function of the virtual speaker;

[0059] The location of the secondary sound source in NFC-HOA decoding is determined based on the number of vehicle speakers.

[0060] Based on the location of the secondary sound source and the location of the virtual speaker, determine the NFC-HOA driving function and the VBAP gain of the secondary sound source;

[0061] The audio signal of the target sound field is obtained based on the transformation function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function.

[0062] In one embodiment, sound field synthesis (SFS) technology has gained increasing attention in the field of spatial audio rendering in recent years. The goal of sound field synthesis is to create a desired sound field within a specific area by using multiple speakers working together. Compared to traditional rendering methods (such as stereo), sound field synthesis technology can provide a better spatial auditory experience and offers greater flexibility in speaker arrangement. Over the past few decades, various sound field synthesis methods have been proposed in academia, such as wave field synthesis (WFS), near-field compensated high-order multidimensional sound (NFC-HOA), and spectral division (SDM). Applying these technologies to real-world acoustic scenarios has also garnered increasing attention and discussion. This embodiment primarily explores the use of sound field synthesis technology for audio rendering in an in-vehicle environment, thereby providing passengers with a better spatial experience.

[0063] Compared to the free-field spaces commonly used in academia, the in-vehicle environment is characterized by its narrow spatial range, pronounced near-field effects, and the listener's position being off-center from the geometric center. Furthermore, the in-vehicle scene imposes limitations on the number and arrangement of usable speakers, which affects the application of sound field synthesis technology and the final rendering effect. This embodiment primarily addresses the challenges of the listener's off-center position and irregular speaker arrangement, utilizing sound field synthesis technology to strive for a better spatial auditory rendering experience.

[0064] The sound field synthesis problem can be expressed by the following formula. Assume an n-dimensional spatial range. Within V, the field is free, meaning it does not contain sound sources or other obstructions. On the surface of V... Deploying several monopole loudspeaker sound sources, also known as secondary sound sources, such as... Figure 1 As shown.

[0065] Therefore, the sound pressure at a point x∈V within V can be expressed as:

[0066]

[0067] Where ω is the angular frequency, and G(x-x0,ω) represents the frequency from... The point propagation function, D(x0,ω), represents the weighting function, often referred to as the driving function. Therefore, the goal of the sound field synthesis problem is transformed into solving for the weighting function D(x0,ω) of the secondary sound source at each position x0 for the desired sound field P.

[0068] The variables in formula (1) can be expanded into a Fourier series with respect to the horizontal azimuth angle, thus obtaining:

[0069] P m (r,ω)=2πRD m (R,ω)G m (r,ω) (2)

[0070] Where r and R represent the distances from the virtual sound source and secondary sound source to the listener's location, respectively, and P... m (r,ω) represents the Fourier coefficients of the synthesized sound field P(x,ω) with respect to the horizontal angle α, i.e. The driving function D(α,ω) for the synthesized target sound field S(x,ω) can be expressed as:

[0071]

[0072] S m (r,ω) and G m (r,ω) are the Fourier expansion coefficients of the corresponding function at the horizontal angle α. Unlike a conventional HOA, in an NFC-HOA, G... m (r,ω) is the propagation function of the point sound source, thus compensating for the near-field environment. After further restricting the secondary sound source to an isoangular sampling distribution, Equation 2-2 can be further simplified to:

[0073]

[0074] Among these, after defining the secondary sound source as having an isoangular sampling distribution and the listener as the geometric center of the secondary sound source, the point sound source D is then considered. m (ω) can be expressed as

[0075]

[0076] Let θ represent the second kind of m-order spherical Hankel function. ps and rps These represent the propagation angle and distance of the secondary sound source relative to the virtual sound source, respectively. From formulas (2) to (5), we can obtain the synthesized sound field of the NFC-HOA for the listener's head area. However, its limitations are: the secondary sound source is equiangularly sampled on the circumference; the listener's position is the geometric center of the circumference of the secondary sound source, which cannot be directly satisfied in the vehicle's interior space. Therefore, we will use VBAP technology to simulate a virtual secondary sound source that meets the requirements.

[0077] In one embodiment, determining the location of the virtual speaker and the transformation function of the virtual speaker based on the location of the in-vehicle speaker and the target location of the user in the vehicle includes:

[0078] Based on the target position of the user inside the vehicle, determine the position of the center point of the audio signal used to obtain the target sound field;

[0079] Construct a virtual sphere with the center point as the center and a preset distance as the radius;

[0080] The position of the vehicle speaker is determined by mapping the position of the vehicle speaker to a point on the virtual sphere.

[0081] Based on the positions of the virtual speaker and the vehicle-mounted speaker, a transfer function for the virtual speaker is determined. This transfer function from the vehicle-mounted speaker to the virtual speaker can be calculated using a distance function, such as linear or logarithmic sound decay with distance. A more precise approach is to pre-measure the room impulse response between the two locations to determine the transfer function.

[0082] In one embodiment, such as Figure 1As shown, sound field reconstruction is performed using in-vehicle speakers in a spherical region centered on the passenger's head, creating a personalized sound field for the passenger and enhancing the spatial audio experience. In the following diagram, A, B, C, and D represent four in-vehicle speakers, the origin represents the passenger's head position, and the dashed circle represents the spherical region for reconstructing the sound field. A', B', C', and D' represent the projections of speakers A, B, C, and D onto the sphere, i.e., the corresponding virtual speaker positions. This scheme includes two signal processing paths: First, based on the target position of the virtual sound sources, NFC-HOA decoding is performed within the spherical region using the number of speakers, the positions of secondary sources, and the reconstructed sound field radius to obtain the driving function. Second, the transfer function of the corresponding speaker is measured at the speaker projection position to obtain the response function of the corresponding virtual speaker. Finally, VBAP and the virtual speaker group are used to perform amplitude translation on the secondary sources in the NFC-HOA decoding, thereby completing the sound field reconstruction of the passenger's head region.

[0083] In one embodiment, such as Figure 4 As shown, firstly, at the target passenger location, the position information of the virtual speaker relative to the center of the reconstructed sound field, as well as the virtual speaker transformation function, are measured based on the corresponding speaker positions in the vehicle. Simultaneously, the positions of the same number of secondary sound sources in the NFC-HOA decoding are determined based on the number of in-vehicle speakers. Here, the secondary sound sources can be uniformly arranged on the reconstructed sound field sphere, thereby reducing the error caused by the non-uniform arrangement of in-vehicle speakers in the HOA decoding at this stage. Based on the target positions of the secondary and virtual sound sources, a driving function can be obtained through decoding, which is used to filter the virtual sound source content. Then, based on the virtual speaker positions and secondary sound source positions, the gain of representing the secondary sound sources using the virtual speaker group is obtained using the VBAP algorithm. Finally, the virtual speaker transformation function, VBAP gain, and NFC-HOA driving function are combined to form a filter bank, which is used to filter and render the virtual sound source content, thereby obtaining the audio representation of the reconstructed sound field.

[0084] One advantage of this signal processing method is that once the speaker positions in the vehicle are determined, they will not move, and the passenger seating positions are also relatively fixed. Therefore, the virtual speaker conversion function, virtual speaker positions, and secondary sound source positions do not change. Thus, the conversion function and VBAP gain can be obtained in advance for different passenger positions. Only the HOA drive function needs to be calculated in real time, thereby reducing the real-time computational burden on the onboard computer.

[0085] In one embodiment, mapping the position of the vehicle speaker to a spherical point on the virtual sphere as the position point of the virtual speaker includes:

[0086] Establish a ray from the center point to the location of the vehicle speaker, and take the intersection point between the ray and the virtual sphere as the location point of the virtual speaker.

[0087] In one embodiment, the number of vehicle speakers is N, where N is a positive integer and N≥3.

[0088] In one embodiment, the number of secondary sound sources in the NFC-HOA decoding is equal to the number of vehicle speakers, and N secondary sound sources are evenly distributed on the virtual sphere.

[0089] In one embodiment, determining the NFC-HOA driving function and the VBAP gain of the secondary sound source based on the location of the secondary sound source and the location of the virtual speaker includes:

[0090] Based on the location of the secondary sound source and the location of the virtual speaker, the NFC-HOA driving function is obtained through NFC-HOA decoding;

[0091] The VBAP gain of the secondary sound source is obtained using the VBAP algorithm based on the location of the secondary sound source and the location of the virtual speaker.

[0092] In one embodiment, obtaining the audio signal of the target sound field based on the transformation function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function includes:

[0093] The conversion function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function are combined to obtain a filter bank;

[0094] The virtual sound source content is filtered and rendered using the filter bank to obtain the audio signal of the target sound field.

[0095] This embodiment obtains the number and location of the vehicle speakers and the target location of the user inside the vehicle. Based on the locations of the vehicle speakers and the target location of the user, it determines the location and transformation function of the virtual speakers. Based on the number of vehicle speakers, it determines the location of the secondary sound source in NFC-HOA decoding. Based on the location of the secondary sound source and the location of the virtual speakers, it determines the NFC-HOA driving function and the VBAP gain of the secondary sound source. Based on the transformation function of the virtual speakers, the VBAP gain of the secondary sound source, and the NFC-HOA driving function, it obtains the audio signal of the target sound field for the user inside the vehicle. This achieves the reconstruction of the in-vehicle sound field with the target location of the user inside the vehicle as the sound field center, ensuring that the user is located at the center of the reconstructed in-vehicle sound field, thus guaranteeing the quality of the reconstructed in-vehicle sound field and providing a good user experience.

[0096] In this embodiment, the passenger's actual position coincides with the sweet spot position, theoretically resulting in better rendering. By measuring the room impulse response function of each speaker on the individual sound field sphere, the influence of the in-vehicle environment on the sound field can be obtained more accurately, thereby further improving the rendering effect. This approach has lower requirements for the number and layout of speakers. The actual passenger position is the target position of the user inside the vehicle.

[0097] It should be understood that, although Figure 2 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated in this embodiment, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Furthermore, Figure 2 At least some of the steps in the process may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but may be executed at different times. The execution order of these steps or stages is not necessarily sequential, but may be executed in turn or alternately with other steps or at least some of the steps or stages in other steps.

[0098] In one embodiment, an apparatus for constructing a personal sound field inside a vehicle is provided, including the following program modules: a first acquisition module, used to acquire the number of vehicle speakers, the position of the vehicle speakers, and the target position of the user inside the vehicle;

[0099] The first determining module is used to determine the position of the virtual speaker and the conversion function of the virtual speaker based on the position of the vehicle speaker and the target position of the user in the vehicle.

[0100] The second determining module is used to determine the location of the secondary sound source in NFC-HOA decoding based on the number of vehicle speakers;

[0101] The third determining module is used to determine the NFC-HOA driving function and the VBAP gain of the secondary sound source based on the position of the secondary sound source and the position of the virtual speaker;

[0102] The fourth determining module is used to obtain the audio signal of the target sound field based on the conversion function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function.

[0103] Specific limitations regarding the device for constructing a personal sound field within a vehicle can be found in the limitations of the method for constructing a personal sound field within a vehicle described above, and will not be repeated here. Each module in the aforementioned device for constructing a personal sound field within a vehicle can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in hardware or independently of the processor in a computer device, or stored in software in the memory of a computer device, so that the processor can call and execute the corresponding operations of each module.

[0104] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 5 As shown, the computer device includes a processor, memory, communication interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, carrier networks, NFC (Near Field Communication), or other technologies. When executed by the processor, the computer program implements a method for constructing a personal sound field within the vehicle. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the device's casing, or an external keyboard, touchpad, or mouse.

[0105] Those skilled in the art will understand that Figure 5 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0106] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program relating to all or part of the processes in the methods of the above embodiments.

[0107] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon relating to all or part of the processes in the methods of the above embodiments.

[0108] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the methods described above. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical storage, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0109] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0110] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A method for constructing a personal sound field inside a vehicle, characterized in that, The method includes: Obtain the number of vehicle speakers, the location of the vehicle speakers, and the target location of the user inside the vehicle; Based on the location of the vehicle-mounted speaker and the target location of the user inside the vehicle, the location of the virtual speaker and the transformation function of the virtual speaker are determined; the number of vehicle-mounted speakers is N, where N is a positive integer and N≥3; The location of the secondary sound source in NFC-HOA decoding is determined based on the number of vehicle speakers. Based on the location of the secondary sound source and the location of the virtual speaker, determine the NFC-HOA driving function and the VBAP gain of the secondary sound source; The audio signal of the target sound field is obtained based on the conversion function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function. The step of determining the virtual speaker position and the virtual speaker conversion function based on the position of the vehicle speaker and the target position of the user inside the vehicle includes: Based on the target position of the user inside the vehicle, determine the position of the center point of the audio signal used to obtain the target sound field; Construct a virtual sphere with the center point as the center and a preset distance as the radius; The position of the vehicle speaker is determined by mapping the position of the vehicle speaker to a point on the virtual sphere. The transformation function of the virtual speaker is determined based on the position of the virtual speaker and the position of the vehicle speaker; In the NFC-HOA decoding, the number of secondary sound sources is equal to the number of vehicle speakers, and N secondary sound sources are evenly distributed on the virtual sphere. The step of determining the NFC-HOA driving function and the VBAP gain of the secondary sound source based on the location of the secondary sound source and the location of the virtual speaker includes: Based on the location of the secondary sound source and the location of the virtual speaker, the NFC-HOA driving function is obtained through NFC-HOA decoding; The VBAP gain of the secondary sound source is obtained using the VBAP algorithm based on the location of the secondary sound source and the location of the virtual speaker.

2. The method according to claim 1, characterized in that, Mapping the position of the vehicle speaker onto a spherical point on the virtual sphere as the virtual speaker's position point includes: Establish a ray from the center point to the location of the vehicle speaker, and take the intersection point between the ray and the virtual sphere as the location point of the virtual speaker.

3. The method according to claim 1, characterized in that, The step of obtaining the audio signal of the target sound field based on the transformation function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function includes: The conversion function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function are combined to obtain a filter bank; The virtual sound source content is filtered and rendered using the filter bank to obtain the audio signal of the target sound field.

4. A device for constructing a personal sound field inside a vehicle, characterized in that, The device includes: The first acquisition module is used to acquire the number of vehicle speakers, the location of the vehicle speakers, and the target location of the user inside the vehicle. The first determining module is used to determine the position of the virtual speaker and the conversion function of the virtual speaker based on the position of the vehicle speaker and the target position of the user in the vehicle. The second determining module is used to determine the location of the secondary sound source in NFC-HOA decoding based on the number of vehicle speakers; the number of vehicle speakers is N, where N is a positive integer and N≥3; The third determining module is used to determine the NFC-HOA driving function and the VBAP gain of the secondary sound source based on the position of the secondary sound source and the position of the virtual speaker; The fourth determining module is used to obtain the audio signal of the target sound field based on the conversion function of the virtual loudspeaker, the VBAP gain of the secondary sound source, and the NFC-HOA driving function; The step of determining the virtual speaker position and the virtual speaker conversion function based on the position of the vehicle speaker and the target position of the user inside the vehicle includes: Based on the target position of the user inside the vehicle, determine the position of the center point of the audio signal used to obtain the target sound field; Construct a virtual sphere with the center point as the center and a preset distance as the radius; The position of the vehicle speaker is determined by mapping the position of the vehicle speaker to a point on the virtual sphere. The transformation function of the virtual speaker is determined based on the position of the virtual speaker and the position of the vehicle speaker; In the NFC-HOA decoding, the number of secondary sound sources is equal to the number of vehicle speakers, and N secondary sound sources are evenly distributed on the virtual sphere. The step of determining the NFC-HOA driving function and the VBAP gain of the secondary sound source based on the location of the secondary sound source and the location of the virtual speaker includes: Based on the location of the secondary sound source and the location of the virtual speaker, the NFC-HOA driving function is obtained through NFC-HOA decoding; The VBAP gain of the secondary sound source is obtained using the VBAP algorithm based on the location of the secondary sound source and the location of the virtual speaker.

5. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 3.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 3.

Citation Information

Patent Citations

  • Three-channel non-central point sound field reconstruction method, equipment, storage medium and device

    CN109587619A

  • System and method for performing panning for an arbitrary loudspeaker setup

    US20190104364A1

  • KR20200128685A