Sound transmission method and device and non-volatile computer readable storage medium
Patent Information
- Application Number
- CN202380034960.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-19
- Filing Date
- 2023-04-18
- Publication Date
- 2024-12-06
AI Technical Summary
In complex environments, it is difficult for existing technologies to accurately simulate the transmission phenomenon of sound. Especially in multi-media buildings or virtual scenes, the transmission, refraction and reflection phenomena of sound are complex, resulting in unrealistic simulation effects.
Through sound ray tracing technology and analysis of ray intersection points, a sound transmission model is constructed to estimate the sound transmission on the wall, and 3D spatial audio calculations are performed to simulate the sound propagation route and the sound received by the listener.
It achieves high-fidelity simulation of sound transmission phenomena, solves the comprehensive simulation problem of sound propagation and refraction in complex environments, and is suitable for application scenarios such as games and music.
Smart Images

Figure CN119096121A_ABST
Abstract
Description
Sound transmission method, device and non-volatile computer readable storage medium
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application is based on and claims priority to PCT application number PCT / CN2022 / 087680, filed on April 19, 2022. The disclosed content of the PCT application is hereby incorporated into this application as a whole. Technical Field
[0003] The present disclosure relates to the field of audio processing technology, and in particular to a sound transmission method, device, and non-volatile computer-readable storage medium. Background Art
[0004] Sound can travel not only through air but also through objects. The ability of sound to penetrate objects varies depending on the physical properties of the object. When sound travels through air and encounters an object, it can experience reflection, diffraction, and transmission.
[0005] The essence of sound transmission lies in the ability of sound to propagate through a medium and its refraction. Sound can propagate through various media, the most common of which is air (which is also a medium). Furthermore, the speed of sound propagation in different media varies. At standard atmospheric pressure, the speed of sound in air is 340 m / s, in water it is 1500 m / s, and in steel it is 5200 m / s. Figure 1 shows the sound tube experiment, a visual experiment demonstrating the perception of sound propagation.
[0006] When sound waves propagate from one medium to another, they change direction. Part of this change is refracted. This refraction is most pronounced when passing through a medium with gradually changing properties. It is also affected by the different propagation velocities v1 and v2 of sound in different media. Furthermore, the refraction of sound waves is related to the angle of incidence θ1 at which the sound enters the medium, as shown in Figure 2.
[0007] In complex real-world environments, buildings or virtual scenes can be complex and composed of multiple media, each with different transmission coefficients and refractive indices. This can lead to very complex transmission phenomena. Figure 3 shows a simplified sound propagation simulation process for transmission.
[0008] As shown in Figure 3, there is a wall between the sound-emitting device and the listener, so the sound does not reach the listener directly. The sound emitted by the sound-emitting device will reach the listener through the blocking wall; at the same time, the sound will also reach the wall, propagate in the wall, and then reach the listener; or the sound will be reflected and then transmitted to reach the listener.
[0009] In environmental acoustic simulation, in order to accurately simulate these acoustic characteristics, it is necessary to model the phenomenon and nature of sound to achieve accurate simulation of acoustic phenomena.
[0010] Summary of the Invention
[0011] According to some embodiments of the present disclosure, a sound transmission method is provided, comprising: determining a set of intersection points between a plurality of rays emitted in all directions from a sound source and a wall of a building; estimating a sound transmission model of the building based on the set of intersection points; and estimating the transmission of sound emitted by the sound source through the wall using the sound transmission model.
[0012] In some embodiments, the intersection point set includes the intersection points of the direct sound and the environmental obstructions, and the sound transmission method further includes determining whether there is direct sound in the building by sound ray tracing; if not, determining that the direct sound is blocked by the environmental obstructions in the building; and calculating the intersection points of the direct sound and the environmental obstructions.
[0013] In some embodiments, determining whether there is direct sound includes determining whether the listener's position in the building can receive the direct sound emitted by the sound source.
[0014] In some embodiments, estimating the sound transmission model based on the set of intersection points includes: estimating the center, length, width and height of the sound transmission model based on the set of intersection points.
[0015] In some embodiments, using the sound transmission model to estimate the transmission of the sound emitted by the sound source in the wall includes: determining the direct transmission wall and the side projection wall in the sound transmission model based on the directions of the multiple rays according to the sound transmission model, the position information of the sound source in the sound transmission model, and the position information of the listener in the sound transmission model; calculating the intersection point set of the side of the sound source in the sound transmission model according to the sound transmission model and the direction of the sound source; and performing 3D spatial audio calculation based on the intersection point set.
[0016] In some embodiments, the direct transmission wall includes the wall of the environmental obstruction in the sound transmission model, and the side projection wall includes the wall other than the environmental obstruction in the sound transmission model; the side includes the direct transmission wall and the side projection wall; the direction of the sound source includes the direction of the ray from the sound source to the listener; the projection point in the intersection point set is determined according to the intersection of the ray from the sound source to the listener and the side and the intersection of the direct sound emitted by the sound source and the direct transmission wall.
[0017] In some embodiments, performing 3D spatial audio calculation based on the intersection point set includes: calculating qualified transmission points in the intersection point set based on the dot product of the vector formed by the sound source and the intersection point in the intersection point set and the vector formed by the sound source and the listener; and performing 3D spatial audio calculation based on the qualified transmission points.
[0018] In some embodiments, performing 3D spatial audio calculation based on the qualified transmission points includes: calculating a set of overall spatial impulse responses based on the qualified transmission points; and performing 3D spatial audio calculation based on the set of overall spatial impulse responses.
[0019] In some embodiments, the vector formed by the sound source and the listener is a first vector, the vector formed by the sound source and the intersection point in the intersection point set is a second vector, and calculating the qualified transmission point in the intersection point set includes: determining the intersection point corresponding to the second vector whose dot product with the first vector is greater than 0 as the qualified transmission point. In some embodiments, the set of spatial impulse responses includes the intersection points of rays reaching the listener via reflection from the side-projection wall and the side-projection wall.
[0020] In some embodiments, performing 3D spatial audio calculation based on the intersection point set includes: simulating the sound received by the listener through the 3D spatial audio calculation.
[0021] In some embodiments, the simulation of the sound received by the listener through the 3D spatial audio calculation includes: generating a propagation path for the sound corresponding to the ray emitted by the sound source to reach the listener based on the intersection lines between multiple transmissive walls of the building and the intersection points of the ray emitted by the sound source and any one of the multiple transmissive walls, the multiple transmissive walls including the direct transmissive wall and the side projection wall; and simulating the sound received by the listener according to the propagation path.
[0022] According to other embodiments of the present disclosure, a sound transmission device is provided, comprising: a determination unit for determining, based on a plurality of rays emitted in all directions from a sound source, a set of intersection points between the plurality of rays and a wall of a building; and an estimation unit for estimating a sound transmission model of the building based on the set of intersection points, and using the sound transmission model, estimating the transmission of sound emitted by the sound source through the wall.
[0023] In some embodiments, the sound transmission device further includes: a judgment unit for judging whether there is direct sound in the building by sound ray tracing; the determination unit, if not, determines that the direct sound is blocked by environmental obstructions in the building, calculates the intersection of the direct sound and the environmental obstruction, and the intersection set includes the intersection of the direct sound and the environmental obstruction.
[0024] In some embodiments, the estimation unit estimates the center, length, width and height of the sound transmission model based on the set of intersection points.
[0025] In some embodiments, the estimation unit determines the direct transmission wall and the side projection wall in the sound transmission model based on the directions of the multiple rays according to the sound transmission model, the position information of the sound source in the sound transmission model, and the position information of the listener in the sound transmission model, calculates the intersection point set of the side of the sound source in the sound transmission model according to the sound transmission model and the direction of the sound source, and performs 3D spatial audio calculation based on the intersection point set.
[0026] In some embodiments, the estimation unit calculates qualified transmission points in the intersection point set based on the dot product of the vector formed by the sound source and the intersection point in the intersection point set and the vector formed by the sound source and the listener, and performs 3D spatial audio calculation based on the qualified transmission points.
[0027] In some embodiments, the estimation unit calculates a set of overall spatial impulse responses according to the transmission points that meet the conditions, and performs 3D spatial audio calculation according to the set of overall spatial impulse responses.
[0028] According to some further embodiments of the present disclosure, there is provided an acoustic transmission device, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the acoustic transmission method described in any of the above embodiments based on instructions stored in the memory device.
[0029] According to some further embodiments of the present disclosure, a non-volatile computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the sound transmission method described in any of the above embodiments is implemented.
[0030] According to some embodiments of the present disclosure, a computer program is further provided, comprising: instructions, which, when executed by a processor, cause the processor to perform the sound transmission method according to any one of the above embodiments.
[0031] According to some embodiments of the present disclosure, a computer program product is further provided, comprising instructions, which, when executed by a processor, cause the processor to perform the sound transmission method according to any one of the above embodiments.
[0032] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] The drawings described herein are used to provide a further understanding of the present disclosure and constitute a part of this application. The illustrative embodiments of the present disclosure and their descriptions are used to explain the present disclosure and do not constitute an improper limitation of the present disclosure. In the drawings:
[0034] FIG1 shows a schematic diagram of a listening tube experiment;
[0035] FIG2 is a schematic diagram showing the refraction of sound waves;
[0036] FIG3 is a schematic diagram showing a simulation process of transmitted sound propagation;
[0037] FIG4 a shows a flow chart of some embodiments of the insonification method according to the present disclosure;
[0038] FIG4 b shows a block diagram of some embodiments of the sound transmission device of the present disclosure;
[0039] FIG5 is a block diagram showing some other embodiments of the sound transmission device disclosed herein;
[0040] FIG6 shows a block diagram of some further embodiments of the sound transmission device of the present disclosure. DETAILED DESCRIPTION
[0041] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. The following description of at least one exemplary embodiment is actually only illustrative and is in no way intended to limit the present disclosure and its application or use. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present disclosure.
[0042] Unless otherwise specifically stated, the relative arrangement of the parts and steps, the numerical expressions and the numerical values set forth in these embodiments do not limit the scope of the present disclosure. At the same time, it should be understood that, for ease of description, the sizes of the various parts shown in the drawings are not drawn according to actual proportional relationships. The techniques, methods and equipment known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, the techniques, methods and equipment should be considered as part of the authorization specification. In all examples shown and discussed herein, any specific values should be interpreted as being merely exemplary and not as limitations. Therefore, other examples of the exemplary embodiments may have different values. It should be noted that similar numbers and letters represent similar items in the following figures, and therefore, once an item is defined in one figure, it does not need to be further discussed in subsequent figures.
[0043] In environmental acoustics simulations, sound transmission is influenced by a variety of factors, including sound pressure, building materials, thickness, and spatial geometry. Accurately simulating sound transmission is a complex and challenging technical problem. Industry research focuses on the impact of building materials and geometric design on sound transmission. Environmental acoustics simulations primarily simulate direct sound transmission, but struggle to comprehensively simulate sound propagation and refraction within objects (different building materials and geometric shapes can affect sound transmission).
[0044] The present invention uses sound ray tracing technology and the intersection of sound rays and object surfaces to form a point cloud of intersections, and reconstructs regular geometric buildings through these point clouds; then, through the transmission and refraction characteristics of sound and the transmission coefficient of buildings, it simulates the process of sound propagation and transmission in objects.
[0045] FIG4 a shows a flow chart of some embodiments of an insonification method according to the present disclosure.
[0046] As shown in Figure 4a, sound ray tracing is used to determine whether there is direct sound (Direct Sound Ray) from the sound source at the listener; if not, it is determined that the direct sound is blocked by an obstruction in the physical scene, and the intersection point i of the direct sound and the obstruction is calculated. direct .
[0047] With the sound source as the center, N rays are emitted to the surroundings, and the intersection point set of these rays is I = {i0,i1,…,i k ,i M}.
[0048] Estimate the AABB model center {x center ,y center ,z center} and length L, width W, and height H. For example, the AABB model can be a shoebox model.
[0049] According to the AABB model, the position information of the sound source and the listener, and the direction of each ray, find the direct transmission wall f face and side projection wall f side .
[0050] According to the AABB model and the direction of the sound source, the following formula is used to calculate the intersection point set of the ray on each side:
[0051] Based on the dot product of the vector formed by the intersection point of the wall and the sound source and the vector between the sound source and the listener, the point that meets the conditions is calculated using the following formula, which is the transmission point:
[0052] in, They represent the vector formed by the sound source and the listener and the vector formed by the sound source and the intersection point, respectively. ′ For example, the vector formed by the sound source and the listener is the first vector, and the vector formed by the sound source and the intersection point in the intersection point set is the second vector. The intersection points corresponding to the second vector whose dot product with the first vector is greater than 0 are determined as the transmission points that meet the conditions.
[0053] Through these qualified transmission points, the spatial impulse response set R from the sound source to the transmission point and then to the listener is calculated. H′ , and add the set to the overall spatial impulse response: R = R r ∪R H′
[0054] Among them, R r is the spatial impact response set of the sound reflection process, R H′ is the spatial impulse response set of sound transmission, and R is the total spatial impulse response set. For example, the spatial impulse response set of the sound reflection process includes the intersection of the ray reaching the listener through the reflection of the side projection wall and the side projection wall.
[0055] Perform 3D spatial audio calculations based on the response set calculations.
[0056] In some embodiments, based on multiple rays emitted in all directions from the sound source, a set of intersection points between the multiple rays and the wall of the building is determined; and based on the set of intersection points, a sound transmission model of the building is estimated.
[0057] For example, as shown in FIG4a , in the case of side transmission, that is, the sound emitted by the sound source is transmitted to the listener through the side-projecting wall, the intersection points of all rays emitted by the sound source and each wall are calculated using a point cloud. A shoebox model is estimated based on the intersection points of the rays calculated by the point cloud and the building. Based on the estimated shoebox model, the wall in the transmission direction is found using the vector formed by the spatial positions of the sound source and the listener. Based on the intersection line between the transmission walls and the point on it (such as the midpoint), a ray is emitted from the sound source to the intersection point of the wall and then transmitted to the listener.
[0058] For example, based on the intersection lines between multiple transmissive walls and the intersection points of the rays emitted by the sound source and any one of the multiple transmissive walls, a propagation path for the sound corresponding to the rays emitted by the sound source to reach the listener is generated, where the multiple transmissive walls include direct transmissive walls and side projection walls; based on the propagation path, the sound received by the listener is simulated.
[0059] In some embodiments, sound ray tracing is used to determine whether there is direct sound in a building, for example, to determine whether a listener's position in the building can receive the direct sound emitted by the sound source.
[0060] In some embodiments, if no, it is determined that the direct sound is blocked by an ambient blocker in the building; and an intersection point between the direct sound and the ambient blocker is calculated. For example, the intersection point set may include the intersection point between the direct sound and the ambient blocker.
[0061] For example, as shown in Figure 4a, in the case of frontal transmission, that is, the sound emitted by the sound source is transmitted to the listener through the direct transmission wall, it is determined whether the direct sound is blocked by the physical scene (environmental obstructions) in the building; if so, the intersection of the ray corresponding to the direct sound and the physical scene is calculated; if not, it is processed through a spatialization algorithm.
[0062] In some embodiments, according to the sound transmission model, the position information of the sound source in the sound transmission model, and the position information of the listener in the sound transmission model, based on the directions of multiple rays, the direct transmission wall and the side projection wall in the sound transmission model are determined; according to the sound transmission model and the direction of the sound source, the intersection point set of the side of the sound source in the sound transmission model is calculated; and based on the intersection point set, 3D spatial audio calculation is performed.
[0063] For example, the direct transmission wall includes the wall of the environmental obstruction in the sound transmission model, and the side projection wall includes the wall other than the environmental obstruction in the sound transmission model; the side includes the direct transmission wall and the side projection wall; the direction of the sound source includes the direction of the ray from the sound source to the listener; the intersection point in the intersection point set is determined according to the intersection point of the ray from the sound source to the listener and the side and the intersection point of the direct sound emitted by the sound source and the direct transmission wall.
[0064] In some embodiments, a sound transmission model is used to estimate the transmission of sound emitted by a sound source through a wall, for example, by performing 3D spatial audio calculations to simulate the sound received by a listener.
[0065] For example, as shown in Figure 4a, spatial processing of the transmitted sound is performed based on the rays and intersection points determined during side and frontal transmission to simulate the sound heard by the listener. Energy attenuation is calculated based on the physical absorption, scattering, and transmission coefficients corresponding to the intersection points; frequency division processing is performed; high-frequency component removal is performed; and spatialization algorithms are used.
[0066] This disclosure proposes the estimation of the sound transmission model: sound ray tracing and shoebox model estimation; proposes the estimation of wall transmission using the shoebox model; and proposes an overall sound transmission model framework.
[0067] The present invention reconstructs a complex spatial geometric building through a sound ray tracing method; then, by modeling sound transmission on a shoebox geometric model, the direct transmitted sound and the transmitted and refracted sound of walls and geometric objects in the sound transmission process are simulated.
[0068] This achieves a highly realistic simulation of the sound transmission phenomenon in environmental acoustics, and effectively solves the technical problem of simulating complex environmental sound transmission effects in applications such as gaming and music.
[0069] FIG4 b shows a block diagram of an acoustic transmission device according to some embodiments of the present disclosure.
[0070] As shown in FIG4b , the sound transmission device 4 includes: a determination unit 41 for determining a set of intersection points between a plurality of rays emitted in all directions from a sound source and a wall of a building; and an estimation unit 42 for estimating a sound transmission model of the building based on the set of intersection points, and using the sound transmission model to estimate the transmission of the sound emitted by the sound source through the wall.
[0071] In some embodiments, the sound transmission device 4 further includes: a judgment unit 43, used to determine whether there is direct sound in the building through sound ray tracing; the determination unit 41, if not, determines that the direct sound is blocked by environmental obstructions in the building, calculates the intersection of the direct sound and the environmental obstruction, and the intersection set includes the intersection of the direct sound and the environmental obstruction.
[0072] For example, the judgment unit 43 judges whether the position of the listener in the building can receive the direct sound emitted by the sound source.
[0073] In some embodiments, the estimation unit 42 estimates the center, length, width, and height of the sound transmission model based on the intersection point set.
[0074] In some embodiments, the estimation unit 42 determines the direct transmission wall and the side projection wall in the sound transmission model based on the directions of the multiple rays according to the sound transmission model, the position information of the sound source in the sound transmission model, and the position information of the listener in the sound transmission model. According to the sound transmission model and the direction of the sound source, the estimation unit 42 calculates the intersection point set of the side of the sound source in the sound transmission model, and performs 3D spatial audio calculation based on the intersection point set.
[0075] For example, the direct transmission wall includes the wall of the environmental obstruction in the sound transmission model, and the side projection wall includes the wall other than the environmental obstruction in the sound transmission model; the side includes the direct transmission wall and the side projection wall; the direction of the sound source includes the direction of the ray from the sound source to the listener; the projection point in the intersection point set is determined according to the intersection of the ray from the sound source to the listener and the side and the intersection of the direct sound emitted by the sound source and the direct transmission wall.
[0076] In some embodiments, the estimation unit 42 calculates qualified transmission points in the intersection point set based on the dot product of the vector formed by the sound source and the intersection point in the intersection point set and the vector formed by the sound source and the listener, and performs 3D spatial audio calculation based on the qualified transmission points.
[0077] For example, the vector formed by the sound source and the listener is a first vector, and the vector formed by the sound source and the intersection point in the intersection point set is a second vector. The estimation unit 42 determines the intersection point corresponding to the second vector whose dot product with the first vector is greater than 0 as the qualified transmission point.
[0078] In some embodiments, the estimation unit 42 calculates a set of overall spatial impulse responses according to the transmission points that meet the conditions, and performs 3D spatial audio calculation according to the set of overall spatial impulse responses.
[0079] For example, the set of spatial impulse responses includes intersections of rays reaching the listener through reflection from the side-projection wall and the side-projection wall.
[0080] In some embodiments, the estimation unit 42 simulates the sound received by the listener through the 3D spatial audio calculation.
[0081] In some embodiments, the estimation unit 42 generates a propagation path for the sound corresponding to the ray emitted by the sound source to reach the listener based on the intersection lines between multiple transmissive walls of the building and the intersection points of the ray emitted by the sound source and any one of the multiple transmissive walls, wherein the multiple transmissive walls include the direct transmissive wall and the side projection wall; and simulates the sound received by the listener based on the propagation path.
[0082] FIG5 shows a block diagram of some other embodiments of the sound transmission device of the present disclosure.
[0083] As shown in FIG5 , the acoustic transmission device 5 of this embodiment includes a memory 51 and a processor 52 coupled to the memory 51 . The processor 52 is configured to execute the acoustic transmission method of any one of the embodiments of the present disclosure based on instructions stored in the memory 51 .
[0084] The memory 51 may include, for example, a system memory, a fixed non-volatile storage medium, etc. The system memory may store, for example, an operating system, an application program, a boot loader, a database, and other programs.
[0085] FIG6 shows a block diagram of some further embodiments of the sound transmission device of the present disclosure.
[0086] As shown in FIG6 , the acoustic transmission device 6 of this embodiment includes a memory 610 and a processor 620 coupled to the memory 610 . The processor 620 is configured to execute the acoustic transmission method of any of the aforementioned embodiments based on instructions stored in the memory 610 .
[0087] The memory 610 may include, for example, a system memory, a fixed non-volatile storage medium, etc. The system memory may store, for example, an operating system, application programs, a boot loader, and other programs.
[0088] The sound transmission device 6 may also include an input / output interface 630, a network interface 640, a storage interface 650, and the like. These interfaces 630, 640, 650, as well as the memory 610 and the processor 620, may be connected, for example, via a bus 660. The input / output interface 630 provides a connection interface for input / output devices such as a display, mouse, keyboard, touch screen, microphone, and speakers. The network interface 640 provides a connection interface for various networked devices. The storage interface 650 provides a connection interface for external storage devices such as SD cards and USB flash drives.
[0089] According to some embodiments of the present disclosure, a computer program comprises: instructions, which, when executed by a processor, cause the processor to perform the sound transmission method according to any one of the above embodiments.
[0090] According to some embodiments of the present disclosure, a computer program product comprises instructions, which, when executed by a processor, cause the processor to perform the sound transmission method according to any one of the above embodiments.
[0091] Those skilled in the art will appreciate that embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present disclosure may take the form of a computer program product implemented on one or more computer-usable non-transient storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0092] So far, the present invention has been described in detail. In order to avoid obscuring the concept of the present invention, some details well known in the art have not been described. Based on the above description, those skilled in the art can fully understand how to implement the technical solutions disclosed herein.
[0093] The methods and systems of the present disclosure may be implemented in many ways. For example, the methods and systems of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above order of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above unless otherwise specified. In addition, in some embodiments, the present disclosure may also be implemented as programs recorded in a recording medium, which include machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers recording media that store programs for executing the methods according to the present disclosure.
[0094] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art will appreciate that the above examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Those skilled in the art will appreciate that modifications may be made to the above embodiments without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.
Claims
1. A sound transmission method, comprising: Determine, based on a plurality of rays emitted in all directions from a sound source as a center, a set of intersection points between the plurality of rays and a wall of a building; estimating a sound transmission model of the building according to the intersection point set; The sound transmission model is used to estimate the transmission condition of the sound emitted by the sound source in the wall.
2. The sound transmission method according to claim 1, wherein the intersection point set includes intersection points of direct sound and environmental obstructions in the building, The insonification method further comprises: By tracing sound rays, determining whether there is direct sound in the building; In the absence of the direct sound, determining that the direct sound is blocked by an environmental occluder; An intersection point between the direct sound and the ambient occlusion object is calculated.
3. The sound transmission method according to claim 2, wherein: The determining whether there is direct sound includes: Determine whether the listener's position in the building can receive the direct sound emitted by the sound source.
4. The sound transmission method according to any one of claims 1 to 3, wherein: The estimating the sound transmission model according to the intersection point set includes: The center, length, width and height of the sound transmission model are estimated based on the intersection point set.
5. The sound transmission method according to any one of claims 1 to 4, wherein: The estimating the transmission condition of the sound emitted by the sound source in the wall by using the sound transmission model includes: determining, according to the sound transmission model, the position information of the sound source in the sound transmission model, and the position information of the listener in the sound transmission model, and based on the directions of the multiple rays, a directly transmitted wall surface and a side-projected wall surface in the sound transmission model; Calculating a set of intersection points of the side surfaces of the sound source in the sound transmission model according to the sound transmission model and the direction of the sound source; 3D spatial audio calculation is performed according to the intersection point set.
6. The sound transmission method according to claim 5, wherein: The direct transmission wall surface includes the wall surface of the environmental shielding object in the sound transmission model, and the side projection wall surface includes the wall surface other than the environmental shielding object in the sound transmission model; The side surface includes the direct transmission wall surface and the side projection wall surface; The direction of the sound source includes the direction of the ray from the sound source to the listener; The intersection point in the intersection point set is determined according to the intersection point of the ray emitted from the sound source and the side surface and the intersection point of the direct sound emitted from the sound source and the directly transmitted wall surface.
7. The sound transmission method according to claim 5 or 6, wherein: The performing 3D spatial audio calculation according to the intersection point set includes: Calculating a transmission point in the intersection point set that meets the conditions according to a dot product of a vector formed by the sound source and an intersection point in the intersection point set and a vector formed by the sound source and the listener; 3D spatial audio calculation is performed according to the transmission points that meet the conditions.
8. The sound transmission method according to claim 7, wherein: The performing 3D spatial audio calculation according to the transmission point meeting the conditions includes: Calculating an overall spatial impulse response set based on the transmission points that meet the conditions; 3D spatial audio calculation is performed based on the set of overall spatial impulse responses.
9. The sound transmission method according to claim 7 or 8, wherein: The vector formed by the sound source and the listener is a first vector, and the vector formed by the sound source and the intersection point in the intersection point set is a second vector. The calculating of the transmission points that meet the conditions in the intersection point set includes: An intersection point corresponding to a second vector whose dot product with the first vector is greater than 0 is determined as the transmission point that meets the conditions.
10. The sound transmission method according to claim 8 or 9, wherein: The calculating of the overall spatial impulse response set comprises: Calculating a spatial impulse response set of acoustic transmission according to the transmission points meeting the conditions; The overall spatial impact response set is determined based on the spatial impact response set of the sound transmission process and the spatial impact response set of the sound reflection process. Time impulse response.
11. The sound transmission method according to any one of claims 5 to 10, wherein: The performing 3D spatial audio calculation according to the intersection point set includes: The sound received by the listener is simulated through the 3D spatial audio calculation.
12. The sound transmission method according to claim 11, wherein: The simulating the sound received by the listener through the 3D spatial audio calculation includes: generating a propagation path of the sound corresponding to the ray emitted by the sound source to the listener based on intersection lines between a plurality of transmissive walls of the building and an intersection point between the ray emitted by the sound source and any one of the plurality of transmissive walls, wherein the plurality of transmissive walls include the direct transmissive wall and the side projection wall; The sound received by the listener is simulated according to the propagation path.
13. A sound transmission device comprising: a determining unit, configured to determine, based on a plurality of rays emitted in all directions from a sound source as a center, a set of intersection points between the plurality of rays and a wall of a building; An estimating unit is configured to estimate a sound transmission model of the building based on the intersection point set, and estimate the transmission condition of the sound emitted by the sound source in the wall surface using the sound transmission model.
14. The sound transmission device according to claim 13, further comprising: a judgment unit, configured to judge whether there is direct sound in the building by sound ray tracing; If no such object is present, the determining unit determines that the direct sound is blocked by an environmental blocker in the building, calculates an intersection point between the direct sound and the environmental blocker, and the intersection point set includes the intersection point between the direct sound and the environmental blocker.
15. The sound transmission device according to claim 13, wherein: The estimation unit estimates the center, length, width, and height of the sound transmission model based on the intersection point set.
16. The sound transmission device according to claim 13, wherein: The estimation unit estimates the sound transmission model, the position information of the sound source in the sound transmission model, and The listener's position information in the sound transmission model is used to determine the direct transmission wall and the side projection wall in the sound transmission model based on the directions of the multiple rays. According to the sound transmission model and the direction of the sound source, a set of intersection points on the side of the sound source in the sound transmission model is calculated. 3D spatial audio calculation is performed based on the set of intersection points.
17. The sound transmission device according to claim 16, wherein: The estimation unit calculates qualified transmission points in the intersection point set based on a dot product of a vector formed by the sound source and an intersection point in the intersection point set and a vector formed by the sound source and the listener, and performs 3D spatial audio calculation based on the qualified transmission points.
18. The sound transmission device according to claim 17, wherein: The estimation unit calculates a set of overall spatial impulse responses according to the transmission points that meet the conditions, and performs 3D spatial audio calculation according to the set of overall spatial impulse responses.
19. A sound transmission device comprising: Memory; and A processor coupled to the memory, wherein the processor is configured to execute the sound transmission method according to any one of claims 1 to 12 based on instructions stored in the memory device.
20. A non-volatile computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the sound transmission method according to any one of claims 1 to 12 is implemented.
21. A computer program comprising: Instructions which, when executed by a processor, cause the processor to perform the sound transmission method according to any one of claims 1 to 12.
22. A computer program product comprising instructions which, when executed by a processor, cause the processor to perform the insonification method according to any one of claims 1 to 12.
