Acoustic visualization and auralization simulation method, device, equipment and storage medium

Abstract

The present application discloses an acoustic visualization and sonification simulation method, device, equipment and storage medium. The method includes: obtaining the house type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation; obtaining the panoramic roaming scheme of the acoustic visualization and sonification simulation based on the house type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation; obtaining the sound pressure level distribution simulation heat map of different grid spaces in the house type based on the panoramic roaming scheme of the acoustic visualization and sonification simulation. The present application enables users to intuitively see and hear the acoustic simulation results and changes, and superimposes the simulation heat map with the panoramic roaming map to display the distribution of the sound pressure level in the room, realizes the visualization of the acoustic simulation results, and brings users a completely immersive experience.

Description

Technical Field

[0001] The present disclosure generally relates to the technical field of architectural model design, and in particular to an acoustic visualization and auralization simulation method, apparatus, device, and storage medium. Background Art

[0002] As quality of life continues to improve, a variety of intelligent products and technologies are emerging, and a comfortable home environment has become a fundamental requirement for people to live and work in peace and contentment. Research on home acoustic comfort, as a key component of digital home technologies, is a crucial step in the transition from traditional home living to smart homes. Simulating and visualizing the sound field in a home environment facilitates this research. This not only allows for simulation and visualization of the sound field distribution throughout the home, but also provides support for research on other digital home products.

[0003] At present, the impact of noise on the comfort of home environment cannot be ignored, but the noise is only displayed through text output, which cannot give technicians and ordinary users a real experience and sense of identity. The display effect is not comprehensive and intuitive. Summary of the Invention

[0004] In view of the above-mentioned defects or deficiencies in the prior art, it is desired to provide an acoustic visualization and sonification simulation method, apparatus, device and storage medium that can meet the current specific needs in acoustic visualization and sonification simulation.

[0005] According to one aspect of an embodiment of the present invention, an acoustic visualization and sonification simulation method is provided. The method includes:

[0006] Obtain apartment data, decoration and renovation material data, sound source data, and camera installation location information for acoustic visualization and sonification simulation;

[0007] Obtaining a panoramic roaming solution for the acoustic visualization and sonification simulation based on the apartment type data, decoration and decoration material data, sound source data, and camera installation location information of the acoustic visualization and sonification simulation;

[0008] According to the panoramic roaming solution of the acoustic visualization and sonification simulation, a simulated heat map of the sound pressure level distribution of different grid spaces in the apartment is obtained.

[0009] In another embodiment, obtaining a panoramic roaming solution of the acoustic visualization and sonification simulation based on the apartment type data, decoration and decoration material data, sound source data, and camera installation location information of the acoustic visualization and sonification simulation includes:

[0010] Obtaining a panoramic view of each camera installation location within the acoustic visualization and sonification simulation apartment based on the apartment type data, decoration and renovation material data, sound source data, and camera installation location information;

[0011] Obtaining a volume result and a simulation heat map at each camera location based on a panoramic view of each camera installation location within the apartment through the acoustic visualization and sonification simulation;

[0012] Obtaining the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment based on the volume results and the simulation heat map at each camera position;

[0013] A panoramic roaming solution for the acoustic visualization and auralization simulation is obtained based on the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment.

[0014] In another embodiment, obtaining a volume result and a simulation heat map at each camera location based on a panoramic view of each camera installation location within the apartment through acoustic visualization and sonification simulation includes:

[0015] Obtaining a spatial geometric model of the acoustic visualization and sonification simulation based on a panoramic view of each camera installation position within the apartment of the acoustic visualization and sonification simulation;

[0016] According to the spatial geometric model of the acoustic visualization and sonification simulation, obtaining a grid spatial model of the acoustic visualization and sonification simulation after meshing the spatial geometric model of the acoustic visualization and sonification simulation;

[0017] The acoustic visualization and sonification simulation is performed based on the grid space model of the acoustic visualization and sonification simulation and the decoration material data to obtain a volume result and a simulation heat map at each camera position.

[0018] In another embodiment, obtaining the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment based on the volume results and the simulation heat map at each camera position includes:

[0019] Obtaining the boost level distribution of different grid spaces within the apartment based on the volume results and the simulated heat map at each camera position;

[0020] Obtaining the sound pressure level at each camera position based on the boost level distribution of different grid spaces within the apartment;

[0021] According to the sound pressure level at each camera position, the field distribution of acoustic design variables such as the sound pressure level of different grid spaces in the apartment is obtained.

[0022] In another embodiment, obtaining the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment includes:

[0023] The pressure acoustics method is used to calculate the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment. The pressure acoustics method includes:

[0024] Compute the wave equation for sound propagation in room air:

[0025]

[0026] Where t is time, p is sound pressure, which is an unknown quantity, c is the speed of sound, and q is the sound source;

[0027] Solve the Helmholtz equation, which is equivalent to the wave equation, in the frequency domain:

[0028]

[0029] Where ω is the angular frequency of the sound wave;

[0030] Obtain the acoustic properties of the decorative materials used in the building design and use impedance boundary conditions to simulate the physical phenomena of sound wave propagation encountering obstacles and their absorption and penetration:

[0031]

[0032] where Z i is the impedance, n is the normal vector of the obstacle boundary;

[0033] Based on the indoor acoustic simulation space model, the sound pressure distribution of different grid spaces in the apartment is obtained, and the field distribution of acoustic design variables such as sound pressure level is calculated:

[0034]

[0035] Among them, p0 is the absolute hearing threshold.

[0036] In another embodiment, obtaining the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment includes:

[0037] The field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment is calculated using a geometric acoustics method, which includes:

[0038] Acquire the sound source ray emitted from the sound source;

[0039] Calculating, based on the sound source ray, attenuation data of the sound intensity of the sound source along the distance in the direction of the sound source ray;

[0040] Based on the attenuation data of the sound intensity of the sound source with distance in the direction of the sound source ray, the sound source distribution in different grid spaces within the apartment is obtained, and the field distribution of acoustic design variables such as sound pressure level is calculated:

[0041]

[0042] Where p0 is the absolute hearing threshold and ρ is the air density.

[0043] In another embodiment, obtaining the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment includes:

[0044] The energy method is used to calculate the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment. The energy method includes:

[0045] Acquire energy diffusion data of simulated sound waves and vibrations. The energy diffusion equation of the sound waves is:

[0046]

[0047] Among them, w is the sound energy density, which is an unknown quantity, c is the speed of sound, m α is the volume absorption coefficient of the propagation medium, q is the sound source, J is the sound energy flux, and the sound energy flux caused by diffusion is proportional to the energy gradient;

[0048] The acoustic energy flux

[0049] Among them, D t is the diffusion coefficient, which is related to the mean free path λ of the sound particles. The mean free path of a regular quasi-square room is estimated to be Where V is the room area, S is the surface area of ​​the room, and the mean free path of a room with a large aspect ratio is estimated to be

[0050] Based on the acoustic properties of the set decorative materials, the absorption and penetration phenomena of simulated sound propagation when encountering obstacles are obtained:

[0051] absorb: Where α is the sound absorption coefficient of the material;

[0052] penetrate: Where S1 and S2 represent the incident and exit positions of the sound through the obstacle, and τ is the penetration coefficient of the material. The relationship with the sound insulation T of the material is τ = 10 -T / 10 ;

[0053] Based on the generated spatial grid model, the distribution of sound energy density in different grid spaces within the apartment is obtained, and the field distribution of acoustic design variables such as sound pressure level is calculated:

[0054]

[0055] Where p0 is the absolute hearing threshold and ρ is the air density.

[0056] According to another aspect of an embodiment of the present invention, an acoustic visualization and sonification simulation device is disclosed, the device comprising:

[0057] The data acquisition module is used to obtain apartment data, decoration and decoration material data, sound source data, and camera installation location information for acoustic visualization and sonification simulation;

[0058] A solution construction module is used to obtain a panoramic roaming solution of the acoustic visualization and sonification simulation based on the apartment type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation;

[0059] The acoustic simulation module is used to obtain a simulated heat map of the sound pressure level distribution of different grid spaces in the apartment based on the panoramic roaming solution of the acoustic visualization and auralization simulation.

[0060] According to another aspect of an embodiment of the present invention, an electronic device is disclosed, comprising one or more processors and a memory, wherein the memory is configured to store one or more programs. When the one or more programs are executed by the processor, the processor implements the acoustic visualization and auralization simulation method provided in each embodiment of the present invention.

[0061] According to another aspect of the embodiments of the present invention, a computer-readable storage medium storing a computer program is disclosed. When the computer program is executed, the acoustic visualization and sonification simulation method provided by each embodiment of the present invention is implemented.

[0062] In an embodiment of the present application, by obtaining the apartment data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation; based on the apartment data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation, a panoramic roaming scheme of the acoustic visualization and sonification simulation is obtained; based on the panoramic roaming scheme of the acoustic visualization and sonification simulation, a simulation heat map of the sound pressure level distribution of different grid spaces in the apartment is obtained. The present application combines the acoustic simulation results with the panoramic roaming, and cooperates with the activities of the switch movable parts in the house, the volume superposition playback, the dragging of the timeline and other interactive methods, so that users can intuitively see and hear the acoustic simulation results and changes, and superimpose the simulation heat map with the panoramic roaming map to show the distribution of the sound pressure level in the room, realize the visualization of the acoustic simulation results, and bring users a completely immersive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Other features, objects and advantages of the present application will become more apparent upon reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0064] Figure 1 This is an application scenario diagram of the acoustic visualization and sonification simulation method provided by one embodiment of the present application;

[0065] Figure 2 This is a flowchart of an acoustic visualization and sonification simulation method provided by one embodiment of the present application;

[0066] Figure 3 A schematic diagram of the structure of an acoustic visualization and auralization simulation device provided in one embodiment of the present application;

[0067] Figure 4 This is a diagram of the internal structure of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0068] The present application will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely for the purpose of explaining the relevant invention and are not intended to limit the invention. It should also be noted that, for ease of description, only portions relevant to the invention are shown in the accompanying drawings.

[0069] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in this application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0070] The acoustic visualization and sonification simulation method provided in this application can be applied to Figure 1 In the application environment shown, the acoustic visualization and sonification simulation method is applied to an acoustic visualization and sonification simulation device. The acoustic visualization and sonification simulation device can be configured in the terminal 102 or the server 104, or partially configured in the terminal 102 and partially configured in the server 104. The acoustic visualization and sonification simulation method is completed by the interaction between the terminal 102 and the server 104.

[0071] The terminal 102 and the server 104 can communicate via a network.

[0072] Among them, the terminal 102 can be but is not limited to various personal computers, laptops, smart phones, tablets and portable wearable devices. The terminal 102 must have the functions of receiving, viewing, editing, and sharing shared scenes. The server 104 can be implemented as an independent server or a server cluster composed of multiple servers.

[0073] In one embodiment, Figure 2As shown, an acoustic visualization and auralization simulation method is provided. This embodiment mainly applies this method to Figure 1 Take the terminal 102 in FIG. 1 as an example.

[0074] Please refer to Figure 2 , which shows an exemplary process to which the acoustic visualization and sonification simulation method according to an embodiment of the present application can be applied.

[0075] like Figure 2 As shown, in step 210, the apartment data, decoration material data, sound source data and camera installation position information of the acoustic visualization and auralization simulation are obtained.

[0076] Specifically, apartment layout data describes the structure and shape of an interior space. It includes information about the location, size, shape, and relationships of floor plan components such as floors, rooms, walls, columns, beams, floors, ceilings, doors, and windows. For movable components like doors and windows, the allowed open and closed states can be further defined.

[0077] Decoration and furnishing material data describes various decoration and furnishing materials, such as indoor and outdoor building materials, hard furnishings, and soft furnishings. It includes information such as price, components, geometry, attribute parameters (such as acoustic properties such as volume insulation and absorption rate), parameters for graphic rendering, and material mapping.

[0078] Sound source data describes individual sound sources, including their location, shape, orientation, type, and attribute parameters, such as measured sound pressure level, sound source power, and playback audio. Sound source data can be a constant that doesn't change over time, describing a fixed sound source. It can also be a piecewise continuous function that changes over time, describing, for example, a street that is typically noisier during the day and quieter at night. The specific storage method is to record the sound source data at each key time point and use linear interpolation to obtain the sound source data between two key time points.

[0079] The floor plan data can be a completed design case obtained from some database, a design currently being implemented by the user, or a floor plan data obtained by searching for data in a cloud-based floor plan database. If the floor plan data cannot be obtained, the user is prompted to create a floor plan using other methods, such as importing CAD files, image files, or freehand drawing. The floor plan data is then identified and extracted from these methods. With the user's permission, the floor plan data is then added back to the cloud-based floor plan database.

[0080] In step 220 , a panoramic roaming solution of the acoustic visualization and sonification simulation is obtained based on the apartment type data, decoration material data, sound source data, and camera installation position information of the acoustic visualization and sonification simulation.

[0081] Specifically, after obtaining the apartment data, decoration and renovation material data, sound source data and camera installation location information, a graphics rendering technology is used to render and obtain a panoramic image corresponding to each camera position.

[0082] By performing acoustic simulation calculations on each sound source, we obtain the volume results and simulation heat map at each camera position, as well as the simulation heat map of all sound sources superimposed.

[0083] Specifically, in one embodiment of the present application, obtaining a panoramic roaming solution of the acoustic visualization and sonification simulation based on the apartment type data, decoration and decoration material data, sound source data, and camera installation location information of the acoustic visualization and sonification simulation includes:

[0084] Obtaining a panoramic view of each camera installation location within the acoustic visualization and sonification simulation apartment based on the apartment type data, decoration and renovation material data, sound source data, and camera installation location information;

[0085] Obtaining a volume result and a simulation heat map at each camera location based on a panoramic view of each camera installation location within the apartment through the acoustic visualization and sonification simulation;

[0086] Obtaining the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment based on the volume results and the simulation heat map at each camera position;

[0087] A panoramic roaming solution for the acoustic visualization and auralization simulation is obtained based on the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment.

[0088] Specifically, by using apartment data, decoration and renovation material data, sound source data and camera installation location information, and through graphics rendering technology, a panoramic image corresponding to each camera position is rendered. By performing acoustic simulation calculations on each sound source, the volume results and simulation heat map at each camera position are obtained, as well as a simulation heat map of the superposition of all sound sources.

[0089] Specifically, when constructing a simulation space for acoustic visualization and auditory simulation, the simulation area is determined based on the apartment data and decoration material data, and a geometric model of the simulation space is constructed. When low-precision simulation is performed, the simulation area is the indoor space surrounded by basic hard furnishings, such as walls, ceilings, floors, doors and windows; when high-precision simulation is performed, the simulation area can further consider decoration details and deduct the space occupied by movable furniture and equipment.

[0090] Specifically, when constructing a panoramic roaming solution for a specific acoustic visualization and auralization simulation, it is necessary to mesh the simulated spatial geometric model and generate a simulated spatial mesh model, which includes the coordinates and number of mesh nodes, as well as the node structure, shape, size, number, and other information of the mesh units.

[0091] Specifically, when conducting acoustic visualization and sonification simulations, it is necessary to use information such as the acoustic properties of decorative materials, such as sound insulation and absorption rates, and associate them with the corresponding parts of the simulated spatial geometry model. The acoustic properties of the sound source are then incorporated into the acoustic simulation analysis. Furthermore, the propagation medium in the acoustic simulation area is defined as air, and the acoustic properties of the medium are incorporated into the simulation analysis. It is also necessary to set the on / off state of active components and calculate the permutations and combinations of their allowed on / off states. Active components in the on state do not require any consideration of sound insulation performance, meaning their sound insulation and absorption rates are all zero.

[0092] Specifically, in one embodiment of the present application, obtaining a volume result and a simulation heat map at each camera location based on a panoramic view of each camera installation location within the apartment according to the acoustic visualization and sonification simulation includes:

[0093] Obtaining a spatial geometric model of the acoustic visualization and sonification simulation based on a panoramic view of each camera installation position within the apartment of the acoustic visualization and sonification simulation;

[0094] According to the spatial geometric model of the acoustic visualization and sonification simulation, obtaining a grid spatial model of the acoustic visualization and sonification simulation after meshing the spatial geometric model of the acoustic visualization and sonification simulation;

[0095] The acoustic visualization and sonification simulation is performed based on the grid space model of the acoustic visualization and sonification simulation and the decoration material data to obtain a volume result and a simulation heat map at each camera position.

[0096] The step of obtaining the field distribution of acoustic design variables such as the sound pressure level in different grid spaces within the apartment based on the volume results and the simulation heat map at each camera position includes:

[0097] Obtaining the boost level distribution of different grid spaces within the apartment based on the volume results and the simulated heat map at each camera position;

[0098] Obtaining the sound pressure level at each camera position based on the boost level distribution of different grid spaces within the apartment;

[0099] According to the sound pressure level at each camera position, the field distribution of acoustic design variables such as the sound pressure level of different grid spaces in the apartment is obtained.

[0100] Specifically, in one embodiment of the present application, obtaining the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment includes:

[0101] The pressure acoustics method is used to calculate the field distribution of acoustic design variables, such as sound pressure levels, in different grid spaces within the apartment. The Navier-Stokes equations describe the generation, propagation, and interaction of sound within a propagation medium. The speed of sound and density of indoor air can be assumed to be constants, resulting in minimal fluctuations in pressure and density caused by the acoustic field, and the effects of viscosity need not be considered.

[0102] The pressure acoustic method includes:

[0103] Compute the wave equation for sound propagation in room air:

[0104]

[0105] Where t is time, p is sound pressure, which is an unknown quantity, c is the speed of sound, and q is the sound source;

[0106] Solve the Helmholtz equation, which is equivalent to the wave equation, in the frequency domain:

[0107]

[0108] Where ω is the angular frequency of the sound wave;

[0109] Obtain the acoustic properties of the decorative materials used in the building design and use impedance boundary conditions to simulate the physical phenomena of sound wave propagation encountering obstacles and their absorption and penetration:

[0110]

[0111] where Z i is the impedance, n is the normal vector of the obstacle boundary;

[0112] Based on the indoor acoustic simulation space model, the sound pressure distribution of different grid spaces in the apartment is obtained, and the field distribution of acoustic design variables such as sound pressure level is calculated:

[0113]

[0114] Among them, p0 is the absolute hearing threshold.

[0115] Specifically, in one embodiment of the present application, obtaining the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment includes:

[0116] The field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment is calculated using a geometric acoustics method, which includes:

[0117] Acquire the sound source ray emitted from the sound source;

[0118] Based on the sound source ray, calculate the attenuation data of the sound intensity of the sound source with distance in the direction of the sound source ray; specifically, if the ray encounters an obstacle, part of it is absorbed by the obstacle, part of it penetrates the obstacle to generate a new ray, and the remaining part is reflected by the obstacle to generate a new ray. If the sound intensity of the new ray can be approximated to zero, it is not tracked;

[0119] Based on the attenuation data of the sound intensity of the sound source with distance in the direction of the sound source ray, the sound source distribution in different grid spaces within the apartment is obtained, and the field distribution of acoustic design variables such as sound pressure level is calculated:

[0120]

[0121] Where p0 is the absolute hearing threshold and ρ is the air density.

[0122] Specifically, in one embodiment of the present application, obtaining the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment includes:

[0123] The energy method is used to calculate the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment. The energy method includes:

[0124] Acquire energy diffusion data of simulated sound waves and vibrations. The energy diffusion equation of the sound waves is:

[0125]

[0126] Among them, w is the sound energy density, which is an unknown quantity, c is the speed of sound, m α is the volume absorption coefficient of the propagation medium, q is the sound source, J is the sound energy flux, and the sound energy flux caused by diffusion is proportional to the energy gradient;

[0127] The acoustic energy flux

[0128] Among them, D t is the diffusion coefficient, which is related to the mean free path λ of the sound particles. The mean free path of a regular quasi-square room is estimated to be Where V is the room area, S is the surface area of ​​the room, and the mean free path of a room with a large aspect ratio is estimated to be

[0129] Based on the acoustic properties of the set decorative materials, the absorption and penetration phenomena of simulated sound propagation when encountering obstacles are obtained:

[0130] absorb: Where α is the sound absorption coefficient of the material;

[0131] penetrate: Where S1 and S2 represent the incident and exit positions of the sound through the obstacle, and τ is the penetration coefficient of the material. The relationship with the sound insulation T of the material is τ = 10 -T / 10 ;

[0132] Based on the generated spatial grid model, the distribution of sound energy density in different grid spaces within the apartment is obtained, and the field distribution of acoustic design variables such as sound pressure level is calculated:

[0133]

[0134] Where p0 is the absolute hearing threshold and ρ is the air density.

[0135] Specifically, the sound pressure level at each camera position is obtained by reading the distribution of sound energy density in different grid spaces within the apartment through linear interpolation. The sound pressure level is then converted to the volume of the sound source audio using a specific sound pressure level-volume conversion relationship. For example, a simple sound pressure level-volume conversion relationship could be a linear conversion of 100 to 1%, meaning that a sound pressure level of 0 decibels corresponds to a volume of 0%, and a sound pressure level of 100 decibels corresponds to a volume of 100%.

[0136] In step 230 , a sound pressure level distribution simulation heat map of different grid spaces within the apartment is obtained according to the panoramic roaming solution of the acoustic visualization and auralization simulation.

[0137] Specifically, through graphic rendering technology, the field distribution of acoustic design variables such as sound pressure level of the panoramic roaming solution of the acoustic visualization and sonification simulation is rendered into a simulated heat map of the sound pressure level distribution of different grid spaces in the apartment.

[0138] The acoustic visualization and sonification simulation method of the present application obtains the house type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation; obtains the panoramic roaming scheme of the acoustic visualization and sonification simulation based on the house type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation; obtains the sound pressure level distribution simulation heat map of different grid spaces in the house type based on the panoramic roaming scheme of the acoustic visualization and sonification simulation. The present application combines the acoustic simulation results with the panoramic roaming, and cooperates with the interactive methods such as the movement of the switch movable parts in the house, the volume superposition playback, and the dragging of the timeline, so that the user can intuitively see and hear the acoustic simulation results and changes, and superimposes the simulation heat map with the panoramic roaming map to show the distribution of the sound pressure level in the room, realizes the visualization of the acoustic simulation results, and brings the user a completely immersive experience.

[0139] It should be understood that although Figure 2 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. In addition, Figure 2 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0140] Figure 3 This is a schematic diagram of the structure of an acoustic visualization and auralization simulation device provided by an embodiment of the present application. Figure 3 As shown, the acoustic visualization and auralization simulation device includes:

[0141] Data acquisition module, solution building module, acoustic simulation module;

[0142] The data acquisition module is used to obtain apartment data, decoration and decoration material data, sound source data, and camera installation location information for acoustic visualization and sonification simulation;

[0143] A solution construction module is used to obtain a panoramic roaming solution of the acoustic visualization and sonification simulation based on the apartment type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation;

[0144] The acoustic simulation module is used to obtain a simulated heat map of the sound pressure level distribution of different grid spaces in the apartment based on the panoramic roaming solution of the acoustic visualization and auralization simulation.

[0145] Specifically, in another embodiment of the present application, the solution construction module is used to obtain a panoramic view of each camera installation position in the house type of the acoustic visualization and sonification simulation based on the house type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation; obtain the volume result and simulation heat map at each camera position based on the panoramic view of each camera installation position in the house type of the acoustic visualization and sonification simulation; obtain the field distribution of acoustic design variables such as sound pressure level in different grid spaces in the house type based on the volume result and simulation heat map at each camera position; obtain a panoramic roaming solution of the acoustic visualization and sonification simulation based on the field distribution of acoustic design variables such as sound pressure level in different grid spaces in the house type.

[0146] Specifically, in another embodiment of the present application, the solution construction module is used to obtain the spatial geometric model of the acoustic visualization and sonification simulation based on a panoramic view of each camera installation position in the house type of the acoustic visualization and sonification simulation; obtain the grid space model of the acoustic visualization and sonification simulation after gridding the spatial geometric model of the acoustic visualization and sonification simulation based on the spatial geometric model of the acoustic visualization and sonification simulation; perform the acoustic visualization and sonification simulation based on the grid space model of the acoustic visualization and sonification simulation and the decoration and decoration material data to obtain the volume result and simulation heat map at each of the camera positions.

[0147] Specifically, in another embodiment of the present application, the scheme construction module is used to obtain the boost level distribution of different grid spaces within the household type based on the volume results and simulation heat map at each of the camera positions; obtain the sound pressure level at each camera position based on the boost level distribution of different grid spaces within the household type; and obtain the field distribution of acoustic design variables such as the sound pressure level of different grid spaces within the household type based on the sound pressure level at each camera position.

[0148] Specifically, in another embodiment of the present application, the solution construction module is used to calculate the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment using a pressure acoustics method. The pressure acoustics method includes: calculating the wave equation for sound propagation in indoor air: Where t is time, p is the sound pressure, which is an unknown quantity, c is the speed of sound, and q is the sound source. Solve the Helmholtz equation, which is equivalent to the wave equation, in the frequency domain: Where ω is the angular frequency of the sound wave; the acoustic properties of the decorative materials of the architectural design unit are obtained, and the impedance boundary condition is used to simulate the physical phenomenon of absorption and penetration of sound waves encountering obstacles: where Z i is the impedance, and n is the normal vector of the obstacle boundary; based on the indoor acoustic simulation space model, the sound pressure distribution of different grid spaces in the apartment is obtained, and the field distribution of acoustic design variables such as sound pressure level is calculated: Among them, p0 is the absolute hearing threshold.

[0149] Specifically, in another embodiment of the present application, the solution construction module is used to calculate the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment using a geometric acoustics method. The geometric acoustics method includes: obtaining a sound source ray radiated from a sound source; based on the sound source ray, calculating the attenuation data of the sound intensity of the sound source with distance in the direction of the sound source ray; based on the attenuation data of the sound intensity of the sound source with distance in the direction of the sound source ray, obtaining the sound source distribution in different grid spaces within the apartment, and calculating the field distribution of acoustic design variables such as sound pressure levels: Where p0 is the absolute hearing threshold and ρ is the air density.

[0150] Specifically, in another embodiment of the present application, the solution construction module is used to calculate the field distribution of acoustic design variables such as sound pressure levels in different grid spaces within the apartment using an energy method. The energy method includes: obtaining energy diffusion data of simulated sound waves and vibrations. The energy diffusion equation of the sound waves is: Among them, w is the sound energy density, which is an unknown quantity, c is the speed of sound, m α is the volume absorption coefficient of the propagation medium, q is the sound source, J is the sound energy flux, and the sound energy flux caused by diffusion is proportional to the energy gradient; the sound energy flux Among them, D t is the diffusion coefficient, which is related to the mean free path λ of the sound particles. The mean free path of a regular quasi-square room is estimated to be Where V is the room area, S is the surface area of ​​the room, and the mean free path of a room with a large aspect ratio is estimated to be Based on the acoustic properties of the set decorative materials, the absorption and penetration phenomena of simulated sound propagation when encountering obstacles are obtained: Absorption: Where α is the sound absorption coefficient of the material; penetration: Where S1 and S2 represent the incident and exit positions of the sound through the obstacle, and τ is the penetration coefficient of the material. The relationship with the sound insulation T of the material is τ = 10 -T / 10 Based on the generated spatial grid model, the distribution of sound energy density in different grid spaces within the apartment is obtained, and the field distribution of acoustic design variables such as sound pressure level is calculated: Where p0 is the absolute hearing threshold and ρ is the air density.

[0151] The acoustic visualization and sonification simulation device of the present application obtains the house type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation through the data acquisition module; the solution construction module obtains the panoramic roaming solution of the acoustic visualization and sonification simulation based on the house type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation; the acoustic simulation module obtains the sound pressure level distribution simulation heat map of different grid spaces in the house type based on the panoramic roaming solution of the acoustic visualization and sonification simulation. The present application combines the acoustic simulation results with the panoramic roaming, and cooperates with the interactive methods such as the movement of the switch movable parts in the house, the volume superposition playback, and the dragging of the timeline, so that the user can intuitively see and hear the acoustic simulation results and changes, and superimposes the simulation heat map with the panoramic roaming map to show the distribution of the sound pressure level in the room, realizes the visualization of the acoustic simulation results, and brings the user a completely immersive experience.

[0152] The specific definition of the acoustic visualization and sonification simulation device can be found in the definition of the acoustic visualization and sonification simulation method above and will not be repeated here. Each module in the aforementioned acoustic visualization and sonification simulation device can be implemented in whole or in part through software, hardware, or a combination thereof. Each of the aforementioned modules can be embedded in or independent of a processor in a computer device in hardware form, or can be stored in a memory in a computer device in software form, so that the processor can call and execute the corresponding operations of each of the aforementioned modules.

[0153] In particular, according to the embodiments of the present disclosure, Figure 4 As shown, the present invention discloses an electronic device, which includes one or more processors and a memory, wherein the memory is used to store one or more programs; when the one or more programs are executed by the processor, the processor implements the acoustic visualization and auralization simulation method described in an embodiment of the present invention.

[0154] In particular, according to embodiments of the present disclosure, the acoustic visualization and sonification simulation method described in any of the above embodiments can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program tangibly embodied on a machine-readable medium, the computer program containing program code for executing the acoustic visualization and sonification simulation method. In such embodiments, the computer program can be downloaded and installed from a network via a communication component and / or installed from removable media.

[0155] The one or more programs are stored in a read-only memory (ROM) or a random access memory (RAM) to perform various appropriate actions and processes. The RAM contains software programs that the server uses to perform its services, as well as various programs and data required for vehicle driving operations. The server, its controlled hardware devices, the ROM, and the RAM are connected to each other via a bus, and various input / output interfaces are also connected to the bus.

[0156] The following components are connected to the input / output interface: an input section including a keyboard, mouse, and the like; an output section including a cathode ray tube (CRT), a liquid crystal display (LCD), and speakers; and a communication section including a network interface card (NIC) such as a LAN card and a modem. The communication section performs communication processing via a network such as the Internet. A drive is also connected to the input / output interface as needed. Removable media such as magnetic disks, optical disks, magneto-optical disks, and semiconductor memories are installed in the drive as needed, so that computer programs read from the media can be installed into the memory as needed.

[0157] In particular, according to embodiments of the present disclosure, the acoustic visualization and sonification simulation method described in any of the above embodiments can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program tangibly embodied on a machine-readable medium, the computer program containing program code for executing the acoustic visualization and sonification simulation method. In such embodiments, the computer program can be downloaded and installed from a network via a communication component and / or installed from removable media.

[0158] The units or modules involved in the embodiments described in this application may be implemented by software or hardware. The units or modules described may also be provided in a processor. The names of these units or modules do not, in certain circumstances, constitute limitations on the units or modules themselves.

[0159] The above description is merely a preferred embodiment of the present application and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of the invention herein is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also encompasses other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the inventive concept. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features having similar functions disclosed in this application.

Claims

1. An acoustic visualization and sonification simulation method, characterized in that: The method comprises: Obtain apartment data, decoration and renovation material data, sound source data, and camera installation location information for acoustic visualization and sonification simulation; Obtaining a panoramic roaming solution for the acoustic visualization and sonification simulation based on the apartment type data, decoration and decoration material data, sound source data, and camera installation location information of the acoustic visualization and sonification simulation; Obtaining a simulated heat map of the sound pressure level distribution of different grid spaces within the apartment based on the panoramic roaming solution of the acoustic visualization and sonification simulation; The method of obtaining a panoramic roaming solution of the acoustic visualization and sonification simulation based on the apartment type data, decoration material data, sound source data, and camera installation position information of the acoustic visualization and sonification simulation includes: Obtaining a panoramic view of each camera installation location within the acoustic visualization and sonification simulation apartment based on the apartment type data, decoration and renovation material data, sound source data, and camera installation location information; Obtaining a volume result and a simulation heat map at each camera location based on a panoramic view of each camera installation location within the apartment through the acoustic visualization and sonification simulation; Obtaining the field distribution of the sound pressure levels of different grid spaces within the apartment based on the volume results and the simulated heat map at each camera position; Obtaining a panoramic roaming solution for the acoustic visualization and auralization simulation based on the field distribution of sound pressure levels in different grid spaces within the apartment; The method of obtaining a volume result and a simulation heat map at each camera location based on a panoramic view of each camera installation location in the apartment according to the acoustic visualization and sonification simulation includes: Obtaining a spatial geometric model of the acoustic visualization and sonification simulation based on a panoramic view of each camera installation position within the apartment of the acoustic visualization and sonification simulation; According to the spatial geometric model of the acoustic visualization and sonification simulation, obtaining a grid spatial model of the acoustic visualization and sonification simulation after meshing the spatial geometric model of the acoustic visualization and sonification simulation; The acoustic visualization and sonification simulation is performed based on the grid space model of the acoustic visualization and sonification simulation and the decoration material data to obtain a volume result and a simulation heat map at each camera position.

2. The method according to claim 1, characterized in that The obtaining of the field distribution of the sound pressure levels of different grid spaces within the apartment based on the volume results and the simulation heat map at each camera position includes: Obtaining the sound pressure level distribution of different grid spaces within the apartment based on the volume results and the simulated heat map at each camera position; Obtaining the sound pressure level at each camera position based on the sound pressure level distribution of different grid spaces within the apartment; According to the sound pressure level at each camera position, the field distribution of the sound pressure level in different grid spaces within the apartment is obtained.

3. An acoustic visualization and sonification simulation device, characterized in that: The device comprises: The data acquisition module is used to obtain apartment data, decoration material data, sound source data, and camera installation location information for acoustic visualization and sonification simulation; A solution construction module is used to obtain a panoramic roaming solution of the acoustic visualization and sonification simulation based on the apartment type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation, including: obtaining a panoramic view of each camera installation position in the apartment type of the acoustic visualization and sonification simulation based on the apartment type data, decoration and decoration material data, sound source data and camera installation position information of the acoustic visualization and sonification simulation; obtaining a volume result and a simulation heat map at each camera position based on the panoramic view of each camera installation position in the apartment type of the acoustic visualization and sonification simulation; obtaining a field distribution of sound pressure levels in different grid spaces in the apartment type based on the volume result and simulation heat map at each camera position; obtaining a panoramic roaming solution of the acoustic visualization and sonification simulation based on the field distribution of sound pressure levels in different grid spaces in the apartment type; The method of obtaining a volume result and a simulation heat map at each camera position based on a panoramic view of each camera installation position in the apartment of the acoustic visualization and sonification simulation includes: obtaining a spatial geometric model of the acoustic visualization and sonification simulation based on a panoramic view of each camera installation position in the apartment of the acoustic visualization and sonification simulation; obtaining a grid space model of the acoustic visualization and sonification simulation after meshing the spatial geometric model of the acoustic visualization and sonification simulation based on the spatial geometric model of the acoustic visualization and sonification simulation; and performing the acoustic visualization and sonification simulation based on the grid space model of the acoustic visualization and sonification simulation and the decoration material data to obtain a volume result and a simulation heat map at each camera position. The acoustic simulation module is used to obtain a simulated heat map of the sound pressure level distribution of different grid spaces in the apartment based on the panoramic roaming solution of the acoustic visualization and auralization simulation.

4. An electronic device, characterized in that: The device includes a processor and a memory, wherein the memory is used to store one or more programs; When the one or more programs are executed by the processor, the processor is caused to implement the method according to any one of claims 1 to 2.

5. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed, the method according to any one of claims 1 to 2 is implemented.

Images