Sound reproduction system and method for enhancing spatial auditory perception

Abstract

The present invention provides a sound reproduction system and method for enhancing spatial auditory perception, including: an information input and definition layer: including speakers, microphones, distance tracking devices, and processors, which complete sampling of the spatial sound field and real-time distance tracking, and then input sound source information, environmental information, and listener information into the spatial sound modulation layer; a spatial sound modulation layer: including a spatial sound modulator, the spatial sound modulator contains pixel blocks arranged in an array for spatio-temporally modulating the amplitude, phase, and directivity of sound waves; the modulated sound waves are input to the listener sound perception layer; a listener sound perception layer: the human ear auditory system realizes the localization of the sound source direction, the perception of the sound source distance, and the comprehensive perception of the sound scene. The present invention can be used in cooperation with existing reproduction systems for creating spatial auditory perception, and can significantly reduce the number of speakers arranged and the space occupied in a precise reproduction system of a physical sound field.

Description

Technical Field

[0001] The present invention relates to the technical field of spatial acoustic processing. Specifically, it relates to a sound reproduction system and method for enhancing spatial auditory perception, and more specifically, to a sound reproduction system and method for enhancing spatial auditory perception using a real-time reconfigurable spatial sound modulator. Background Art

[0002] Vision and hearing are important means for humans to perceive the world and obtain information. The proposal of the "metaverse" concept has further stimulated the development needs of technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR). Providing a digital immersive experience at the visual and auditory levels with compact and portable hardware devices is the goal pursued by the VR, AR, and MR technology fields. Current VR, AR, and MR devices all focus on visual image presentation and mostly ignore auditory sound effect presentation, so they cannot provide a complete digital immersive experience.

[0003] A good auditory digital immersive experience not only requires VR, AR, and MR devices to be able to provide accurate loudness, pitch, and timbre information, but more importantly, to create a rich spatial auditory sense. The sound generated by a loudspeaker propagates in space in the form of waves (including direct and ambient reflection paths) and then superimposes to form a complex spatial sound field. When a listener is in the sound field, their own physiological structure (such as the torso, head, and auricle, etc.) interferes with the sound field and converts the sound field information into a binaural sound pressure signal. The auditory system comprehensively processes the sound pressure signals received by both ears to form various spatial auditory perceptions.

[0004] In principle, the sound reproduction methods for creating spatial auditory perception can be divided into three categories: precise reproduction of the physical sound field, approximate reproduction of psychoacoustics and the physical sound field, and precise reproduction of binaural sound signals. Although the precise reproduction method of the physical sound field can achieve perfect reconstruction of the physical sound field within a certain spatial area, restricted by the Shannon-Nyquist spatial sampling theorem, on the one hand, it is extremely difficult to achieve sound field reconstruction in the entire audible audio band, and on the other hand, a huge number of speaker arrays are required; as typical application representatives of traditional two-channel stereo, 5.1, and 7.1-channel surround sound, the approximate reproduction method of psychoacoustics and the physical sound field can significantly reduce the number of speakers used, but the arrangement of these speakers is not sufficient to accurately reconstruct the target sound field, and to a large extent, it relies on psychoacoustic principles to synthesize various spatial auditory events; although the precise reproduction method of binaural sound signals can greatly simplify the hardware system configuration, it can only achieve precise reconstruction of the sound pressure at two points in the binaural region (space), and the listener needs to wear headphones all the time, which affects comfort.

[0005] Patent document CN106303843A (application number: CN201610616173.5) discloses a 2.5D playback method for different voice sound sources in multiple regions, including setting the number of sound fields to be played back and the azimuth of the sound sources; transforming the S-channel voice signal into the frequency domain, extracting the amplitude information of each frequency coefficient, and obtaining the two-dimensional cylindrical harmonic expansion expression of each corresponding target sub-sound field in the space based on the amplitude information; based on the spatial cylindrical harmonic coefficient conversion theory, converting the S-group sub-region sound field coefficients into a set of overall sound field cylindrical harmonic expansion coefficients through a spatial transfer operator; based on the linear superposition theory of the spatial sound field and the additional theory of spherical Bessel functions, obtaining the three-dimensional spherical harmonic expression for reconstructing the sound field by a high-order speaker array, and calculating the mode weights of each high-order speaker in the 2.5D playback system under the minimum mean square criterion; transforming the high-order speaker mode weights into the time domain to obtain the time-domain playback signals of each directional speaker in the high-order speaker. However, this invention does not modulate the correlation, amplitude, and delay relationship of the sound wave signals radiated by different pixels with the aid of a spatial sound modulator, and does not change the sound pressure directivity, amplitude, and phase of a specified region in the space in real time. Summary of the Invention

[0006] Aiming at the defects in the prior art, the purpose of the present invention is to provide a sound playback system and method for enhancing spatial auditory perception.

[0007] A sound playback system for enhancing spatial auditory perception according to the present invention includes:

[0008] Information input and definition layer: including speakers, microphones, distance tracking devices, and processors, which complete the sampling of the spatial sound field and real-time distance tracking, and then input the sound source information, environmental information, and listener information into the spatial sound modulation layer;

[0009] Spatial sound modulation layer: including a spatial sound modulator, which contains pixel blocks arranged in an array for spatio-temporally modulating the amplitude, phase, and directivity of sound waves; the modulated sound waves are input to the listener's sound perception layer;

[0010] Listener's sound perception layer: realized by the human ear auditory system to perform sound source direction localization, sound source distance perception, and sound scene comprehensive perception.

[0011] Preferably, in the said spatial sound modulation layer:

[0012] The spatial sound modulator includes a signal transceiver, a calculation unit, a regulation unit, and an execution unit;

[0013] The information collector collects signals as the input of the spatial sound modulator. The spatial sound modulator propagates the modulated sound wave signals to the listener via the sound wave transmission path, and the information collector collects the signals again and feeds them back to the spatial sound modulator for input;

[0014] The signal transceiver communicates bidirectionally with the information collector through wired or wireless transmission; the sound source information, environmental information, and listener information obtained by the information collector are received by the signal transceiver, transcoded, and then transmitted to the computing unit; the computing unit performs spectrum and filtering processing on the transcoded signal, filters out interference clutter, retains the original sound wave spectrum characteristics of the speaker, and simultaneously determines the required sound wave amplitude, phase, and directivity according to the real-time position information of the listener, and sends the corresponding instructions to the regulation unit; the regulation unit controls the state of specific pixels of the execution unit according to the instructions.

[0015] Preferably, the physical basis for the spatial sound modulator to regulate the spatial sound field is the Huygens principle, which is expressed by the Kirchhoff-Helmholtz integral as:

[0016]

[0017] where P(r,f) is the sound field in the source-free region V within the closed boundary surface S′, S′ is the closed boundary surface, P(r′,f) is the sound field at any point on S′, n′ is the normal vector on any boundary, r is the vector of any field point or receiving position within the boundary; r′ is the position vector of any point on the boundary surface; f′ is the frequency, and G(r,r′,f) is the free-field Green's function of the three-dimensional Helmholtz equation. is the inner normal derivative of the boundary surface;

[0018] Since G(r,r′,f) physically represents the sound pressure generated by a monopole sound source located at r′ at the field point r, represents the sound pressure generated by a dipole sound source located at r′ at the field point r, so the above formula shows that the sound pressure at any field point r within the surface S′ can be continuously and uniformly distributed by reconstructing the monopole and dipole secondary sound sources on the boundary surface, and the driving signals of the monopole and dipole secondary sound sources are respectively proportional to the inner normal derivative of the sound pressure and the sound pressure on the boundary surface;

[0019] The sound field reconstruction is realized in the entire space within the boundary by using the spatial sound modulator to control the sound pressure or sound pressure gradient on the boundary;

[0020] Represent the sound at the spatial target position as a linear combination of independent sound waves, and construct the matrix as follows:

[0021]

[0022] where R0 is the linear combination of the sound fields at the specific optimized positions, and P N is the amplitude of the Nth received sound wave, is the phase condition of the Nth received sound wave;

[0023] N represents the total number of sound waves, and the sound intensity at the target position is expressed as:

[0024]

[0025] The value of N is determined by the number of independent sound waves within the modifiable frequency range of the spatial sound modulator. The average propagation distance l between two scattering events s is given by the mean free path of scattering. The time between two consecutive scattering events is δt = l s / c, where c is the speed of sound in air, 343 m / s. Define δt as the scattering time interval. Within each scattering time interval, the number of sound waves scattered by the spatial sound modulator is N χ is:

[0026]

[0027] where A ssm is the surface area of the spatial sound modulator, and A is the sum of the area of the spatial sound modulator and the area of the inner boundary of the space (such as a wall, etc.);

[0028] The number of scattering events τ experienced by each sound wave within a certain time interval is:

[0029]

[0030] where t is the time from when the sound wave is emitted to when the number of scattering events is calculated, and t0 is the time when the sound wave directly reaches the microphone;

[0031] The spatial sound modulator regulates the sound waves incident on it. Within each scattering time interval, each pixel can regulate x sound waves, where x = N χ / M, and M is the number of pixels of the spatial sound modulator. The spatial sound modulator modulates each sound wave, and the modulation method is recorded as where k(f) is the modulation amplitude, is the modulated phase, and they are both determined by the frequency of the sound wave. The scattering of each pixel within a scattering time interval can be absorbed by an N×N diagonal matrix, defined as T m,q , where m is the pixel label and q is the number of scattering events; when q > 0, T m,q random x numbers on the diagonal will be modulated to the remaining data remains 1;

[0032]

[0033] Therefore, at the selected optimized time t opt , the cumulative time effect of the m-th pixel is:

[0034]

[0035] where T′m is the modulation influence ability of the m-th pixel; obtain x T' m , each pixel corresponds to one, by evaluating R m-1 and T' m R m-1 to judge the modulation effect of the m-th pixel.

[0036] Preferably, the speaker and the listener are located on both sides or the same side of the spatial sound modulator;

[0037] When the speaker and the listener are located on both sides of the spatial sound modulator, the incident sound wave emitted by the speaker is modulated by the spatial sound modulator and then reaches the listener via the transmission path;

[0038] When the speaker and the listener are located on the same side of the spatial sound modulator, the incident sound wave emitted by the speaker is modulated by the spatial sound modulator and then reaches the listener via the reflection path.

[0039] Preferably, the control part and the execution part are separately arranged or integrated into one body; the spatial sound modulator can be controlled by electronic compilation, and the calculation part controls the leads of each specific row of each column to complete the modulation of the sound;

[0040] When the control part and the execution part are separately arranged, a single pixel block of the control part specifically includes a fixed layer board, an electromagnet, and a lead; a single pixel block of the execution part specifically includes a fixed layer board, a thin film, and a magnetic mass block, wherein the lead can change the direction of the alternating current, thereby controlling the polarity of the electromagnet, and the magnetic mass block is attracted and repelled by the electromagnet to control the tension state of the thin film, thereby regulating the amplitude and phase of the radiated sound wave;

[0041] The signal transceiver part and the calculation part can be placed at the bottom, top or side of the spatial sound modulator;

[0042] When the control part and the execution part are integrated into one body, a single pixel block of the control part specifically includes a piezoelectric sheet and a lead; a single pixel block of the execution part specifically includes a fixed layer board, a thin film, and a mass block, wherein the lead can change the direction of the alternating current, and by using the direct piezoelectric effect and the inverse piezoelectric effect of the piezoelectric sheet, the equivalent bending stiffness of the piezoelectric sheet is changed, and then the tension state of the thin film is controlled, thereby regulating the amplitude and phase of the radiated sound wave.

[0043] Preferably, the spatial sound modulator is foldable or modularly spliceable; when the spatial sound modulator is foldable, a single pixel block or a sub-block composed of multiple pixel blocks is connected by a hinge, and the rotation angle of the hinge is 0° to 180°, which is convenient for folding the spatial sound modulator for transportation or storage; when the spatial sound modulator is modularly spliceable, small magnets and small iron sheets are inserted on the sides between a single pixel block or a sub-block composed of multiple pixel blocks, and the two are spliced by magnetic attraction;

[0044] As an information collector, the head-mounted device includes a camera, a microphone, and a spatial sound modulator including a light-emitting and flashing device. The camera captures the position information of the light-emitting and flashing device in real time to obtain the real-time position information between the listener and the spatial sound modulator. The microphone collects the sound field signal near the human ear and transmits it to the spatial sound modulator to complete the dynamic sound field modulation near the human ear.

[0045] A sound reproduction method for enhancing spatial auditory perception provided by the present invention is characterized in that the sound reproduction system for enhancing spatial auditory perception is adopted, and the execution includes:

[0046] Step S1: Perform initial parameter setting on the spatial sound modulator according to the listener's spatial position information and the sound frequency of the speaker;

[0047] Step S2: Sample the spatial sound field information at the listener's position and feedback it to the spatial sound modulator;

[0048] Step S3: Use a preset program to obtain the working states of the pixels in different regions of the spatial sound modulator by means of an optimization algorithm, and drive the execution part through the regulation part to complete the adaptive modulation.

[0049] Preferably, in the step S1:

[0050] Set the preset sound effects at the specified positions in advance, store the mapping relationship index between the sound effects and the specific positions in the calculation part for the selection and sending of subsequent instructions, and determine the required frequency of the regulated sound in advance within the modifiable range of the spatial sound modulator corresponding to the sound frequency of the speaker;

[0051] Obtaining the sound frequency is completed synchronously by the feedback mechanism, capturing the sound frequency at any time, or setting up another component to calculate the sound frequency in advance.

[0052] Preferably, in the step S2:

[0053] After the microphone receives the sound signal of the corresponding speaker, it converts it into an electrical signal. If the electrical signal is weak, it needs to be amplified. The calculation part also needs to perform spectral analysis on the signal, filter out the clutter, select the audio signal to be modulated at the target optimization point, and convert the analyzed audio signal into a control command and send it to the regulation part;

[0054] Specifically, it includes:

[0055] Step S2.1: Convert the sound analog signal into an electrical digital signal;

[0056] This sound-electric conversion device is composed of a microphone. After conversion, a weak electrical signal is formed, which needs to be amplified. The microphone needs to collect the sound signal felt by the user, and the microphone is placed near the listener's ear;

[0057] Step S2.2: Transmit the electrical digital signal to the spatial sound modulator;

[0058] Step S2.3: Perform spectrum and filtering processing by the computing unit;

[0059] The sound signal acquired by the microphone also contains other impurity signals. To accurately process the corresponding signal, the computing unit needs to separate the signal to obtain a large-amplitude true signal, and accurately control the regulation unit and the execution unit according to the obtained amplitude and the expected amplitude.

[0060] Preferably, in the said Step S3:

[0061] After completing the state control of a certain pixel unit in the array, the information collector collects and feeds back the modulated sound field effect, compares the effects before and after the state change, thereby determining the final state of the pixel unit, and completing the iterative work according to this rule;

[0062] Specifically, it includes:

[0063] Step S3.1: Calculate and optimize the output voltage signal of the regulation unit;

[0064] The voltage signal of the regulation unit is determined by the computing unit. The system issues the next-stage instruction to the regulation unit according to the expected sound field signal value and the actual sound field signal value at the optimized position. This instruction is the voltage signal, and this signal is transmitted to the regulation unit;

[0065] Step S3.2: The regulation unit at a specific pixel position drives the execution unit;

[0066] The pixels are arranged in an array on the panel to form a spatial sound modulator. The regulation unit controls the corresponding pixel array through the electrical signal transmitted by the computing unit, changes the state of the resonant membrane in each pixel unit, and thus performs acoustic wave modulation.

[0067] Compared with the prior art, the present invention has the following beneficial effects:

[0068] 1. The present invention can be used in cooperation with the existing playback system for creating spatial auditory perception, and can significantly reduce the number of speakers arranged and the space occupied in the precise playback system of the physical sound field; it can improve the sound field reconstruction accuracy of two-channel stereo, 5.1, and 7.1-channel surround sound systems without increasing the number of speakers; it can accurately reconstruct the sound pressure in the binaural region without wearing headphones;

[0069] 2. The present invention can be used alone as an independent spatial auditory perception playback system, without involving multi-speaker arrangement calibration, multi-channel audio track output algorithms, or real-time HRTF (head-related transfer function) calculations. The core function is implemented by one or more real-time reconfigurable spatial sound modulators arranged, which can directly and real-time change the sound pressure directivity, amplitude, and phase in a specified area of space, and is easily compatible with existing sound acquisition, encoding, and decoding standards and formats;

[0070] 3. The present invention facilitates the reuse of functional modules with the positioning and tracking system of a head-mounted device, and can significantly improve its spatial sound effect without increasing the complexity of the head-mounted device system. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] By reading the following detailed description of non-limiting embodiments with reference to the accompanying drawings, other features, objects, and advantages of the present invention will become more apparent:

[0072] Figure 1 It is a schematic diagram of an application scenario of the present invention;

[0073] Figure 2 It is a block diagram of the overall system composition of the present invention;

[0074] Figure 3 It is a basic block diagram of the spatial sound modulator of the present invention;

[0075] Figure 4 It is a schematic diagram of two arrangement forms of the spatial sound modulator of the present invention;

[0076] Figure 5 It is an embodiment of the separate configuration of the execution layer and the regulation layer of the spatial sound modulator of the present invention;

[0077] Figure 6 It is an embodiment of the integrated configuration of the execution layer and the regulation layer of the spatial sound modulator of the present invention;

[0078] Figure 7 It is a foldable embodiment of the spatial sound modulator of the present invention;

[0079] Figure 8 It is a modular splicing embodiment of the spatial sound modulator of the present invention;

[0080] Figure 9 It is a schematic diagram of the reuse of the positioning and tracking function of the spatial sound modulator of the present invention and a head-mounted device;

[0081] Figure 10 It is a logic relationship diagram of the sound playback method for enhancing spatial auditory perception of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0082] The present invention will be described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present invention, several changes and improvements can be made. These all fall within the protection scope of the present invention.

[0083] Example 1:

[0084] The present application provides a sound reproduction system and method for enhancing spatial auditory perception, including an information input and definition layer, a spatial sound modulation layer, and a listener sound perception layer. In the embodiments of the present application, by using a small number of speakers as sound sources, with the help of at least one real-time reconfigurable spatial sound modulator placed in the space, by reconstructing the spatial distribution state of the array pixels it contains, modulating the correlation, amplitude, and delay relationship of the sound wave signals radiated by different pixels, thereby changing the sound pressure directivity, amplitude, and phase of a specified area in the space in real time, and finally creating and enriching spatial auditory events. The sound reproduction system and method for enhancing spatial auditory perception proposed in the present application have a simple layout and high execution efficiency, and can be conveniently used for complex spatial virtual soundscape presentation and real-time audibility.

[0085] A sound reproduction system for enhancing spatial auditory perception according to the present invention, as Figures 1 - 10 shown, includes:

[0086] Information input and definition layer: including speakers, microphones, distance tracking devices, and processors, which complete the sampling of the spatial sound field and real-time distance tracking, and then input the sound source information, environmental information, and listener information into the spatial sound modulation layer;

[0087] Spatial sound modulation layer: including a spatial sound modulator, which contains pixel blocks arranged in an array to modulate the amplitude, phase, and directivity of sound waves in time and space; the modulated sound waves are input to the listener sound perception layer;

[0088] Listener sound perception layer: realized by the human ear auditory system for sound source direction localization, sound source distance perception, and comprehensive sound scene perception.

[0089] Specifically, in the said spatial sound modulation layer:

[0090] The spatial sound modulator includes a signal transceiver, a calculation unit, a regulation unit, and an execution unit;

[0091] The information collector collects signals as the input of the spatial sound modulator. The spatial sound modulator propagates the modulated sound wave signals to the listener via the sound wave transmission path, and the signals are collected again by the information collector and fed back into the spatial sound modulator;

[0092] The signal transceiver communicates bidirectionally with the information collector through wired or wireless transmission; the sound source information, environmental information, and listener information obtained by the information collector are received by the signal transceiver, transcoded, and then transmitted to the computing unit; the computing unit performs spectrum and filtering processing on the transcoded signal, filters out interference clutter, retains the original sound wave spectrum characteristics of the speaker, and at the same time determines the required sound wave amplitude, phase, and directivity according to the real-time position information of the listener, and sends the corresponding instructions to the regulation unit; the regulation unit controls the state of specific pixels of the execution unit according to the instructions.

[0093] Specifically, the physical basis for the spatial sound modulator to regulate the spatial sound field is Huygens' principle, which is expressed by the Kirchhoff-Helmholtz integral as:

[0094]

[0095] where P(r,f) is the sound field in the source-free region V inside the closed boundary surface S′, S′ is the closed boundary surface, P(r′,f) is the sound field at any point on S′, n′ is the normal vector on any boundary, r is the vector of any field point or receiving position inside the boundary; r′ is the position vector of any point on the boundary surface; f′ is the frequency, and G(r,r′,f) is the free-field Green's function of the three-dimensional Helmholtz equation. is the inner normal derivative of the boundary surface;

[0096] Since G(r,r′,f) physically represents the sound pressure generated by a monopole source located at r′ at the field point r, represents the sound pressure generated by a dipole source located at r′ at the field point r, so the above formula shows that the sound pressure at any field point r inside the surface S′ can be continuously and uniformly reconstructed by the monopole and dipole secondary sources on the boundary surface, and the drive signals of the monopole and dipole secondary sources are respectively proportional to the inner normal derivative of the sound pressure and the sound pressure on the boundary surface;

[0097] The sound field reconstruction is achieved by using a spatial sound modulator to control the sound pressure or sound pressure gradient on the boundary in the entire space inside the boundary;

[0098] Represent the sound at the spatial target position as a linear combination of independent sound waves and construct the matrix as follows:

[0099]

[0100] where R0 is the linear combination of the sound fields at specific optimized positions, P N is the amplitude of the Nth received sound wave, is the phase condition of the Nth received sound wave;

[0101] N represents the total number of sound waves, and the sound intensity at the target position is expressed as:

[0102]

[0103] The value of N is determined by the number of independent sound waves within the modifiable frequency range of the spatial sound modulator. The average propagation distance l between two scattering events s is given by the scattering mean free path. The time between two consecutive scattering events is δt = l s / c, where c is the speed of sound waves in air, 343 m / s; δt is defined as the scattering time interval. Within each scattering time interval, the number of sound waves scattered by the spatial sound modulator is N χ is:

[0104]

[0105] where A ssm is the surface area of the spatial sound modulator, and A is the sum of the area of the spatial inner boundary (such as a wall, etc.) and the spatial sound modulator;

[0106] The number of scattering events τ experienced by each sound wave within a certain time interval is:

[0107]

[0108] where t is the time from when the sound wave is emitted to when the number of scattering events is calculated, and t0 is the time when the sound wave directly reaches the microphone;

[0109] The spatial sound modulator regulates the sound waves incident on it. Within each scattering time interval, each pixel can regulate x sound waves, where x = N χ / M, and M is the number of pixels of the spatial sound modulator; the spatial sound modulator modulates each sound wave, and the modulation method is recorded as where k(f) is the modulation amplitude, is the modulated phase, and they are both determined by the frequency of the sound wave; the scattering of each pixel within a scattering time interval can be absorbed by an N×N diagonal matrix, defined as T m,q , where m is the pixel label and q is the number of scattering events; when q > 0, T m,q Random x numbers on the diagonal will be modulated to The remaining data remains 1;

[0110]

[0111] Therefore, at the selected optimized time t opt the cumulative time effect of the m-th pixel is:

[0112]

[0113] where T′ mis the modulation influence ability of the m-th pixel; x T's are obtained m , each pixel corresponds to one, by evaluating R m-1 and T' m R m-1 to judge the modulation effect of the m-th pixel.

[0114] Specifically, the loudspeaker and the listener are located on both sides or the same side of the spatial sound modulator;

[0115] When the loudspeaker and the listener are located on both sides of the spatial sound modulator, the incident sound wave emitted by the loudspeaker is modulated by the spatial sound modulator and then reaches the listener via the transmission path;

[0116] When the loudspeaker and the listener are located on the same side of the spatial sound modulator, the incident sound wave emitted by the loudspeaker is modulated by the spatial sound modulator and then reaches the listener via the reflection path.

[0117] Specifically, the control unit and the execution unit are separately arranged or integrated into one body; the spatial sound modulator can be electronically compiled and controlled, and the calculation unit controls the leads of each specific row of each column with the determined instructions, so as to complete the modulation of sound;

[0118] When the control unit and the execution unit are separately arranged, a single pixel block of the control unit specifically includes a fixed layer board, an electromagnet, and a lead; a single pixel block of the execution unit specifically includes a fixed layer board, a thin film, and a magnetic mass block, wherein the lead can change the direction of alternating current, thereby controlling the polarity of the electromagnet, and the magnetic mass block is attracted and repelled by the electromagnet to control the tension state of the thin film, thereby regulating the amplitude and phase of the radiated sound wave;

[0119] The signal transceiver unit and the calculation unit can be placed at the bottom, top or side of the spatial sound modulator;

[0120] When the control unit and the execution unit are integrated into one body, a single pixel block of the control unit specifically includes a piezoelectric sheet and a lead; a single pixel block of the execution unit specifically includes a fixed layer board, a thin film, and a mass block, wherein the lead can change the direction of alternating current, and by using the direct piezoelectric effect and inverse piezoelectric effect of the piezoelectric sheet, the equivalent bending stiffness of the piezoelectric sheet is changed, and further the tension state of the thin film is controlled, thereby regulating the amplitude and phase of the radiated sound wave.

[0121] Specifically, the spatial sound modulator can be folded or modularly spliced; when the spatial sound modulator is foldable, a hinge connection is adopted between a single pixel block or a sub-block composed of multiple pixel blocks, and the rotation angle of the hinge is 0° to 180°, which is convenient for folding, transporting or storing the spatial sound modulator; when the spatial sound modulator is modularly spliced, small magnets and small iron sheets are side-embedded between a single pixel block or a sub-block composed of multiple pixel blocks, and the two are spliced by magnetic attraction;

[0122] The head-mounted device, as an information collector, includes a camera, a microphone, and a spatial sound modulator including a light-emitting and flashing device. The camera captures the position information of the light-emitting and flashing device in real time to obtain the real-time position information between the listener and the spatial sound modulator. The microphone collects the sound field signal near the human ear and transmits it to the spatial sound modulator to complete the dynamic sound field modulation near the human ear.

[0123] A sound reproduction method for enhancing spatial auditory perception provided by the present invention is characterized in that the sound reproduction system for enhancing spatial auditory perception is adopted, and the execution includes:

[0124] Step S1: Perform initial parameter setting on the spatial sound modulator according to the listener's spatial position information and the sound frequency of the speaker;

[0125] Specifically, in the step S1:

[0126] The preset sound effects at the specified positions are set in advance, and the mapping relationship index between the sound effects and the specific positions is stored in the calculation unit for the selection and transmission of subsequent instructions. The sound frequency corresponding to the speaker is within the modifiable range of the spatial sound modulator, and the frequency of the sound to be regulated is determined in advance;

[0127] The acquisition of the sound frequency is completed synchronously by the feedback mechanism, capturing the sound frequency at any time, or another component is set up to calculate the sound frequency in advance.

[0128] Step S2: Sample the spatial sound field information at the listener's position and feedback it to the spatial sound modulator;

[0129] Specifically, in the step S2:

[0130] After the microphone receives the sound signal of the corresponding speaker, it converts it into an electrical signal. If the electrical signal is weak, it needs to be amplified. The calculation unit also needs to perform spectral analysis on the signal, filter out the clutter, select the audio signal to be modulated at the target optimization point, and convert the analyzed audio signal into a control command and send it to the regulation unit;

[0131] Specifically, it includes:

[0132] Step S2.1: Convert the sound analog signal into an electrical digital signal;

[0133] This sound-electric conversion device is composed of a microphone. After conversion, a weak electrical signal is formed, which needs to be amplified. The microphone needs to collect the sound signal felt by the user, and the microphone is placed near the listener's ear;

[0134] Step S2.2: Transmit the electrical digital signal to the spatial sound modulator;

[0135] Step S2.3: The computing unit performs spectrum and filtering processing;

[0136] The sound signal acquired by the microphone will also contain other impurity signals. To accurately process the corresponding signal, the computing unit needs to separate the signals to obtain a large-amplitude true signal, and accurately control the regulation unit and the execution unit according to the obtained amplitude and the expected amplitude.

[0137] Step S3: The preset program uses an optimization algorithm to obtain the working states of the pixels in different regions of the spatial sound modulator, and drives the execution unit through the regulation unit to complete adaptive modulation.

[0138] Specifically, in the step S3:

[0139] After completing the state control of a certain pixel unit in the array, the information collector collects and feeds back the modulated sound field effect, compares the effects before and after the state change, so as to determine the final state of the pixel unit, and completes the iterative work according to this rule;

[0140] Specifically, it includes:

[0141] Step S3.1: Calculate and optimize the output voltage signal of the regulation unit;

[0142] The voltage signal of the regulation unit is determined by the computing unit. The system issues the next-stage instruction to the regulation unit according to the expected sound field signal value and the actual sound field signal value at the optimized position. This instruction is the voltage signal, and this signal is transmitted to the regulation unit;

[0143] Step S3.2: The regulation unit at a specific pixel position drives the execution unit;

[0144] The pixels are arranged in an array on the panel to form a spatial sound modulator. The regulation unit controls the corresponding pixel array through the electrical signal transmitted by the computing unit, changes the state of the resonant membrane in each pixel unit, and thus performs acoustic wave modulation.

[0145] The object of the present invention is: aiming at the technical defects of the current three playback methods for creating spatial auditory perception, to provide a sound playback system and method for enhancing spatial auditory perception, by using at least one real-time reconfigurable spatial sound modulator arranged in space, and by reconstructing the spatial distribution state of the array pixels included therein, modulating the correlation, amplitude and delay relationship of the acoustic wave signals radiated by different pixels, creating and enriching spatial auditory events, and having the characteristics of simple arrangement, high execution efficiency, and being convenient for use in complex spatial virtual soundscape presentation and real-time auditoryization.

[0146] Example 2:

[0147] Embodiment 2 is a preferred example of Embodiment 1, and is used to illustrate the present invention more specifically.

[0148] Refer toFigure 1 , Figure 1 is a schematic diagram of an application scenario of the present invention.

[0149] As Figure 1 shown, the application scenario includes a speaker 11, a spatial sound modulator 12, a listener 13, and a sound wave transmission path 14. Among them, the speaker 11 can be an electro-dynamic speaker, an electromagnetic speaker, etc.; the spatial sound modulator 12 can be attached to the spatial wall or stand inside the space; the listener 13 can be at any position in the space, and the obtained sound perception will change with its specific three-dimensional coordinates; the sound wave transmission path 14 includes a direct sound path that propagates directly to the listener without being modulated by the spatial sound modulator 12 and a secondary sound path that propagates to the listener after being reflected, modulated, or transmitted and modulated by the spatial sound modulator.

[0150] In Figure 1 the application scenario shown, the speaker 11 generates a specified sound signal according to the spatial sound effect required by the virtual environment, and the spatial sound modulator 12 modulates the correlation, amplitude, and delay relationship of the sound wave signals radiated by different pixels by reconstructing the spatial distribution state of the array pixels it contains, thereby changing the spatial auditory perception of the listener 13 at the specified position.

[0151] It should be noted that in a specific application scenario, it may also include an information collector 15 carried by the listener 13 or placed at a specified spatial position for spatial sound field sampling and real-time distance tracking, so as to obtain sound source information (such as sound source azimuth), environmental information (such as sound wave spectrum), and listener information (such as three-dimensional position).

[0152] Those skilled in the art can understand that Figure 1 the system components do not constitute a limitation on the application scenario of the present invention, and may include more or fewer components than shown in the figure, or combine some components, or different component arrangements.

[0153] Referring to Figure 2 , Figure 2 is a block diagram of the overall system of the present invention.

[0154] As Figure 2As shown, the overall system includes an information input and definition layer 101, a spatial sound modulation layer 102, and a listener sound perception layer 103. In a specific embodiment, the information input and definition layer 101 is composed of a speaker, a microphone, a distance tracking device, a processor, etc. After sampling the spatial sound field and performing real-time distance tracking, it inputs the sound source information, environmental information, and listener information into the spatial sound modulation layer 102; the core function of the spatial sound modulation layer 102 is realized by the spatial sound modulator 12, which includes pixel blocks arranged in an array for temporally and spatially modulating the amplitude, phase, and directivity of sound waves; the modulated sound waves are input to the listener sound perception layer 103, and the human ear auditory system realizes the sound source direction localization, sound source distance perception, and sound scene comprehensive perception.

[0155] Refer to Figure 3 , Figure 3 which is the basic block diagram of the spatial sound modulator of the present invention;

[0156] As Figure 3 shown, the spatial sound modulator 12 includes a signal transceiver unit 121, a calculation unit 122, a regulation unit 123, and an execution unit 124. The information collector 15 collects signals as the input of the spatial sound modulator 12, and the spatial sound modulator 12 propagates the modulated sound wave signals to the listener 13 via the sound wave transmission path 14. And the information collector 15 collects signals again and feeds them back into the spatial sound modulator 12.

[0157] In a specific embodiment, the signal transceiver unit 121 communicates bidirectionally with the information collector 15 through a wired transmission method or a wireless transmission method such as Bluetooth, WIFI, 5G, etc.; the sound source information, environmental information, and listener information obtained by the information collector 15 are received by the signal transceiver unit 121, and after format transcoding, they are transmitted to the calculation unit 122; the calculation unit 122 performs spectrum and filtering processing on the transcoded signals, filters out interference clutter, retains the original sound wave spectrum characteristics of the speaker 11, and at the same time determines the required sound wave amplitude, phase, and directivity according to the real-time position information of the listener 13, and sends the corresponding instructions to the regulation unit 123; the regulation unit 123 controls the state of specific pixels of the execution unit 124 according to the instructions, and finally creates and enriches the spatial auditory event.

[0158] Refer to Figure 4 , Figure 4 which are the schematic diagrams of two layout forms of the spatial sound modulator of the present invention.

[0159] As Figure 4As shown, in Figure a, the speaker 11 and the listener 13 are located on both sides of the spatial sound modulator 12. The incident sound wave 141 emitted by the speaker 11 is modulated by the spatial sound modulator 12 and then reaches the listener 13 via the transmission path 142. In Figure b, the speaker 11 and the listener 13 are located on the same side of the spatial sound modulator 12. The incident sound wave 141 emitted by the speaker 11 is modulated by the spatial sound modulator 12 and then reaches the listener 13 via the reflection path 143.

[0160] Referring to Figure 5 , Figure 5 is a schematic diagram of an embodiment of the separated configuration of the execution part and the regulation part of the spatial sound modulator of the present invention.

[0161] As Figure 5 shown, in this embodiment, the regulation part 123 and the execution part 124 are separately arranged. A single pixel block of the regulation part 123 specifically includes a fixed layer plate 1231, an electromagnet 1232, and a lead 1233; a single pixel block of the execution part 124 specifically includes a fixed layer plate 1241, a thin film 1242, and a magnetic mass block 1243. Among them, the lead 1233 can change the direction of the alternating current, thereby controlling the polarity of the electromagnet 1232. The magnetic mass block 1243 is attracted and repelled by the electromagnet 1232 to control the tension state of the thin film 1242, thereby regulating the amplitude and phase of the radiated sound wave.

[0162] Figure 5 Also shown in

[0163] are the signal transceiver part 121 and the calculation part 122 placed at the bottom. It should be noted that the signal transceiver part 121 and the calculation part 122 are not limited to being placed at the bottom of the spatial sound modulator. In other embodiments, the signal transceiver part 121 and the calculation part 122 can also be placed at the top or side.

[0163] Referring to Figure 6 , Figure 6 is a schematic diagram of an embodiment of the integrated configuration of the execution part and the regulation part of the spatial sound modulator of the present invention.

[0164] As Figure 6 shown, in this embodiment, the regulation part 123 and the execution part 124 are integrated. A single pixel block of the regulation part 123 specifically includes a piezoelectric sheet 1234 and a lead 1233; a single pixel block of the execution part 124 specifically includes a fixed layer plate 1241, a thin film 1242, and a mass block 1243. Among them, the lead 1233 can change the direction of the alternating current, and by using the direct piezoelectric effect and the inverse piezoelectric effect of the piezoelectric sheet, the equivalent bending stiffness of the piezoelectric sheet is changed, thereby controlling the tension state of the thin film 1242, and further regulating the amplitude and phase of the radiated sound wave.

[0165] It should be noted that Figure 5 and Figure 6Both of the two embodiments of the spatial sound modulator 12 shown can be controlled by electronic compilation. The computing unit 122 can control the leads of specific rows in each column with the determined instructions, thereby completing the modulation of sound.

[0166] Refer to Figure 7 , Figure 7 which is a schematic diagram of a foldable embodiment of the spatial sound modulator of the present invention.

[0167] As Figure 7 shown, this embodiment shows a foldable spatial sound modulator 12. The sub-blocks composed of a single pixel block or multiple pixel blocks are connected by hinges 125. The rotation angle of the hinge 125 is from 0° to 180°, which is convenient for folding, transporting, or storing the spatial sound modulator 12.

[0168] Refer to Figure 8 , Figure 8 which is a schematic diagram of a modular splicing embodiment of the spatial sound modulator of the present invention.

[0169] As Figure 8 shown, this embodiment shows a modularly spliceable spatial sound modulator 12. Small magnets 1262 and small iron sheets 1261 are side-embedded between the sub-blocks composed of a single pixel block or multiple pixel blocks, and the two are spliced by magnetic attraction. In some embodiments, the small magnet 1262 can also be an electromagnet, which needs to be powered in cooperation with the contact set 127. When splicing is required, the small electromagnet 1262 is powered on and has magnetism to attract the small iron sheet 1261 to play a fixing role. When disassembling is required, the small electromagnet 1262 is powered off and the magnetism disappears, and each block can be disassembled. The contact set 127 can transmit signals and power between different blocks without redundant wiring.

[0170] Refer to Figure 9 , Figure 9 which is a schematic diagram of the multiplexing of the positioning and tracking function of the spatial sound modulator of the present invention and a head-mounted device.

[0171] In an actual application scenario, the movement state of the listener's head will change the transmission characteristics of sound waves to the ears, thereby changing the sound pressure characteristics of both ears. In this embodiment, the head-mounted device serves as the information collector 15, which includes a camera 151 and a microphone 152. The spatial sound modulator 12 includes a light-emitting and flashing device 128. The camera 151 can capture the position information of the light-emitting and flashing device 128 in real time, and thus obtain the real-time position information between the listener 13 and the spatial sound modulator 12. The microphone 152 can collect the sound field signal near the human ear and transmit it to the spatial sound modulator 12 to complete the dynamic sound field modulation near the human ear.

[0172] In other embodiments, the head-mounted device may also be equipped with a high-precision inertial navigation sensor to accurately determine the three-dimensional position coordinates of the listener 13, and determine a specific sound field modulation scheme according to the three-dimensional position of the listener 13.

[0173] The present invention also provides a sound reproduction method for enhancing spatial auditory perception. Referring to Figure 10 , Figure 10 is a logic relationship diagram of the sound reproduction method for enhancing spatial auditory perception of the present invention.

[0174] In this embodiment, the reproduction method includes the following steps:

[0175] Step S10: Perform initial parameter setting on the spatial sound modulator according to the listener's spatial position information and the sound frequency of the speaker.

[0176] It should be noted that the preset sound effects at the specified positions need to be set in advance, and the mapping relationship index between the sound effects and the specific positions is stored in the calculation unit for the selection and transmission of subsequent instructions. The sound frequency corresponding to the speaker needs to be within the modifiable range of the spatial sound modulator, so it is necessary to determine the frequency of the sound to be regulated in advance.

[0177] It is worth noting that obtaining the sound frequency in this step can be completed synchronously by a feedback mechanism to capture the sound frequency at any time, or another component can be set up to measure the sound frequency in advance. This embodiment does not make specific restrictions on this.

[0178] Step S20: Sample the spatial sound field information at the listener's position and feedback it to the spatial sound modulator

[0179] After the microphone receives the sound signal of the corresponding speaker, it converts it into an electrical signal, and the electrical signal is transmitted to the spatial sound modulator. If the electrical signal is weak, it needs to be amplified. The calculation unit also needs to perform spectral analysis on the signal, filter out the clutter, select the audio signal to be modulated at the target optimization point, and convert the analyzed audio signal into a control command and send it to the regulation unit.

[0180] Step S30: Use an optimization algorithm by a preset program to obtain the working states of the pixels in different regions of the spatial sound modulator, and drive the execution unit through the regulation unit to complete adaptive modulation.

[0181] It should be noted that this process completes the state control of a pixel unit in the array. The information collector collects and feedbacks the modulated sound field effect, compares the effects before and after the state change, so as to determine the final state of the pixel unit, and completes the iterative work according to this rule.

[0182] In this embodiment, the step S20 specifically includes:

[0183] Step S201: Convert the analog sound signal into a digital electrical signal.

[0184] It should be noted that the sound-electricity conversion device is composed of a microphone. After conversion, a weak electrical signal is formed, which needs to be amplified. The microphone needs to collect the sound signal felt by the user, so the microphone needs to be placed near the listener's ear.

[0185] Step S202: Transmit the digital electrical signal to the spatial sound modulator.

[0186] Step S203: Perform spectrum and filtering processing by the computing unit.

[0187] It can be understood that the sound signal obtained by the microphone may not only contain the signal corresponding to the speaker, but also contain other impurity signals. In order to accurately process the corresponding signal, the computing unit needs to separate the signal to obtain a large-amplitude true signal, and accurately control the regulation unit and the execution unit according to the obtained amplitude and the expected amplitude.

[0188] In this embodiment, step S30 specifically includes:

[0189] S301: Calculate and optimize the voltage signal of the regulation unit.

[0190] It should be noted that the voltage signal of the regulation unit here is determined by the computing unit. The system issues the next-stage instruction to the regulation unit according to the expected sound field signal value and the actual sound field signal value at the optimized position. This instruction is the voltage signal, and this signal is transmitted to the regulation unit.

[0191] S302: The regulation unit at a specific pixel position drives the execution unit.

[0192] It should be noted that the pixels are arranged in an array on the panel to form a spatial sound modulator. The regulation unit controls the corresponding pixel array through the electrical signal transmitted by the computing unit, that is, changes the state of the resonant membrane in each pixel unit, so as to perform acoustic wave modulation.

[0193] In the description of this application, it should be understood that the orientation or positional relationship indicated by the terms "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing this application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as a limitation to this application.

[0194] Those skilled in the art know that, in addition to implementing the systems, devices, and their respective modules provided by the present invention in the form of pure computer-readable program code, the method steps can be logically programmed to enable the systems, devices, and their respective modules provided by the present invention to be implemented in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers, etc., to achieve the same program. Therefore, the systems, devices, and their respective modules provided by the present invention can be considered as a kind of hardware components, and the modules included therein for implementing various programs can also be regarded as the structures within the hardware components; the modules for implementing various functions can also be regarded as either software programs for implementing the methods or the structures within the hardware components.

[0195] The specific embodiments of the present invention have been described above. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various changes or modifications within the scope of the claims, which does not affect the essence of the present invention. Without conflict, the embodiments of the present application and the features in the embodiments can be combined arbitrarily with each other.

Claims

1. A sound reproduction system for enhancing spatial auditory perception, characterized in that, Including: Information input and definition layer: including a speaker, a microphone, a distance tracking device and a processor, which complete sampling of the spatial sound field and real-time distance tracking, and then input the sound source information, environmental information and listener information into the spatial sound modulation layer; Spatial sound modulation layer: including a spatial sound modulator, which contains pixel blocks arranged in an array to modulate the amplitude, phase and directivity of sound waves in time and space; the modulated sound waves are input to the listener sound perception layer; Listener sound perception layer: realized by the human ear auditory system for sound source direction localization, sound source distance perception and sound scene comprehensive perception; Represent the sound at the spatial target position as a linear combination of independent sound waves, and construct the following matrix: Among them, is the linear combination of the sound fields at specific optimization positions, is the amplitude of the Nth received sound wave, is the phase condition of the Nth received sound wave; N represents the total number of sound waves, and the sound intensity at the target position is expressed as: The value of N is determined by the number of independent sound waves within the modifiable frequency range of the spatial sound modulator, and the average propagation distance between two scattering events is given by the scattering mean free path, and the time between two consecutive scattering events is , where c is the speed of sound waves in air, 343 m / s; Define as the scattering time interval. Within each scattering time interval, the number of sound waves scattered by the spatial sound modulator is: Among them, is the surface area of the spatial sound modulator, is the sum of the area of the inner boundary of the space and the spatial sound modulator; The number of scattering events experienced by each sound wave within a certain time interval is as follows: wherein, is the time from when the sound wave is emitted to when the number of scattering events is calculated, is the time for the sound wave to directly reach the microphone; The spatial sound modulator controls the sound waves incident on it. In each scattering time interval, each pixel can control sound waves, where , M is the number of pixels of the spatial sound modulator; the spatial sound modulator modulates each sound wave, and the modulation method is recorded as , where is the modulation amplitude,[[]] is the phase to be modulated, and they are both determined by the frequency of the sound wave; the scattering of each pixel in a scattering time interval can be absorbed by a diagonal matrix, which is defined as , where m is the pixel label and q is the number of scattering events; when q 0, random x numbers on the diagonal will be modulated to , and the remaining data remains 1; Therefore, at the selected optimization time the cumulative time effect of the m-th pixel is as follows: Among them, is the modulation influence ability of the m-th pixel; x are obtained, each pixel corresponds to one, and by evaluating and to judge the modulation effect of the m-th pixel.

2. The sound reproduction system for enhancing spatial auditory perception according to claim 1, characterized in that, In the said spatial sound modulation layer: The spatial sound modulator includes a signal transceiver, a calculation unit, a regulation unit and an execution unit; The information collector collects signals as the input of the spatial sound modulator. The spatial sound modulator propagates the modulated sound wave signals to the listener via the sound wave transmission path, and the information collector collects the signals again and feeds them back to the spatial sound modulator; The signal transceiver communicates bidirectionally with the information collector through wired or wireless transmission; The sound source information, environmental information and listener information obtained by the information collector are received by the signal transceiver, transcoded and then transmitted to the calculation unit; the calculation unit performs spectrum and filtering processing on the transcoded signals, filters out interference clutter, retains the original sound wave spectrum characteristics of the speaker, and at the same time determines the required sound wave amplitude, phase and directivity according to the real-time position information of the listener, and sends the corresponding instructions to the regulation unit; the regulation unit controls the state of specific pixels of the execution unit according to the instructions.

3. The sound reproduction system for enhancing spatial auditory perception according to claim 2, characterized in that: The physical basis for the spatial sound modulator to regulate the spatial sound field is the Huygens principle, which is expressed by the Kirchhoff-Helmholtz integral as: wherein, is the closed boundary surface of the source-free region in the sound field, is the closed boundary surface, is the sound field at any point on is the normal vector on any boundary, is the vector of any field point or receiving position within the boundary; is the position vector of any point on the boundary surface; is the frequency, is the free-field Green's function of the three-dimensional Helmholtz equation, is the inner normal derivative of the boundary surface; Since physically represents the sound pressure generated by a monopole sound source located at at the field point and represents the sound pressure generated by a dipole sound source located at at the field point the above formula indicates that the sound pressure at any field point inside the surface can be continuously and uniformly reconstructed by monopole and dipole secondary sound sources on the boundary surface, and the driving signals of the monopole and dipole secondary sound sources are proportional to the inner normal derivative of the sound pressure and the sound pressure on the boundary surface respectively; The sound field reconstruction is realized by using the spatial sound modulator to control the sound pressure or sound pressure gradient on the boundary in the entire space within the boundary.

4. The sound reproduction system for enhancing spatial auditory perception according to claim 2, characterized in that: The speaker and the listener are located on both sides or the same side of the spatial sound modulator; When the speaker and the listener are located on both sides of the spatial sound modulator, the incident sound waves emitted by the speaker are modulated by the spatial sound modulator and then reach the listener via the transmission path; When the speaker and the listener are located on the same side of the spatial sound modulator, the incident sound waves emitted by the speaker are modulated by the spatial sound modulator and then reach the listener via the reflection path.

5. The sound reproduction system for enhancing spatial auditory perception according to claim 2, characterized in that: The regulation unit and the execution unit are separately arranged or integrated; the spatial sound modulator can be regulated by electronic compilation, and the calculation unit controls the leads of specific rows of each column to complete the modulation of sound. When the control part and the execution part are separately arranged, a single pixel block of the control part specifically includes a fixed layer board, an electromagnet, and a lead wire; a single pixel block of the execution part specifically includes a fixed layer board, a thin film, and a magnetic mass block, wherein the lead wire can change the direction of alternating current, thereby controlling the polarity of the electromagnet, and the magnetic mass block is attracted and repelled by the electromagnet to control the tension state of the thin film, thereby regulating the amplitude and phase of the radiated sound wave; The signal transceiver part and the calculation part can be placed at the bottom, top, or side of the spatial sound modulator; When the control part and the execution part are integrated, a single pixel block of the control part specifically includes a piezoelectric sheet and a lead wire; a single pixel block of the execution part specifically includes a fixed layer board, a thin film, and a mass block, wherein the lead wire can change the direction of alternating current, and by using the direct piezoelectric effect and the inverse piezoelectric effect of the piezoelectric sheet, the equivalent bending stiffness of the piezoelectric sheet is changed, and further the tension state of the thin film is controlled, thereby regulating the amplitude and phase of the radiated sound wave.

6. The sound reproduction system for enhancing spatial auditory perception according to claim 2, wherein: The spatial sound modulator is foldable or modularly spliceable; when the spatial sound modulator is foldable, a single pixel block or a sub-block composed of multiple pixel blocks is connected by a hinge, and the rotation angle of the hinge is 0° to 180°, which is convenient for folding and transporting or storing the spatial sound modulator; when the spatial sound modulator is modularly spliceable, small magnets and small iron sheets are side-embedded between a single pixel block or a sub-block composed of multiple pixel blocks, and the two are spliced by magnetic attraction; The head-mounted device is used as an information collector, including a camera, a microphone, and the spatial sound modulator includes a light-emitting and flashing device. The camera captures the position information of the light-emitting and flashing device in real time to obtain the real-time position information between the listener and the spatial sound modulator. The microphone collects the sound field signal near the human ear and transmits it to the spatial sound modulator to complete the dynamic sound field modulation near the human ear.

7. A method for sound reproduction that enhances spatial auditory perception, characterized in that, Using the sound reproduction system for enhancing spatial auditory perception according to claim 1, the execution includes: Step S1: Perform initial parameter settings on the spatial sound modulator according to the listener's spatial position information and the sound frequency of the speaker; Step S2: Sample the spatial sound field information at the listener's position and feedback it to the spatial sound modulator; Step S3: The preset program uses an optimization algorithm to obtain the working states of the pixels in different regions of the spatial sound modulator, and drives the execution part through the control part to complete the adaptive modulation.

8. The method for sound reproduction enhancing spatial auditory perception according to claim 7, characterized in that, In the step S1: The preset sound effects at specified positions are set in advance, and the mapping relationship index between the sound effects and specific positions is stored in the calculation part for the selection and sending of subsequent instructions. The sound frequency corresponding to the speaker is within the modifiable range of the spatial sound modulator, and the frequency of the sound to be regulated is determined in advance; Obtaining the sound frequency is completed synchronously by the feedback mechanism, capturing the sound frequency at any time, or another component is set up to measure the sound frequency in advance.

9. The method for sound reproduction for enhancing spatial auditory perception according to claim 7, wherein In the step S2: After the microphone receives the sound signal from the corresponding speaker, it converts it into an electrical signal. If the electrical signal is weak, it needs to be amplified. The calculation unit simultaneously needs to perform spectral analysis on the signal, filter out clutter, select the audio signal to be modulated at the target optimization point, analyze the audio signal and convert it into a control command to be sent to the regulation unit; Specifically, it includes: Step S2.1: Convert the sound analog signal into an electrical digital signal. After conversion, a weak electrical signal is formed, which needs to be amplified. The microphone needs to collect the sound signal felt by the user, and the microphone is placed near the listener's ear; Step S2.2: Transmit the electrical digital signal to the spatial sound modulator; Step S2.3: Perform spectral and filtering processing by the calculation unit; The sound signal obtained by the microphone may also contain other impurity signals. In order to accurately process the corresponding signal, the calculation unit needs to separate the signal to obtain a large-amplitude true signal, and accurately control the regulation unit and the execution unit according to the obtained amplitude and the expected amplitude.

10. The method for sound reproduction enhancing spatial auditory perception according to claim 7, characterized in that, In the said step S3: After completing the state control of a certain pixel unit in the array, the information collector collects and feeds back the modulated sound field effect, compares the effects before and after the state change, so as to determine the final state of the pixel unit, and completes the iterative work according to this rule; Specifically, it includes: Step S3.1: Calculate and optimize the output voltage signal of the regulation unit; The voltage signal of the regulation unit is determined by the calculation unit. The system issues the next-stage instruction to the regulation unit according to the expected sound field signal value and the actual sound field signal value at the optimized position. This instruction is the voltage signal, and this signal is transmitted to the regulation unit; Step S3.2: The regulation unit at a specific pixel position drives the execution unit; The pixels are arranged in an array on the panel to form a spatial sound modulator. The regulation unit controls the corresponding pixel array through the electrical signal transmitted by the calculation unit, changes the state of the resonant membrane in each pixel unit, so as to perform acoustic wave modulation.

Images