A dynamic audio processing method and system for digital speakers

Abstract

The present application provides a dynamic audio processing method and system for a digital speaker. First, a surround field is constructed according to first original audio data and second original audio data to obtain an audio dynamic surround field. A sound image offset model is determined according to a user base point position and a sound image position of the audio dynamic surround field; a sound image high-speed offset region is determined according to the sound image offset model; a sound image offset sub-module of the sound image high-speed offset region is obtained, and dynamic audio insertion is performed on the sound image high-speed offset region in the first original audio data and the second original audio data according to the sound image offset sub-module to obtain first dynamic audio data and second dynamic audio data; and a first digital speaker and a second digital speaker are controlled to play the first dynamic audio data and the second dynamic audio data respectively, thereby reducing the discomfort caused by the rapid change of sound image when the digital speaker user plays the audio, and improving the comfort of the digital speaker user.

Description

Technical Field

[0001] The present application relates to the technical field of digital loudspeakers, and more specifically, to a dynamic audio processing method and system for digital loudspeakers. Background Art

[0002] Sound and image are the sound sources that listeners feel when listening to music. The 3D dynamic surround sound technology of digital speakers can simulate the effect of real sound and image position changes through software algorithms. Even if only a pair of ordinary speakers or headphones are used, realistic 3D positioning sound effects can be achieved. Through the interactive scenes and sound source changes in the software, corresponding changes in sound effects are output through multiple digital speakers, resulting in extremely realistic sound and image position changes around the listener, which can bring a real auditory experience.

[0003] Similar to how fast-moving visual images may cause motion sickness, fast-changing sound and image positions may also cause auditory discomfort to some listeners. When the sound and image positions change rapidly or suddenly in three-dimensional space, the listener's brain will try to interpret the source position of the sound. Therefore, when the sound and image (perceived sound source) position changes drastically, it is easy for the listener's brain to exceed the processing ability of the sound position change, causing some listeners to feel uncomfortable. Existing audio processing technology does not extract and process the fast-changing parts of the sound and image positions in the audio, causing some listeners to feel uncomfortable when using digital speakers to listen to 3D dynamic surround music for a long time, which greatly restricts the application and development of digital speakers in 3D dynamic surround technology. Summary of the invention

[0004] The present application provides a dynamic audio processing method and system for a digital speaker, which can reduce the discomfort caused by rapid changes in sound and image when playing audio to the digital speaker user, and improve the comfort of the digital speaker user.

[0005] In a first aspect, the present application provides a dynamic audio processing method for a digital speaker. The method may be executed by a network device, or may be executed by a chip configured in the network device, and the present application does not limit this.

[0006] Specifically, the method includes:

[0007] Acquire the original audio data to be processed through the first digital speaker and the second digital speaker respectively, to obtain the first original audio data and the second original audio data;

[0008] Constructing a surround field according to the first original audio data and the second original audio data to obtain an audio dynamic surround field, and determining an audio image offset model according to a user base point position and an audio image position of the audio dynamic surround field;

[0009] Determine the high-speed sound and image migration area in the first original audio data and the second original audio data by using the sound and image migration model;

[0010] Acquire a sound image displacement submodule of the sound image high-speed displacement area, and perform dynamic audio insertion on the sound image high-speed displacement area in the first original audio data and the second original audio data according to the sound image displacement submodule to obtain first dynamic audio data and second dynamic audio data;

[0011] The first digital speaker and the second digital speaker are controlled to play the first dynamic audio data and the second dynamic audio data respectively.

[0012] In combination with the first aspect, in some implementations of the first aspect, constructing a surround field according to the first original audio data and the second original audio data to obtain an audio dynamic surround field specifically includes:

[0013] Performing equally spaced sound pressure sampling on the first original audio data and the second original audio data to obtain a first sound pressure sampling value sequence and a second sound pressure sampling value sequence;

[0014] Obtaining the sound and image playback distance and the user base point position from the data distribution in the first sound pressure value sampling sequence and the second sound pressure value sampling sequence;

[0015] An audio dynamic surround field is constructed according to the sound and image playback distance and the user base point position.

[0016] In combination with the first aspect, in some implementations of the first aspect, determining the sound image shift model based on the user base point position and the sound image position of the audio dynamic surround field specifically includes:

[0017] Performing sound image position analysis according to each sound pressure sampling value in the first sound pressure sampling value sequence and the second sound pressure sampling value sequence to obtain a plurality of sound image shift entropies;

[0018] Acquire a user base point position of the audio dynamic surround field, and obtain an audio and video offset sequence according to a center offset distance between the user base point position and the first and second digital speakers and a plurality of audio and video offset entropies;

[0019] The sound image shift sequence is fitted according to each sound pressure sampling moment in the first sound pressure sampling value sequence and the second sound pressure sampling value sequence to obtain a sound image shift model.

[0020] In combination with the first aspect, in some implementations of the first aspect, a Lagrange interpolation method is used to perform sequence fitting on the sound image shift sequence to obtain a sound image shift model.

[0021] In combination with the first aspect, in some implementations of the first aspect, determining the high-speed sound and image migration area in the first original audio data and the second original audio data by using the sound and image migration model specifically includes:

[0022] Performing temporal differentiation on the sound image shift model to obtain a sound image shift trajectory;

[0023] Determine a track average value of the sound image offset track, and use a part of the sound image offset track that is higher than the track average value as a high-speed sound image offset track;

[0024] A time interval corresponding to the high-speed sound and image offset trajectory is obtained, and the first original audio data and the second original audio data are respectively intercepted according to the time interval to obtain a high-speed sound and image offset area.

[0025] In combination with the first aspect, in certain implementations of the first aspect, obtaining the sound image offset sub-mold of the sound image high-speed offset area includes: obtaining the area time interval corresponding to the sound image high-speed offset area in the original audio data, intercepting the sound image offset model according to the area time interval, and obtaining the sound image offset sub-mold.

[0026] In combination with the first aspect, in some implementations of the first aspect, the first original audio data and the second original audio data are transmitted in WAV format.

[0027] In a second aspect, the present application provides a dynamic audio processing system for a digital speaker, comprising an audio processing unit, wherein the audio processing unit comprises:

[0028] An acquisition module, used to control the first digital speaker and the second digital speaker to respectively acquire the original audio data to be processed, so as to obtain the first original audio data and the second original audio data;

[0029] A processing module, configured to construct a surround field according to the first original audio data and the second original audio data to obtain an audio dynamic surround field, and determine an audio-visual offset model according to a user base point position and an audio-visual position of the audio dynamic surround field;

[0030] A processing module, configured to determine a high-speed sound and image migration area in the first original audio data and the second original audio data by using the sound and image migration model;

[0031] A processing module, configured to obtain a sound image displacement sub-module of the sound image high-speed displacement area, and perform dynamic audio insertion on the sound image high-speed displacement area in the first original audio data and the second original audio data according to the sound image displacement sub-module to obtain first dynamic audio data and second dynamic audio data;

[0032] The execution module is used to control the first digital speaker and the second digital speaker to play the first dynamic audio data and the second dynamic audio data respectively.

[0033] In a third aspect, the present application provides a computer terminal device, which includes a memory and a processor, wherein the memory stores codes, and the processor is configured to obtain the codes and execute the above-mentioned dynamic audio processing method for a digital speaker.

[0034] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores at least one computer program, and the computer program is loaded and executed by a processor to implement the operations performed by the above-mentioned dynamic audio processing method of a digital speaker.

[0035] The technical solution provided by the embodiments disclosed in this application has the following beneficial effects:

[0036] The present application provides a dynamic audio processing method and system for a digital speaker. First, original audio data to be processed are obtained by a first digital speaker and a second digital speaker respectively to obtain first original audio data and second original audio data; a surround field is constructed according to the first original audio data and the second original audio data to obtain an audio dynamic surround field, and a sound image offset model is determined according to a user base point position and a sound image position of the audio dynamic surround field; a sound image high-speed offset region in the first original audio data and the second original audio data is determined according to the sound image offset model; a sound image offset sub-module of the sound image high-speed offset region is obtained, and dynamic audio insertion is performed on the sound image high-speed offset region in the first original audio data and the second original audio data according to the sound image offset sub-module to obtain first dynamic audio data and second dynamic audio data; and the first digital speaker and the second digital speaker are controlled to play the first dynamic audio data and the second dynamic audio data respectively.

[0037] To summarize, the present application first constructs an audio dynamic surround field, determines the sound and image position during audio playback through the audio dynamic surround field, obtains a sound and image offset model, and then separates the area where the sound and image position changes faster in the initial audio data according to the sound and image offset model to obtain a sound and image high-speed offset area, and then dynamically inserts audio into the sound and image high-speed offset area according to the sound and image offset sub-model, so that when the audio in this part of the sound and image high-speed offset area is played, the user's perception of the change in the sound and image position is disturbed due to the insertion of dynamic audio, thereby reducing the discomfort caused by the rapid changes in sound and image when playing audio to the digital speaker user, and improving the comfort of the digital speaker user. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1is an exemplary flow chart of a dynamic audio processing method of a digital speaker according to some embodiments of the present application;

[0039] Figure 2 is a schematic diagram of an audio dynamic surround field according to some embodiments of the present application;

[0040] Figure 3 is a schematic diagram of exemplary hardware and / or software of an audio processing unit according to some embodiments of the present application;

[0041] Figure 4 It is a structural schematic diagram of a computer terminal device for implementing a dynamic audio processing method of a digital speaker according to some embodiments of the present application. DETAILED DESCRIPTION

[0042] The present application obtains the original audio data to be processed by the first digital speaker and the second digital speaker respectively to obtain the first original audio data and the second original audio data; constructs a surround field according to the first original audio data and the second original audio data to obtain an audio dynamic surround field, and determines a sound image offset model according to the user base point position and the sound image position of the audio dynamic surround field; determines the sound image high-speed offset area in the first original audio data and the second original audio data according to the sound image offset model; obtains the sound image offset sub-module of the sound image high-speed offset area, and performs dynamic audio insertion on the sound image high-speed offset area in the first original audio data and the second original audio data according to the sound image offset sub-module to obtain the first dynamic audio data and the second dynamic audio data; controls the first digital speaker and the second digital speaker to play the first dynamic audio data and the second dynamic audio data respectively, thereby reducing the discomfort caused by the rapid changes of sound and image when playing audio to the digital speaker user, and improving the comfort of the digital speaker user.

[0043] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods. Figure 1 , which is an exemplary flow chart of a dynamic audio processing method of a digital speaker according to some embodiments of the present application. The dynamic audio processing method 100 of a digital speaker mainly includes the following steps:

[0044] In step S101, original audio data to be processed are acquired through a first digital speaker and a second digital speaker respectively, so as to obtain first original audio data and second original audio data.

[0045] It should be noted that the definition of a digital speaker is a speaker system that directly receives and processes digital audio signals. Optionally, in some embodiments, the first digital speaker and the second digital speaker are two Bluetooth speakers at a certain distance from each other. In other embodiments, the first digital speaker and the second digital speaker in this application may also be Bluetooth headphones worn by the user's left and right ears respectively, which is not limited here.

[0046] Optionally, in some embodiments, the first original audio data and the second original audio data are transmitted in WAV format.

[0047] In step S102, a surround field is constructed according to the first original audio data and the second original audio data to obtain an audio dynamic surround field, and an audio image shift model is determined according to the user base point position and the audio image position of the audio dynamic surround field.

[0048] It should be noted that the audio dynamic surround field is a virtual two-dimensional space field constructed to facilitate the sound image shift. Figure 2 As shown, Figure 2 is a schematic diagram of an audio dynamic surround field shown in some embodiments of the present application, wherein the audio dynamic surround field includes a user base point position, the first digital speaker, and the second digital speaker, and D1 and D2 are respectively the first and second coordinate axis directions of the audio dynamic surround field. Optionally, in some embodiments, the surround field is constructed according to the first original audio data and the second original audio data, and the audio dynamic surround field can be obtained by adopting the following steps:

[0049] Performing equally spaced sound pressure sampling on the first original audio data and the second original audio data to obtain a first sound pressure sampling value sequence and a second sound pressure sampling value sequence;

[0050] Obtaining the sound and image playback distance and the user base point position from the data distribution in the first sound pressure value sampling sequence and the second sound pressure value sampling sequence;

[0051] An audio dynamic surround field is constructed according to the sound and image playback distance and the user base point position.

[0052] In a specific implementation, the first original audio data and the second original audio data are respectively subjected to equally spaced sound pressure sampling, and in the process of obtaining the first sound pressure sampling value sequence and the second sound pressure sampling value sequence, the sampling interval, the number of sampling points and the initial sampling time of the two are consistent, wherein the sampling interval, the number of sampling points and the initial sampling time are preset according to requirements, and when sampling, it is necessary to perform conversion between the audio data sampling value and the sound pressure sampling value. In some embodiments of the present application, the sound pressure sampling value in the sound pressure sampling value sequence = the audio data sampling value × the reference sound pressure value / 2^(quantization bit depth-1).

[0053] Optionally, in some embodiments, the sound and image playback distance is a virtual sound source distance determined according to the sound pressure value of the original audio data. The sound and image playback distance can be determined based on the product of the sampling mean of each sound pressure sampling value in the first boosted sampling value sequence and the second sound pressure sampling value sequence and a preset reference distance value. After determining the sound and image playback distance, the coordinate value of the first digital speaker in the audio dynamic surround field is (-X, X), and the coordinate value of the second digital speaker in the audio dynamic surround field is (X, X), wherein X is the sound and image playback distance, and the user base point position is (Y, 0), wherein Y=X×(1-c1 / c2), wherein c1 and c2 are the sampling mean of the first boosted sampling value sequence and the sampling mean of the second sound pressure sampling value sequence, respectively.

[0054] It should be noted that the sound image, also known as the virtual sound source or the perceived sound source, is the virtual sound source position felt by a person listening to music due to the binaural effect. The sound image position is mainly related to the sound pressure heard by the human ears. The sound image shift model described in the present application is a function of the change in the sound source position over time, the independent variable of the function is the audio time value, and the dependent variable is the position of the sound source in the audio dynamic surround field. Optionally, in some embodiments, the sound image shift model is determined by the user base point position and the sound image position of the audio dynamic surround field, which can be implemented by the following steps:

[0055] Performing sound image position analysis according to each sound pressure sampling value in the first sound pressure sampling value sequence and the second sound pressure sampling value sequence to obtain a plurality of sound image shift entropies;

[0056] Acquire a user base point position of the audio dynamic surround field, and obtain an audio and video offset sequence according to a center offset distance between the user base point position and the first and second digital speakers and a plurality of audio and video offset entropies;

[0057] The sound image shift sequence is fitted according to each sound pressure sampling moment in the first sound pressure sampling value sequence and the second sound pressure sampling value sequence to obtain a sound image shift model.

[0058] In specific implementation, the number of sound image offset entropies is consistent with the sequence length of the first sound pressure sampling value sequence and the second sound pressure sampling value sequence, wherein, based on the dual-channel stereo sine law, the first sound image offset entropy = initial sound image offset entropy × (K1-K2) / (K1+K2), wherein K1 is the first sound pressure sampling value in the first sound pressure sampling value sequence, and K2 is the first sound pressure sampling value in the second sound pressure sampling value sequence. The remaining sound image offset entropies are also determined according to the corresponding sound pressure sampling values, which will not be repeated here. It should be noted that the sound image offset entropy in the present application is the sine value of the angle between the real-time sound image position direction and the user's front center axis direction, which is used to reflect the degree of offset between the sound image direction and the user's front center axis direction. The initial sound image offset entropy is the sine value of the angle between the initial sound image direction and the user's front center axis direction. In some embodiments, the present application Figure 2 The middle L axis is the direction of the user's front center axis, the sine value of the angle θ is the initial sound and image offset entropy, and the sine value of the angle γ between the real-time sound and image position direction and the user's front center axis direction is the sound and image offset entropy. It should also be noted that the user's front center axis direction is the positive direction of the second coordinate axis of the audio dynamic surround field, and the direction vector of the user's front center axis direction in the audio dynamic surround field is (0, X), and the direction vector of the initial sound and image is (-Y, X), wherein X is the sound and image playback distance, and Y is the horizontal coordinate of the user's base point position.

[0059] It should be noted that, in the audio dynamic surround field, in order to facilitate the determination of the sound image offset model, the movement of the sound image can be regarded as a reciprocating motion on a unidirectional axis. Figure 2 The middle M axis is the axis where the sound and image move. In the present application, the axis where the sound and image move is at the axis center of the audio dynamic surround field is (0, X), and the direction is the positive direction of the second coordinate axis of the audio dynamic surround field. The center offset distance represents the vertical distance between the user base point position and the axis where the sound and image move. Preferably, in some embodiments, the sound and image playback distance can be used as the center offset distance between the user base point position and the first and second digital speakers. The sound and image offset sequence is composed of multiple sound and image offset values, each of which corresponds to a sound and image offset entropy, wherein the sound and image offset value represents the coordinate position of the real-time sound and image position on the axis where the sound and image move. The mapping relationship between each sound and image offset entropy and the sound and image offset distance can be obtained according to the center offset distance to obtain the sound and image offset sequence, which will not be repeated here.

[0060] Optionally, in some embodiments, the Lagrange interpolation method can be used to perform sequence fitting on the sound and image offset sequence to obtain a sound and image offset model. It should be noted that the sound and image offset model described in the present application is a function of the change in the position of the sound source over time, and the independent variable of the function is the audio time value (determined by fitting at each sampling moment), and the dependent variable is the coordinate value of the sound source in the direction of the first coordinate axis in the audio dynamic surround field.

[0061] In step S103, the sound image high-speed migration area in the first original audio data and the second original audio data is determined by using the sound image migration model.

[0062] Optionally, in some embodiments, determining the high-speed sound and image migration area in the first original audio data and the second original audio data by using the sound and image migration model may be implemented by the following steps:

[0063] Performing temporal differentiation on the sound image shift model to obtain a sound image shift trajectory;

[0064] Determine a track average value of the sound image offset track, and use a part of the sound image offset track that is higher than the track average value as a high-speed sound image offset track;

[0065] A time interval corresponding to the high-speed sound and image offset trajectory is obtained, and the first original audio data and the second original audio data are respectively intercepted according to the time interval to obtain a high-speed sound and image offset area.

[0066] Optionally, in some embodiments, the sound image offset trajectory is a function of the sound image offset trajectory, the function independent variable is the audio time value, and the function dependent variable is the moving speed of the sound image during the offset. In specific implementation, the first-order differential function of the sound image offset model can also be used as the sound image offset trajectory as a function of the sound image offset trajectory.

[0067] It should be noted that the trajectory mean value of the sound and image offset trajectory is the function mean of the offset trajectory function of the sound and image offset trajectory on the definition domain, and the first original audio data and the second original audio data are respectively intercepted according to the time interval corresponding to the high-speed sound and image offset trajectory to obtain the sound and image high-speed offset area. The sound and image high-speed offset area includes: the sound and image high-speed offset area corresponding to the first original audio data, and the sound and image high-speed offset area corresponding to the second original audio data.

[0068] In step S104, the sound image displacement sub-module of the sound image high-speed displacement area is obtained, and dynamic audio insertion is performed on the sound image high-speed displacement area in the first original audio data and the second original audio data according to the sound image displacement sub-module to obtain first dynamic audio data and second dynamic audio data.

[0069] Optionally, in some embodiments, obtaining the sound image displacement sub-model of the sound image high-speed displacement area may be implemented by the following steps:

[0070] The regional time interval corresponding to the high-speed sound and image offset area in the original audio data is obtained, and the sound and image offset model is intercepted and time-differentiated according to the regional time interval to obtain the sound and image offset sub-model. It should be noted that time differentiation refers to differentiating the model function of the sound and image offset model obtained by intercepting the part on its definition domain, and the obtained differential function is the sound and image offset sub-model.

[0071] Optionally, in some embodiments, performing dynamic audio insertion on the high-speed audio and video offset region in the first original audio data and the second original audio data according to the audio and video offset sub-module to obtain the first dynamic audio data and the second dynamic audio data may be implemented by the following steps:

[0072] Acquire a high-speed audio and video offset region of the first original audio data;

[0073] Reconstructing data of the high-speed sound and image offset region of the first original audio data according to the sound and image offset sub-module to obtain reconstructed dynamic audio of the first original audio data;

[0074] Acquire a high-speed sound and image offset region of the second original audio data;

[0075] Reconstructing data of the high-speed sound and image offset region of the second original audio data according to the sound and image offset sub-module to obtain reconstructed dynamic audio of the second original audio data;

[0076] The reconstructed dynamic audio of the first original audio data is used to dynamically insert the sound and image high-speed offset region in the first original audio data to obtain the first dynamic audio data; the reconstructed dynamic audio of the second original audio data is used to dynamically insert the sound and image high-speed offset region in the second original audio data to obtain the second dynamic audio data.

[0077] Optionally, in some embodiments, data reconstruction of the high-speed sound and image offset region of the first original audio data is performed according to the sound and image offset sub-module to obtain the reconstructed dynamic audio of the first original audio data can be achieved by the following steps:

[0078] Acquire the first audio data in the high-speed sound and image shift area of ​​the first original audio data, and acquire the corresponding sound and image shift speed value in the sound and image shift submodule according to the audio time value corresponding to the first audio data;

[0079] Dynamically continue the first audio data according to the sound and image offset speed value to obtain a dynamically continued audio corresponding to the first audio data;

[0080] Acquire other audio data in the high-speed sound and image deviation area of ​​the first original audio data, and obtain dynamic continuous audio corresponding to the other audio data in the same manner;

[0081] The dynamic continuation audios corresponding to all the audio data are combined into the reconstructed dynamic audio of the first original audio data according to the audio time value.

[0082] In a specific implementation, the first audio data is dynamically continued according to the sound and image offset speed value to obtain the dynamic continued audio corresponding to the first audio data. The first audio data can be proportionally attenuated continuously according to discrete audio time values, and the attenuation rate is the product of a preset standard attenuation amount and the sound and image offset speed value corresponding to the first audio data. For example, the digital signal value of the first audio data is 64, and the corresponding audio time value is the first moment. The attenuation rate is 2, then the digital signal value at the second moment in the dynamic continued audio is 32, and the digital signal value at the third moment is 16, and so on. This can ensure that the first audio data has a certain volume continuation when being played, and can allow the user to have a blurred perception of the sound and image position when the sound and image position changes rapidly, avoid the user's discomfort when the sound and image change rapidly, and improve the comfort of the digital speaker when playing audio.

[0083] Preferably, in some embodiments, the reconstructed dynamic audio of the first original audio data is used to perform dynamic audio insertion into the sound and image high-speed offset region in the first original audio data to obtain the first dynamic audio data, which can be achieved by the following steps: inserting the reconstructed dynamic audio of the first original audio data into the sound and image high-speed offset region in the first original audio data according to the corresponding audio time value.

[0084] It should be noted that the reconstructed dynamic audio of the second original audio data can be obtained in the same way as the reconstructed dynamic audio of the first original audio data, by inserting dynamic audio into the high-speed sound and image offset area in the second original audio data, and the second dynamic audio data can be obtained in the same way as the first dynamic audio data, which will not be repeated here.

[0085] In step S105, the first digital speaker and the second digital speaker are controlled to play the first dynamic audio data and the second dynamic audio data respectively.

[0086] Optionally, in some embodiments, the first digital speaker plays the first dynamic audio data, and the second digital speaker plays the second dynamic audio data.

[0087] In addition, in another aspect of the present application, in some embodiments, the present application provides a dynamic audio processing system for a digital speaker, the system comprising an audio processing unit, referring to Figure 3 , which is a schematic diagram of exemplary hardware and / or software of an audio processing unit according to some embodiments of the present application, the audio processing unit 200 includes: an acquisition module 201, a processing module 202 and an execution module 203, which are described as follows:

[0088] In some specific embodiments of the present application, the acquisition module 201 is mainly used to control the first digital speaker and the second digital speaker to respectively acquire the original audio data to be processed, so as to obtain the first original audio data and the second original audio data;

[0089] The processing module 202 is used in some specific embodiments of the present application to construct a surround field according to the first original audio data and the second original audio data to obtain an audio dynamic surround field, and determine an audio image offset model according to a user base point position and an audio image position of the audio dynamic surround field;

[0090] The processing module 202 is used in some specific embodiments of the present application to determine the high-speed sound and image migration area in the first original audio data and the second original audio data by using the sound and image migration model;

[0091] The processing module 202 is used in some specific embodiments of the present application to obtain the sound image displacement sub-module of the sound image high-speed displacement area, and perform dynamic audio insertion on the sound image high-speed displacement area in the first original audio data and the second original audio data according to the sound image displacement sub-module to obtain first dynamic audio data and second dynamic audio data;

[0092] The execution module 203, in some specific embodiments of the present application, is mainly used to control the first digital speaker and the second digital speaker to play the first dynamic audio data and the second dynamic audio data respectively.

[0093] The above describes in detail an example of a dynamic audio processing method and system for a digital speaker provided in an embodiment of the present application. It can be understood that in order to realize the above functions, the corresponding device includes a hardware structure and / or software module corresponding to executing each function.

[0094] Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed in this document, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function in the application is executed in hardware or in a computer software-driven hardware manner depends on the specific application and design constraints of the technical solution. Therefore, professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0095] In addition, the present application also provides a computer terminal device, which includes a memory and a processor, wherein the memory stores codes, and the processor is configured to obtain the codes and execute the above-mentioned dynamic audio processing method for a digital speaker.

[0096] In some embodiments, reference Figure 4 , which is a schematic diagram of the structure of a computer terminal device using a dynamic audio processing method of a digital speaker according to some embodiments of the present application. The dynamic audio processing method of a digital speaker in the above embodiment can be Figure 4 The computer terminal device 300 shown in the figure is implemented, and the computer terminal device 300 includes at least one communication bus 301, a communication interface 302, a processor 303 and a memory 304.

[0097] The processor 303 may be a general-purpose central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more processors for controlling the execution of a dynamic audio processing method of a digital speaker in the present application.

[0098] The communication bus 301 may include a path for transmitting information between the above-mentioned components.

[0099] The memory 304 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, an optical disc storage (including a compressed optical disc, a laser disc, an optical disc, a digital versatile disc, a Blu-ray disc, etc.), a disk or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 304 may exist independently and be connected to the processor 303 via the communication bus 301. The memory 304 may also be integrated with the processor 303.

[0100] The memory 304 is used to store the program code for executing the solution of the present application, and the execution is controlled by the processor 303. The processor 303 is used to execute the program code stored in the memory 304. The program code may include one or more software modules. The determination of the high-speed excursion area of ​​the sound and image in the above embodiment can be implemented by the processor 303 and one or more software modules in the program code in the memory 304.

[0101] The communication interface 302 uses any transceiver or other device for communicating with other devices or communication networks, such as Ethernet, radio access network (RAN), wireless local area networks (WLAN), etc.

[0102] Optionally, the computer terminal device 300 may further include a power supply 305 for providing power to various devices or circuits in the real-time computer terminal device.

[0103] In a specific implementation, as an embodiment, a computer terminal device may include multiple processors, each of which may be a single-CPU processor or a multi-CPU processor. The processor here may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0104] The computer terminal device may be a general-purpose computer terminal device or a dedicated computer terminal device. In a specific implementation, the computer terminal device may be a desktop computer, a portable computer, a network server, a personal digital assistant (PDA), a mobile phone, a tablet computer, a wireless terminal device, a communication device or an embedded device. The embodiment of the present application does not limit the type of computer terminal device.

[0105] In addition, in other aspects of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores at least one computer program, and the computer program is loaded and executed by a processor to implement the operations performed by the above-mentioned dynamic audio processing method for a digital speaker.

[0106] In summary, in a dynamic audio processing method and system for a digital speaker disclosed in an embodiment of the present application, first, the original audio data to be processed are obtained by a first digital speaker and a second digital speaker respectively to obtain first original audio data and second original audio data; a surround field is constructed according to the first original audio data and the second original audio data to obtain an audio dynamic surround field, and a sound image offset model is determined according to the user base point position and the sound image position of the audio dynamic surround field; a sound image high-speed offset area of ​​the first original audio data and the second original audio data is determined according to the sound image offset model; a sound image offset sub-module of the sound image high-speed offset area is obtained, and dynamic audio insertion is performed on the sound image high-speed offset area of ​​the first original audio data and the second original audio data according to the sound image offset sub-module to obtain first dynamic audio data and second dynamic audio data; the first digital speaker and the second digital speaker are controlled to play the first dynamic audio data and the second dynamic audio data respectively, thereby reducing the discomfort of the digital speaker user caused by the rapid change of sound and image when playing audio, and improving the comfort of the digital speaker user.

[0107] The above is only an embodiment of the present application, and the common knowledge such as the specific technical scheme or characteristics in the scheme is not described in detail here. It should be pointed out that for those skilled in the art, without departing from the technical scheme of the present application, several modifications and improvements can be made, which should also be regarded as the scope of protection of the present application, and these will not affect the effect of the implementation of the present application and the practicality of the patent.

[0108] The scope of protection claimed by this application shall be based on the content of its claims. The specific implementation methods and other records in the specification can be used to interpret the content of the claims. Obviously, those skilled in the art can make various changes and modifications to this application without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is also intended to include these modifications and variations.

Claims

1. A dynamic audio processing method for a digital speaker, characterized in that: include: Acquire the original audio data to be processed through the first digital speaker and the second digital speaker respectively, to obtain the first original audio data and the second original audio data; Constructing a surround field according to the first original audio data and the second original audio data to obtain an audio dynamic surround field, and determining an audio image offset model according to a user base point position and an audio image position of the audio dynamic surround field; Determine the high-speed sound and image migration area in the first original audio data and the second original audio data by using the sound and image migration model; Acquire a sound image displacement submodule of the sound image high-speed displacement area, and perform dynamic audio insertion on the sound image high-speed displacement area in the first original audio data and the second original audio data according to the sound image displacement submodule to obtain first dynamic audio data and second dynamic audio data; Controlling the first digital speaker and the second digital speaker to play the first dynamic audio data and the second dynamic audio data respectively; The step of constructing a surround field according to the first original audio data and the second original audio data to obtain an audio dynamic surround field specifically includes: Performing equally spaced sound pressure sampling on the first original audio data and the second original audio data to obtain a first sound pressure sampling value sequence and a second sound pressure sampling value sequence; Obtaining the sound and image playback distance and the user base point position from the data distribution in the first sound pressure value sampling sequence and the second sound pressure value sampling sequence; Constructing an audio dynamic surround field according to the sound and image playback distance and the user base point position; The method of determining the sound image shift model based on the user base point position and the sound image position of the audio dynamic surround field specifically includes: Performing sound image position analysis according to each sound pressure sampling value in the first sound pressure sampling value sequence and the second sound pressure sampling value sequence to obtain a plurality of sound image shift entropies; Acquire a user base point position of the audio dynamic surround field, and obtain an audio and video offset sequence according to a center offset distance between the user base point position and the first and second digital speakers and a plurality of audio and video offset entropies; The sound image shift sequence is fitted according to each sound pressure sampling moment in the first sound pressure sampling value sequence and the second sound pressure sampling value sequence to obtain a sound image shift model.

2. The method according to claim 1, characterized in that The sound image shift sequence is fitted by using Lagrange interpolation method to obtain a sound image shift model.

3. The method according to claim 1, characterized in that Determining the high-speed sound and image migration area in the first original audio data and the second original audio data by using the sound and image migration model specifically includes: Performing temporal differentiation on the sound image shift model to obtain a sound image shift trajectory; Determine a track average value of the sound image offset track, and use a part of the sound image offset track that is higher than the track average value as a high-speed sound image offset track; A time interval corresponding to the high-speed sound and image offset trajectory is obtained, and the first original audio data and the second original audio data are respectively intercepted according to the time interval to obtain high-speed sound and image offset areas in the first original audio data and the second original audio data.

4. The method according to claim 1, characterized in that Acquiring the sound image shift sub-mold of the sound image high-speed shift area includes: acquiring the area time interval corresponding to the sound image high-speed shift area in the original audio data, intercepting the sound image shift model according to the area time interval, and obtaining the sound image shift sub-mold.

5. The method according to claim 1, characterized in that The first original audio data and the second original audio data are transmitted in WAV format.

6. A dynamic audio processing system for a digital speaker, which uses the method according to any one of claims 1 to 5 to perform dynamic audio processing, the system comprising an audio processing unit, characterized in that: The audio processing unit comprises: An acquisition module, used to control the first digital speaker and the second digital speaker to respectively acquire the original audio data to be processed, so as to obtain the first original audio data and the second original audio data; A processing module, configured to construct a surround field according to the first original audio data and the second original audio data to obtain an audio dynamic surround field, and determine an audio-visual offset model according to a user base point position and an audio-visual position of the audio dynamic surround field; A processing module, configured to determine a high-speed sound and image migration area in the first original audio data and the second original audio data by using the sound and image migration model; A processing module, configured to obtain a sound image displacement sub-module of the sound image high-speed displacement area, and perform dynamic audio insertion on the sound image high-speed displacement area in the first original audio data and the second original audio data according to the sound image displacement sub-module to obtain first dynamic audio data and second dynamic audio data; The execution module is used to control the first digital speaker and the second digital speaker to play the first dynamic audio data and the second dynamic audio data respectively.

7. A computer terminal device, characterized in that: The computer terminal device comprises a memory and a processor, wherein the memory stores codes, and the processor is configured to obtain the codes and execute the dynamic audio processing method for a digital speaker as claimed in any one of claims 1 to 5.

8. A computer-readable storage medium storing at least one computer program, characterized in that: The computer program is loaded and executed by a processor to implement the operations performed by the dynamic audio processing method for a digital speaker as claimed in any one of claims 1 to 5.

Images