A 3D sound effect processing method, terminal and computer readable storage medium

Abstract

The present invention discloses a 3D sound effect processing method, a terminal and a computer-readable storage medium, which relate to the field of computer technology, and solve the problem that the prior art cannot match the corresponding 3D sound effect for each song. The method comprises: determining the movement rate of the playback device of the target audio according to the characteristic information of the target audio; and generating a surround 3D sound effect according to the movement rate. The embodiment of the present invention can match the corresponding 3D sound effect for each audio, bringing the user a differential experience of different music.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a 3D sound effect processing method, a terminal and a computer-readable storage medium. Background Art

[0002] In the prior art, the technical solution for reproducing 3D sound effects with headphones is to use a database containing the head-related transfer function (HRTF) to process songs with 3D sound effects. During the processing, based on the HRTF database, effective training is performed on human listening effects, and the corresponding HRTF is matched in the HRTF database according to the training results. Then, the HRTF is fine-tuned according to the user's experience effect and feedback information during use, so that the matched and corrected HRTF can better meet the listener's 3D sound effect needs.

[0003] With the solution in the prior art, all songs have a fixed 3D sound effect, which cannot provide users with a differentiated experience of different music. Summary of the invention

[0004] The embodiments of the present invention provide a 3D sound effect processing method, a terminal and a computer-readable storage medium to solve the problem that the existing solution for performing 3D sound effect processing on songs based on a database cannot match the corresponding 3D sound effect for each song.

[0005] In a first aspect, an embodiment of the present invention provides a 3D sound effect processing method, comprising:

[0006] Determining a moving speed of a playback device of the target audio according to characteristic information of the target audio;

[0007] A surround 3D sound effect is generated according to the movement rate.

[0008] Optionally, determining the moving speed of the playback device of the target audio according to the characteristic information of the target audio includes:

[0009] Determining an adjustment coefficient according to the characteristic information of the target audio;

[0010] The moving speed of the playback device of the target audio is determined according to the adjustment coefficient and the preset moving speed.

[0011] Optionally, the characteristic information of the target audio includes: the beat of the target audio;

[0012] The step of determining the adjustment coefficient according to the characteristic information of the target audio includes:

[0013] The beat value of the target audio at the current playing moment is divided by the average beat value of the target audio to obtain the adjustment coefficient of the target audio at the current playing moment.

[0014] Optionally, generating a surround 3D sound effect according to the moving rate includes:

[0015] Based on the trajectory model of the ellipsoid surface, determining the target motion trajectory of the playback device of the target audio in the three-dimensional coordinate system; wherein the target motion trajectory is distributed along the ellipsoid surface, and the ellipsoid surface takes the listener of the target audio as the center point;

[0016] A surround 3D sound effect is generated according to the moving speed and the target motion trajectory.

[0017] Optionally, the determining of the target motion trajectory of the target audio playback device in the three-dimensional coordinate system based on the trajectory model of the ellipsoid surface includes:

[0018] Determine N motion trajectories distributed on the ellipsoid surface; wherein the N motion trajectories have different direction angles, and the N motion trajectories correspond to N sound effects;

[0019] According to the user's sound effect selection operation, a motion trajectory corresponding to the sound effect selection operation is determined from the N motion trajectories as the target motion trajectory; or, the target motion trajectory is determined according to the popularity of the sound effects corresponding to the N motion trajectories.

[0020] Optionally, determining the target motion trajectory according to popularity of the sound effects corresponding to the N motion trajectories includes:

[0021] According to the popularity of N kinds of sound effects, weighted processing is performed on the N motion trajectories to obtain the target motion trajectory; or,

[0022] According to the popularity of the N sound effects, a motion trajectory corresponding to the sound effect with the highest popularity is selected from the N sound effects as the target motion trajectory.

[0023] Optionally, after determining the target motion trajectory of the target audio playback device in the three-dimensional coordinate system based on the ellipsoidal surface, the method further includes:

[0024] Determine the popularity of N sound effects, wherein the N preset radius lengths of the ellipsoid surface correspond to the N sound effects;

[0025] According to the popularity of N kinds of sound effects and N kinds of preset radius lengths of the ellipsoidal surface, a target radius length is obtained;

[0026] The radius length of the trajectory model of the ellipsoid surface is updated to the target radius length; wherein the target radius length includes: the x-axis radius length, the y-axis radius length and the z-axis radius length.

[0027] Optionally, obtaining the target radius length according to the popularity of the N sound effects and the N preset radius lengths of the ellipsoidal surface includes:

[0028] According to the popularity of the N sound effects, weighted processing is performed on the N preset radius lengths to obtain the target radius length; or,

[0029] According to the popularity of the N sound effects, the radius length of the ellipsoid surface corresponding to the sound effect with the highest popularity is selected from the N sound effects as the target radius length.

[0030] In a second aspect, an embodiment of the present invention further provides a 3D sound effect processing device, comprising:

[0031] A first determining module, configured to determine a moving speed of a playback device of the target audio according to feature information of the target audio;

[0032] A generating module is used to generate a surround 3D sound effect according to the moving speed.

[0033] In a third aspect, an embodiment of the present invention further provides a terminal, comprising: a transceiver, a memory, a processor, and a computer program stored in the memory and executable on the processor; the processor is configured to read the program in the memory to implement the steps in the 3D sound processing method as described above.

[0034] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the 3D sound effect processing method as described above are implemented.

[0035] In an embodiment of the present invention, the moving speed of the target audio player is determined according to the characteristic information of the target audio, and a surround 3D sound effect is generated according to the moving speed. In this way, the generated surround 3D sound effect is related to the characteristic information of the target audio, and can adjust the moving speed of the player in real time during the audio playback process, so as to match the corresponding 3D surround effect for each audio, bringing the user an immersive music aesthetic and a differential experience of different music. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0037] Figure 1 is a flow chart of a 3D sound effect processing method provided by an embodiment of the present invention;

[0038] Figure 2 is an architecture diagram of an audio engine provided by an embodiment of the present invention;

[0039] Figure 3 is a structural diagram of a 3D sound effect processing device provided by an embodiment of the present invention;

[0040] Figure 4 It is a structural diagram of a terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0041] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] See also Figure 1 , Figure 1 is a flow chart of a 3D sound effect processing method provided by an embodiment of the present invention. Figure 1 As shown, the following steps are included:

[0043] Step 101: Determine the moving speed of a playback device of the target audio according to feature information of the target audio.

[0044] Optionally, the characteristic information of the target audio includes at least one of the following: voiceprint features (such as beat, melody, intensity, etc.), music type (classical, rock, KTV, fast song, slow song) and emotion type (happiness, sadness, pain, fear, carnival, joy, etc.).

[0045] Exemplarily, as an implementation method, the movement rate of the playback device of the target audio at the current playback moment can be determined based on the characteristic information corresponding to the current playback moment of the target audio. Since the movement rate of the playback device of each target audio is determined by its own characteristics, the movement rate of the playback device relative to the listener is different for each audio in 3D surround, which can bring the listener a 3D surround effect that changes with the audio characteristics.

[0046] As an implementation method, the moving speed of the target audio playback device at the current playback moment can be determined based on the correspondence between the characteristic information and the moving speed. For example, 1 / 4 beat corresponds to the first moving speed, 2 / 4 beat corresponds to the second moving speed, 3 / 4 corresponds to the third moving speed, and so on; for another example, classical music corresponds to the fourth moving speed, rock music corresponds to the fifth moving speed, fast songs correspond to the sixth moving speed, etc. Here, the first moving speed to the sixth moving speed are all preset calibration values.

[0047] Step 102: Generate surround 3D sound effects based on the moving speed

[0048] In this step, when the playback device of the target audio moves in the three-dimensional space, the movement speed of the playback device is determined according to the characteristic information of the target audio.

[0049] In the above embodiment, the movement rate of the playback device of the target audio in the three-dimensional space is related to the characteristic information of the target audio, so that during the audio playback process, the movement rate of the player in the three-dimensional space can be adjusted in real time, thereby matching the corresponding 3D surround effect for each audio, bringing users immersive music beauty and differential experience of different music.

[0050] In one embodiment, the above step 101 includes:

[0051] Determining an adjustment coefficient according to the characteristic information of the target audio;

[0052] The moving speed of the playback device of the target audio is determined according to the adjustment coefficient and the preset moving speed.

[0053] In this embodiment, the preset movement rate can be the initial movement rate of the simulated playback device, so that the current movement rate of the playback device can be adjusted in real time based on the characteristic information of the audio to obtain a movement rate that matches the characteristic information of the current audio, so as to achieve better 3D sound effects.

[0054] In a specific embodiment, the characteristic information of the target audio includes: the beat of the target audio;

[0055] The step of determining the adjustment coefficient according to the characteristic information of the target audio includes:

[0056] The beat value of the target audio at the current playing moment is divided by the average beat value of the target audio to obtain the adjustment coefficient of the target audio at the current playing moment.

[0057] Here, we take songs as an example. Since each song has its own unique rhythm, melody, and style, the simplest and most representative feature of a song file is the music beat. In a piece of music, it is composed of several beats. It is a basic unit of music and will not change. Common music beats include 1 / 4, 2 / 4, 3 / 4, 4 / 4, 3 / 8, 6 / 8, 7 / 8, 9 / 8, 12 / 8, etc. The length of each measure is fixed.

[0058] The calculation method of the adjustment coefficient a based on the music beat is:

[0059]

[0060] Among them, Beat c Beat is the beat value of the target audio at the current playback time. avg is the average beat value of the target audio.

[0061] The moving speed of the simulated playback device at the playback time is: v = a·(x v ,y v ,z v ), where x v is the movement speed of the playback device in the x direction, y v is the moving speed of the playback device in the y direction, z v is the moving speed of the playback device in the z direction. The spatial position of the playback device in the three-dimensional coordinate system is (x, y, z).

[0062] In the above embodiment, based on the beat value of the target audio at the current playback moment and the average beat value of the target audio, the adjustment coefficient of the target audio at the current playback moment is obtained, and the movement rate of the playback device of the target audio at the current playback moment is adjusted by the adjustment coefficient. In this way, since the adjustment coefficient of each audio is determined by the beat of its own current playback moment, the movement rate of the playback device relative to the listener is different for each audio when generating 3D surround sound effects, thereby providing the listener with a 3D surround effect that changes with the rhythm of the music, achieving the effect of adaptively matching the best 3D sound effect for each song.

[0063] In one embodiment, the step 102 includes:

[0064] Based on the trajectory model of the ellipsoid, the target motion trajectory of the playback device of the target audio in the three-dimensional coordinate system is determined; wherein the target motion trajectory is distributed along the ellipsoid, and the ellipsoid takes the listener of the target audio as the center point.

[0065] A surround 3D sound effect is generated according to the moving speed and the target motion trajectory.

[0066] For example, a set of coordinate values ​​of the playback device distributed along the ellipsoid surface in three-dimensional space can be obtained according to the coordinate equation of the ellipsoid surface, and the line connecting the set of coordinate values ​​is used as the target motion trajectory. It should be pointed out here that the target motion trajectory can be a preset one, or one of N preset motion trajectories, or calculated according to the preset N motion trajectories.

[0067] In this embodiment, the listener is used as the coordinate origin to construct a spatial coordinate system of a three-dimensional perspective, and the target motion trajectory is determined based on the ellipsoid trajectory model in the spatial coordinate system. By simulating the movement of the playback device along the target motion trajectory in three-dimensional space, the spatial relative position relationship between the listener and the playback device is changed, thereby giving the listener a 3D surround sound auditory experience. The trajectory model of the ellipsoid surface is centered on the listener, and the x-axis radius length, y-axis radius length, and z-axis radius length of the ellipsoid surface are set according to the optimal hearing range of the human ear, so that the playback device and the human ear are kept within a reasonable distance range, which can meet the hearing habits of the human ear and achieve a better auditory effect. Through this embodiment, it is possible to adjust the player's movement rate, spatial position, and movement direction in real time during audio playback, thereby matching the corresponding surround 3D sound effect for each audio.

[0068] Further, in one embodiment, the ellipsoid-based trajectory model determines the target motion trajectory of the target audio playback device in the three-dimensional coordinate system, including:

[0069] Determine N motion trajectories distributed on the ellipsoid surface; wherein the N motion trajectories have different direction angles, and the N motion trajectories correspond to N sound effects;

[0070] According to the user's sound effect selection operation, a motion trajectory corresponding to the sound effect selection operation is determined from the N motion trajectories as the target motion trajectory; or, the target motion trajectory is determined according to the popularity of the sound effects corresponding to the N motion trajectories.

[0071] As an implementation method, when the user listens to the target audio, each selected sound effect corresponds to a motion track in the background.

[0072] As an implementation method, the popularity can be obtained based on the number of valid playbacks corresponding to each sound effect and the popularity corresponding to each sound effect. The number of valid playbacks refers to the percentage (such as 10%) of the user's listening time under the current sound effect exceeding the entire song; the popularity corresponding to each sound effect can be calculated based on at least one of the number of comments, likes, and forwarding data of the user on the sound effect, such as weighted summation according to different weights.

[0073] In this embodiment, the target motion trajectory can be iteratively updated based on the popularity of N kinds of sound effects, thereby achieving dynamic real-time adjustment of the target motion trajectory to obtain the target motion trajectory under the best 3D sound effect.

[0074] Specifically, determining the target motion trajectory according to the N motion trajectories according to the popularity of the N sound effects includes one of the following methods:

[0075] Method 1: performing weighted processing on the N motion trajectories according to the popularity of the N sound effects to obtain the target motion trajectory;

[0076] In the first method, since the popularity of each sound effect is different, the weight corresponding to each sound effect can be obtained based on the popularity, and then the N motion trajectories are weighted summed based on the weight to obtain the final target motion trajectory.

[0077] Method 2: According to the popularity of N kinds of sound effects, the motion trajectory corresponding to the sound effect with the highest popularity is selected from the N kinds of sound effects as the target motion trajectory.

[0078] In this second method, it is possible to reduce the amount of calculation and improve processing efficiency while meeting more user needs.

[0079] In one embodiment, after determining the target motion trajectory of the target audio playback device in the three-dimensional coordinate system based on the ellipsoidal surface, the method further includes:

[0080] Determine the popularity of N sound effects, wherein the N preset radius lengths of the ellipsoid surface correspond to the N sound effects;

[0081] According to the popularity of N kinds of sound effects and N kinds of preset radius lengths of the ellipsoidal surface, a target radius length is obtained;

[0082] The radius length of the trajectory model of the ellipsoid surface is updated to the target radius length; wherein the target radius length includes: the x-axis radius length, the y-axis radius length and the z-axis radius length.

[0083] As an implementation method, when the user listens to the target audio, each sound effect selected corresponds to a radius length of an ellipsoid in the background.

[0084] As an implementation method, the popularity can be obtained based on the number of valid playbacks corresponding to each sound effect and the popularity corresponding to each sound effect. The number of valid playbacks refers to the percentage (such as 10%) of the user's listening time under the current sound effect exceeding the entire song; the popularity corresponding to each sound effect can be calculated based on at least one of the number of comments, likes, and forwarding data of the user on the sound effect, such as weighted summation according to different weights.

[0085] In this embodiment, the target radius of the ellipsoid surface can be iteratively updated based on the popularity of N sound effects, thereby achieving dynamic real-time adjustment of the target radius of the ellipsoid surface and obtaining the trajectory model of the ellipsoid surface under the best 3D sound effect.

[0086] Specifically, in one embodiment, obtaining the target radius length according to the popularity of the N sound effects and the N radius lengths of the ellipsoid surface includes one of the following methods:

[0087] Method 1: According to the popularity of N kinds of sound effects, weighted processing is performed on N kinds of radius lengths to obtain the target radius length;

[0088] In the first method, since the popularity of each sound effect is different, the weight corresponding to each sound effect can be obtained based on the popularity, and then the N ellipsoid radii are weighted summed based on the weight to obtain the final ellipsoid trajectory model.

[0089] Method 2: According to the popularity of N sound effects, the radius length of the ellipsoid corresponding to the sound effect with the highest popularity is selected from the N sound effects as the target radius length.

[0090] This second method can meet more user needs while reducing the amount of calculation and improving processing efficiency.

[0091] It should be noted that the above 3D sound processing method can be used in Figure 2 The audio engine is implemented under the audio engine architecture shown. The audio engine is between the upper-level application and the underlying hardware. For the upper-level application, it provides a rich set of APIs for the upper-level application to call. For the underlying hardware, it encapsulates the hardware driver, can call the hardware, and drive it to work normally. For this application, the underlying hardware is the sound card. The application programming interface (Application Programming Interface, API for short) of the audio engine is an intuitive and concise way of use. The basic functions include the initialization of the audio engine, the loading, playing, and stopping of audio files. Advanced functions include 3D sound effects, reverberation, digital signal processing (Digital SignalProcessor, DSP for short), asynchronous I / O, channel control, memory management and a series of other functions. The audio engine also encapsulates the driver of the underlying hardware to provide support for the hardware.

[0092] The embodiment of the present invention also provides a 3D sound effect processing device. Figure 3 , Figure 33D audio processing apparatus provided by the embodiment of the present invention is a structural diagram. Since the principle of the apparatus to solve the problem is similar to the 3D audio processing method in the embodiment of the present invention, the implementation of the video processing apparatus can refer to the implementation of the method, and the repeated parts will not be repeated.

[0093] like Figure 3 As shown, the video processing device 300 includes:

[0094] A first determining module 301 is used to determine a moving speed of a playback device of the target audio according to feature information of the target audio;

[0095] The generating module 302 is used to generate a surround 3D sound effect according to the moving speed.

[0096] Optionally, the first determining module 301 includes:

[0097] A first determination submodule, used to determine an adjustment coefficient according to feature information of the target audio;

[0098] The second determining submodule is used to determine the moving speed of the playback device of the target audio according to the adjustment coefficient and the preset moving speed.

[0099] Optionally, the characteristic information of the target audio includes: the beat of the target audio;

[0100] The first determination submodule includes:

[0101] The first determination unit is used to divide the beat value of the target audio at the current playing moment by the average beat value of the target audio to obtain the adjustment coefficient of the target audio at the current playing moment.

[0102] Optionally, the generating module 302 includes:

[0103] A first processing submodule is used to determine a target motion trajectory of the playback device of the target audio in a three-dimensional coordinate system based on the trajectory model of the ellipsoid surface; wherein the target motion trajectory is distributed along the ellipsoid surface, and the ellipsoid surface takes the listener of the target audio as the center point;

[0104] The second processing submodule is used to generate a surround 3D sound effect according to the moving speed and the target motion trajectory.

[0105] Optionally, the first processing submodule includes:

[0106] A first processing unit is used to determine N motion trajectories distributed on the ellipsoid surface; wherein the N motion trajectories have different direction angles, and the N motion trajectories correspond to N types of sound effects;

[0107] The second processing unit is used to determine, according to the user's sound effect selection operation, a motion trajectory corresponding to the sound effect selection operation from the N motion trajectories as the target motion trajectory; or, determine the target motion trajectory according to the popularity of the sound effects corresponding to the N motion trajectories.

[0108] Optionally, the second processing unit is specifically configured to:

[0109] According to the popularity of N kinds of sound effects, weighted processing is performed on the N motion trajectories to obtain the target motion trajectory; or,

[0110] According to the popularity of the N sound effects, a motion trajectory corresponding to the sound effect with the highest popularity is selected from the N sound effects as the target motion trajectory.

[0111] Optionally, the apparatus 300 further includes:

[0112] The first processing module is used to determine the popularity of N kinds of sound effects, wherein the N kinds of preset radius lengths of the ellipsoid surface correspond to the N kinds of sound effects;

[0113] The second processing module is used to obtain a target radius length according to the popularity of the N sound effects and the N preset radius lengths of the ellipsoid surface;

[0114] The third processing module is used to update the radius length of the trajectory model of the ellipsoidal surface to the target radius length; wherein the target radius length includes: x-axis radius length, y-axis radius length and z-axis radius length.

[0115] Optionally, the second processing module is specifically used for:

[0116] According to the popularity of the N sound effects, weighted processing is performed on the N preset radius lengths to obtain the target radius length; or,

[0117] According to the popularity of the N sound effects, the radius length of the ellipsoid surface corresponding to the sound effect with the highest popularity is selected from the N sound effects as the target radius length.

[0118] The device provided in the embodiment of the present invention can execute the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.

[0119] like Figure 4 As shown, the terminal of the embodiment of the present invention includes: a processor 400, which is used to read the program in the memory 420 and execute the following process:

[0120] Determining a moving speed of a playback device of the target audio according to characteristic information of the target audio;

[0121] A surround 3D sound effect is generated according to the movement rate.

[0122] The transceiver 410 is configured to receive and send data under the control of the processor 400 .

[0123] Among them, Figure 4 In the embodiment, the bus architecture may include any number of interconnected buses and bridges, specifically linking various circuits of one or more processors represented by processor 400 and memory represented by memory 420. The bus architecture may also link various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface. The transceiver 410 may be a plurality of components, namely, a transmitter and a transceiver, providing a unit for communicating with various other devices on a transmission medium. The processor 400 is responsible for managing the bus architecture and general processing, and the memory 420 may store data used by the processor 400 when performing operations.

[0124] The processor 400 is responsible for managing the bus architecture and general processing, and the memory 420 can store data used by the processor 400 when performing operations.

[0125] The processor 400 is further configured to read the computer program and execute the following steps:

[0126] Determining an adjustment coefficient according to the characteristic information of the target audio;

[0127] The moving speed of the playback device of the target audio is determined according to the adjustment coefficient and the preset moving speed.

[0128] The processor 400 is further configured to read the computer program and execute the following steps:

[0129] The step of determining the adjustment coefficient according to the characteristic information of the target audio includes:

[0130] The beat value of the target audio at the current playing moment is divided by the average beat value of the target audio to obtain the adjustment coefficient of the target audio at the current playing moment.

[0131] The processor 400 is further configured to read the computer program and execute the following steps:

[0132] Based on the trajectory model of the ellipsoid surface, determining the target motion trajectory of the playback device of the target audio in the three-dimensional coordinate system; wherein the target motion trajectory is distributed along the ellipsoid surface, and the ellipsoid surface takes the listener of the target audio as the center point;

[0133] A surround 3D sound effect is generated according to the moving speed and the target motion trajectory.

[0134] The processor 400 is further configured to read the computer program and execute the following steps:

[0135] Determine N motion trajectories distributed on the ellipsoid surface; wherein the N motion trajectories have different direction angles, and the N motion trajectories correspond to N sound effects;

[0136] According to the user's sound effect selection operation, a motion trajectory corresponding to the sound effect selection operation is determined from the N motion trajectories as the target motion trajectory; or, the target motion trajectory is determined according to the popularity of the sound effects corresponding to the N motion trajectories.

[0137] The processor 400 is further configured to read the computer program and execute the following steps:

[0138] According to the popularity of N kinds of sound effects, weighted processing is performed on the N motion trajectories to obtain the target motion trajectory; or,

[0139] According to the popularity of the N sound effects, a motion trajectory corresponding to the sound effect with the highest popularity is selected from the N sound effects as the target motion trajectory.

[0140] The processor 400 is further configured to read the computer program and execute the following steps:

[0141] Determine the popularity of N sound effects, wherein the N preset radius lengths of the ellipsoid surface correspond to the N sound effects;

[0142] According to the popularity of N kinds of sound effects and N kinds of preset radius lengths of the ellipsoidal surface, a target radius length is obtained;

[0143] The radius length of the trajectory model of the ellipsoid surface is updated to the target radius length; wherein the target radius length includes: the x-axis radius length, the y-axis radius length and the z-axis radius length.

[0144] The processor 400 is further configured to read the computer program and execute the following steps:

[0145] According to the popularity of the N sound effects, weighted processing is performed on the N preset radius lengths to obtain the target radius length; or,

[0146] According to the popularity of the N sound effects, the radius length of the ellipsoid surface corresponding to the sound effect with the highest popularity is selected from the N sound effects as the target radius length.

[0147] In the terminal provided in the embodiment of the present application, the movement rate of the playback device of the target audio in the three-dimensional space is related to the characteristic information of the target audio, so that during the audio playback process, the movement rate of the player in the three-dimensional space can be adjusted in real time, thereby matching the corresponding 3D surround effect for each audio, bringing users immersive music beauty and differential experience of different music.

[0148] In addition, the computer-readable storage medium of the embodiment of the present invention is used to store a computer program. When the program is executed by the processor, the steps in the above-mentioned 3D sound effect processing method are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0149] In the several embodiments provided in the present application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0150] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0151] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the sending and receiving method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.

[0152] The above is a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A 3D sound effect processing method, characterized in that: include: Determine the moving speed of the playback device of the target audio according to the characteristic information of the target audio; wherein the characteristic information of the target audio includes at least one of the following: voiceprint feature, music type and emotion type; Based on the trajectory model of the ellipsoid, the target motion trajectory of the playback device of the target audio in the three-dimensional coordinate system is simulated; wherein the target motion trajectory is distributed along the ellipsoid, and the ellipsoid takes the listener of the target audio as the center point; A surround 3D sound effect is generated according to the moving speed and the target motion trajectory.

2. The 3D sound effect processing method according to claim 1, characterized in that: The step of determining the moving speed of the playback device of the target audio according to the characteristic information of the target audio includes: Determining an adjustment coefficient according to the characteristic information of the target audio; The moving speed of the playback device of the target audio is determined according to the adjustment coefficient and the preset moving speed.

3. The 3D sound effect processing method according to claim 2, characterized in that: The characteristic information of the target audio includes: the beat of the target audio; The step of determining the adjustment coefficient according to the characteristic information of the target audio includes: The beat value of the target audio at the current playing moment is divided by the average beat value of the target audio to obtain the adjustment coefficient of the target audio at the current playing moment.

4. The 3D sound effect processing method according to claim 1, characterized in that: The trajectory model based on the ellipsoid surface simulates the target motion trajectory of the target audio playback device in the three-dimensional coordinate system, including: Determine N motion trajectories distributed on the ellipsoid surface; wherein the N motion trajectories have different direction angles, and the N motion trajectories correspond to N sound effects; According to the user's sound effect selection operation, a motion trajectory corresponding to the sound effect selection operation is determined from the N motion trajectories as the target motion trajectory; or, the target motion trajectory is determined according to the popularity of the sound effects corresponding to the N motion trajectories.

5. The 3D sound effect processing method according to claim 4, characterized in that: The step of determining the target motion trajectory according to the popularity of the sound effects corresponding to the N motion trajectories includes: According to the popularity of N kinds of sound effects, weighted processing is performed on the N motion trajectories to obtain the target motion trajectory; or, According to the popularity of the N sound effects, a motion trajectory corresponding to the sound effect with the highest popularity is selected from the N sound effects as the target motion trajectory.

6. The 3D sound effect processing method according to claim 1, characterized in that: After the trajectory model based on the ellipsoid surface simulates the target motion trajectory of the target audio playback device in the three-dimensional coordinate system, the method further includes: Determine the popularity of N sound effects, wherein the N preset radius lengths of the ellipsoid surface correspond to the N sound effects; According to the popularity of N kinds of sound effects and N kinds of preset radius lengths of the ellipsoidal surface, a target radius length is obtained; The radius length of the trajectory model of the ellipsoid surface is updated to the target radius length; wherein the target radius length includes: the x-axis radius length, the y-axis radius length and the z-axis radius length.

7. The 3D sound effect processing method according to claim 6, characterized in that: The method of obtaining the target radius length according to the popularity of the N sound effects and the N radius lengths of the ellipsoid surface includes: According to the popularity of the N sound effects, weighted processing is performed on the N preset radius lengths to obtain the target radius length; or, According to the popularity of the N sound effects, the radius length of the ellipsoid surface corresponding to the sound effect with the highest popularity is selected from the N sound effects as the target radius length.

8. A terminal, comprising: A transceiver, a memory, a processor, and a computer program stored in the memory and executable on the processor; wherein the processor is used to read the program in the memory to implement the steps in the 3D sound processing method as described in any one of claims 1 to 7.

9. A computer-readable storage medium for storing a computer program, characterized in that: When the computer program is executed by a processor, the steps in the 3D sound effect processing method according to any one of claims 1 to 7 are implemented.

Images