Special effects processing methods and devices

Abstract

This application discloses a special effects processing method and apparatus. The method includes: preloading audio data to be played; dividing the audio data into multiple audio segments; determining the feature parameters of each audio segment and the feature parameters of the audio data; determining the base score of the audio data based on the feature parameters of the audio data; for each audio segment, determining the score rate of the audio segment based on the feature parameters of the audio segment and the feature parameters of the audio data; for each audio segment, determining the score of the audio segment based on the score rate of the audio segment and the base score of the audio data; and displaying corresponding visual effects based on the score of the currently playing audio segment during audio playback. Based on the technical solution disclosed in this application, adapted visual effects are output during audio playback, thereby enhancing the user's visual experience.

Description

Technical Field

[0001] This application belongs to the field of extended reality technology, and in particular relates to a special effects processing method and apparatus. Background Technology

[0002] Extended reality (AR) refers to creating an interactive virtual environment by combining the real and virtual worlds. AR is a collective term for virtual reality, augmented reality, and mixed reality. Improving the user's visual experience is a problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0003] In view of this, the purpose of this application is to provide a special effects processing method and apparatus that outputs appropriate visual effects during audio playback, thereby enhancing the user's visual experience.

[0004] To achieve the above objectives, this application provides the following technical solution:

[0005] Firstly, this application provides a special effects processing method applied to an augmented reality device, the special effects processing method comprising:

[0006] Preload audio data to be played;

[0007] The audio data is divided into multiple audio segments;

[0008] The feature parameters of each audio segment and the feature parameters of the audio data are determined. The feature parameters of the audio segment include the mean amplitude and the variance of the amplitude. The feature parameters of the audio data include the maximum amplitude, the minimum amplitude, the mean amplitude, and the variance of the amplitude.

[0009] The basic score of the audio data is determined based on the feature parameters of the audio data;

[0010] For each audio segment, the score rate of the audio segment is determined based on the feature parameters of the audio segment and the feature parameters of the audio data, wherein the score rate of the audio segment is positively correlated with the difference between the feature parameters of the audio segment and the feature parameters of the audio data;

[0011] For each audio segment, the score of the audio segment is determined based on the score rate of the audio segment and the base score;

[0012] During the playback of the audio data, corresponding visual effects are displayed based on the score of the audio segment being played.

[0013] Optionally, determining the basic score of the audio data based on the feature parameters of the audio data includes:

[0014] The first basic score is determined based on the average amplitude of the audio data;

[0015] The second basic score is determined based on the amplitude variance of the audio data;

[0016] The base score is determined based on the first base score, the second base score, and the preset weight.

[0017] Optionally, determining the score of the audio segment based on the feature parameters of the audio segment and the feature parameters of the audio data includes:

[0018] According to the formula Calculate the initial score rate of the audio segment;

[0019] The initial score rate of the audio segment is normalized to obtain the score rate of the audio segment;

[0020] Wherein, ScoreRate′ is the initial score rate of the audio segment, var is the amplitude variance of the audio segment, var0 is the amplitude variance of the audio data, max0 is the maximum amplitude of the audio data, and min0 is the minimum amplitude of the audio data.

[0021] Optionally, determining the score of the audio segment based on the feature parameters of the audio segment and the feature parameters of the audio data includes:

[0022] According to the formula Calculate the initial score rate of the audio segment;

[0023] The initial score rate of the audio segment is normalized to obtain the score rate of the audio segment;

[0024] Wherein, ScoreRate′ is the initial score rate of the audio segment, ave is the average amplitude of the audio segment, ave0 is the average amplitude of the audio data, max0 is the maximum amplitude of the audio data, and min0 is the minimum amplitude of the audio data.

[0025] Optionally, determining the score of the audio segment based on the score rate of the audio segment and the base score includes:

[0026] The score of the audio segment is calculated using the formula Score = BaseScore + ScoreRate * (BaseScore + HighScore);

[0027] Wherein, Score is the score of the audio segment, BaseScore is the base score, ScoreRate is the score rate of the audio segment, and HighScore is the score corresponding to the climax indicator.

[0028] Secondly, this application provides a special effects processing device for use in an augmented reality device, the special effects processing device comprising:

[0029] The preloading module is used to preload the audio data to be played.

[0030] A data segmentation module is used to segment the audio data into multiple audio segments;

[0031] The feature parameter determination module is used to determine the feature parameters of each audio segment and the feature parameters of the audio data. The feature parameters of the audio segment include the mean amplitude and the variance of the amplitude, and the feature parameters of the audio data include the maximum amplitude, the minimum amplitude, the mean amplitude, and the variance of the amplitude.

[0032] The basic score determination module is used to determine the basic score of the audio data based on the feature parameters of the audio data;

[0033] The score rate determination module is used to determine the score rate of each audio segment based on the feature parameters of the audio segment and the feature parameters of the audio data, wherein the score rate of the audio segment is positively correlated with the difference between the feature parameters of the audio segment and the feature parameters of the audio data;

[0034] An audio segment score determination module is used to determine the score of each audio segment based on the score rate of the audio segment and the base score.

[0035] The special effects processing module is used to display corresponding visual effects based on the score of the audio segment being played during the playback of the audio data.

[0036] Optionally, the basic score determination module includes:

[0037] The first basic score determination unit is used to determine a first basic score based on the mean amplitude of the audio data, determine a second basic score based on the variance of the amplitude of the audio data, and determine a basic score based on the first basic score, the second basic score, and a preset weight.

[0038] Optionally, the score rate determination module includes:

[0039] The first score rate determination unit is used to determine the score rate according to the formula. Calculate the initial score rate of the audio segment, normalize the initial score rate of the audio segment, and obtain the score rate of the audio segment.

[0040] Wherein, ScoreRate′ is the initial score rate of the audio segment, var is the amplitude variance of the audio segment, var0 is the amplitude variance of the audio data, max0 is the maximum amplitude of the audio data, and min0 is the minimum amplitude of the audio data.

[0041] Optionally, the score rate determination module includes:

[0042] The second score rate determination unit is used to determine the score rate according to the formula. Calculate the initial score rate of the audio segment, normalize the initial score rate of the audio segment, and obtain the score rate of the audio segment.

[0043] Wherein, ScoreRate′ is the initial score rate of the audio segment, ave is the average amplitude of the audio segment, ave0 is the average amplitude of the audio data, max0 is the maximum amplitude of the audio data, and min0 is the minimum amplitude of the audio data.

[0044] Optionally, the audio segment score determination module includes:

[0045] The first audio segment determination unit is used to calculate the score of the audio segment according to the following formula;

[0046] Score=BaseScore+ScoreRate*(BaseScore+HighScore)

[0047] Wherein, Score is the score of the audio segment, BaseScore is the base score, ScoreRate is the score rate of the audio segment, and HighScore is the score corresponding to the climax indicator.

[0048] Therefore, the beneficial effects of this application are as follows:

[0049] The special effects processing method and apparatus disclosed in this application preload audio data to be played into an extended reality device, divide the audio data into multiple audio segments, and determine the score of each audio segment. The score of each audio segment is determined based on the base score of the audio data and the score rate of the audio segment. During the playback of the audio data, the corresponding visual effects are displayed according to the score of the currently playing audio segment, providing users with richer display content and enhancing the user's visual experience. Attached Figure Description

[0050] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0051] Figure 1 A flowchart of a special effects processing method disclosed in this application;

[0052] Figure 2 This is a schematic diagram of the structure of a special effects processing device disclosed in this application. Detailed Implementation

[0053] This application discloses a special effects processing method and apparatus that outputs appropriate visual effects during audio playback, thereby enhancing the user's visual experience.

[0054] First, let's explain the terminology used in this application:

[0055] VR: Virtual Reality;

[0056] AR: Augmented Reality;

[0057] MX: Mixed Reality;

[0058] XR: Extended Reality;

[0059] PCM: Pulse Code Modulation.

[0060] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0061] See Figure 1 , Figure 1 This is a flowchart of a special effects processing method disclosed in this application. The method is applied to an extended reality device, wherein the extended reality device can be a virtual reality device, an augmented reality device, or a mixed reality device. The method includes:

[0062] S11: Preload audio data to be played.

[0063] Before playing music, the extended reality device preloads audio data into memory. This preloaded audio data can be in PCM format.

[0064] In practice, the extended reality device converts audio files into PCM format audio data, and then preloads the PCM format audio data into memory. Audio file formats include, but are not limited to: mp3, ogg, avi, wmv, rmvb, and wav.

[0065] S12: Divide the audio data into multiple audio segments.

[0066] In practice, various methods can be used to segment audio data into multiple audio segments.

[0067] The first approach is to divide the audio data into a specified number of audio segments according to the rule of equal duration.

[0068] The second approach involves dividing the audio data into a specified number of audio segments; comparing the feature parameters of each audio segment; and merging adjacent audio segments into a single audio segment if their feature parameters meet a preset similarity condition. The preset similarity condition could be that the difference in feature parameters is within a preset range.

[0069] For example, audio data is divided into 5 audio segments, numbered 1, 2, 3, 4, and 5. If the feature parameters of audio segments numbered 1 and 2 satisfy a preset similarity condition, the feature parameters of audio segments numbered 2 and 3 satisfy the preset similarity condition, and the feature parameters of audio segments numbered 3 and 4 do not satisfy the preset similarity condition, then the three audio segments numbered 1, 2, and 3 are merged into one audio segment, while the two audio segments numbered 4 and 5 remain unchanged, resulting in a total of 3 audio segments.

[0070] S13: Determine the feature parameters of each audio segment and the feature parameters of the audio data.

[0071] The characteristic parameters of an audio segment include the mean amplitude and the variance of the amplitude, while the characteristic parameters of audio data include the maximum amplitude, the minimum amplitude, the mean amplitude, and the variance of the amplitude.

[0072] The feature parameters of audio data can be understood as global feature parameters, while the feature parameters of each audio segment can be understood as local feature parameters. The mean amplitude of audio data can characterize the type of music. The variance of audio data can characterize the intensity of the music.

[0073] S14: Determine the basic score of the audio data based on the characteristic parameters of the audio data.

[0074] Option 1:

[0075] The base score of the audio data is determined based on the mean amplitude of the audio data.

[0076] In implementation, a correspondence between the mean amplitude and the fundamental score is pre-established. The fundamental score of the audio data is determined based on the mean amplitude of the audio data and the aforementioned correspondence. In the first approach, the fundamental score of the audio data can characterize the type of music; from another perspective, the fundamental score of the audio data is mainly determined by the type of music.

[0077] Musical genres are primarily determined by the frequency and rhythm of the music. A musical genre represents the intensity of its rhythm. For example, musical genres include: gentle, calm, lively, fast, and intense. Of course, this is just one example of musical genres, and music is not limited to these.

[0078] The second option:

[0079] The basic score of the audio data is determined based on the amplitude variance of the audio data.

[0080] In implementation, a correspondence between amplitude variance and fundamental score is pre-established, and the fundamental score of the audio data is determined based on the amplitude variance of the audio data and the aforementioned correspondence. In the second approach, the fundamental score of the audio data can characterize the intensity of the music; from another perspective, the fundamental score of the audio data is mainly determined by the intensity of the music.

[0081] The third option:

[0082] The first base score is determined based on the mean amplitude of the audio data; the second base score is determined based on the variance of the amplitude of the audio data; and the base score is determined based on the first base score, the second base score, and the preset weights.

[0083] In practice, a correspondence between the mean amplitude and the base score is pre-established, and a correspondence between the variance amplitude and the base score is pre-established. The first base score of the audio data is determined based on the mean amplitude of the audio data and the first correspondence mentioned above. The second base score of the audio data is determined based on the variance amplitude of the audio data and the second correspondence mentioned above. Then, the base score of the audio data is determined according to the following formula.

[0084] BaseScore = Score ave *l+Score var *(1-l)

[0085] Where BaseScore is the base score of the audio data, and Score is the base score.var The first base score for audio data, Score ave Let be the second basic score of the audio data, l be the weight corresponding to the first basic score, and 1-l be the weight corresponding to the second basic score. The sum of the weights corresponding to the first and second basic scores is 1. The weights of the first and second basic scores can be empirical values ​​or user-defined.

[0086] In the third approach, the basic score of the audio data is determined based on the mean and variance of the amplitude. In other words, the basic score of the audio data can characterize the type and intensity of the music.

[0087] S15: For each audio segment, determine the score of the audio segment based on the feature parameters of the audio segment and the feature parameters of the audio data.

[0088] The score of an audio segment is positively correlated with the difference between the feature parameters of that audio segment and the feature parameters of the audio data. In other words, the larger the difference between the feature parameters of the audio segment and the feature parameters of the audio data, the higher the score of the audio segment; conversely, the smaller the difference between the feature parameters of the audio segment and the feature parameters of the audio data, the lower the score of the audio segment.

[0089] Option 1:

[0090] According to the formula Calculate the initial score of the audio segment;

[0091] The initial score of the audio segment is normalized to obtain the score of the audio segment.

[0092] Where ScoreRate′ is the initial score rate of the audio segment, var is the amplitude variance of the audio segment, var0 is the amplitude variance of the audio data, max0 is the maximum amplitude of the audio data, and min0 is the minimum amplitude of the audio data.

[0093] The second option:

[0094] According to the formula Calculate the initial score of the audio segment;

[0095] The initial score of the audio segment is normalized to obtain the score of the audio segment.

[0096] Where ScoreRate′ is the initial score rate of the audio segment, ave is the mean amplitude of the audio segment, ave0 is the mean amplitude of the audio data, max0 is the maximum amplitude of the audio data, and min0 is the minimum amplitude of the audio data.

[0097] In the two schemes for determining the score rate of audio segments disclosed above, normalizing the initial score rate after calculating the initial score rate means normalizing the initial score rate to the range of (0,1).

[0098] Understandably, if the type or intensity of an audio segment differs significantly from the type or intensity of the overall audio, the audio segment will have a higher score and a higher final score. This results in a significant difference between the visual effects displayed by the extended reality device while playing the audio segment and the visual effects displayed while playing other audio segments.

[0099] S16: For each audio segment, determine the score of the audio segment based on the score rate of the audio segment and the base score of the audio data.

[0100] The first approach: Calculate the score of the audio segment using the formula Score = BaseScore + ScoreRate * BaseScore.

[0101] Wherein, Score is the score of the audio segment, BaseScore is the base score of the audio data, and ScoreRate is the score rate of the audio segment.

[0102] The second approach is to calculate the score of the audio segment using the formula Score = BaseScore + ScoreRate * (BaseScore + HighScore).

[0103] Wherein, Score is the score of the audio segment, BaseScore is the base score of the audio data, ScoreRate is the score rate of the audio segment, and HighScore is the score corresponding to the climax indicator.

[0104] This section explains HighScore.

[0105] For each audio segment, determine whether it is a climax segment and set a climax indicator for it. For example, if the audio segment is a climax segment, the value of the climax indicator set for the audio segment is the first data (e.g., 1), and the corresponding score is the first numerical value (e.g., 100). If the audio segment is not a climax segment, the value of the climax indicator set for the audio segment is the second numerical value (e.g., 0), and the corresponding score is the second numerical value (e.g., 0).

[0106] In the second approach to determining the score of an audio segment, whether the audio segment is a climax segment is taken into consideration, so that the visual effects displayed by the extended reality device during the playback of the climax segment are significantly different from the visual effects displayed during the playback of other non-climax segments.

[0107] S17: During the playback of audio data, display corresponding visual effects based on the score of the audio segment being played.

[0108] In practice, a pre-established correspondence between the scores of audio segments and visual effects is constructed. While playing audio data, the extended reality device determines the visual effect corresponding to the score of the currently playing audio segment based on this correspondence and displays that visual effect to the user.

[0109] It should be noted that the extended reality device determines the score of the audio segment before playing it.

[0110] The visual effects in this application include, but are not limited to, fireworks effects and lighting effects.

[0111] Fireworks and lighting effects can be further categorized based on their special effects parameters. For example, fireworks effects can be further divided into multiple categories based on one or more of the firework color and release frequency. Similarly, lighting effects can be further divided into multiple categories based on one or more of the light color and flashing frequency.

[0112] Optionally, in the aforementioned correspondence between audio segment scores and visual effects, the greater the difference in audio segment scores, the greater the difference in corresponding visual effects.

[0113] Optionally, in the aforementioned correspondence between audio segment scores and visual effects, the higher the score of the audio segment, the more prominent the visual effect of the corresponding visual effect. For example, if the first score is higher than the second score, the fireworks effect corresponding to the first score will contain more colors and have a higher release frequency, presenting a more prominent visual effect compared to the fireworks effect corresponding to the second score.

[0114] The special effects processing method disclosed in this application preloads audio data to be played into an extended reality device, divides the audio data into multiple audio segments, and determines the score of each audio segment. The score of each audio segment is determined based on the base score of the audio data and the score rate of the audio segment. During the playback of the audio data, the corresponding visual effects are displayed according to the score of the currently playing audio segment, providing users with richer display content and enhancing the user's visual experience.

[0115] The present application discloses a special effects processing method for extended reality devices. Correspondingly, the present application also discloses a special effects processing apparatus for extended reality devices. The descriptions of the two in the specification can be referenced to each other.

[0116] See Figure 2 , Figure 2This is a schematic diagram of the special effects processing device disclosed in this application.

[0117] The special effects processing device includes a preloading module 201, a data segmentation module 202, a feature parameter determination module 203, a basic score determination module 204, a score rate determination module 205, an audio segment score determination module 206, and a special effects processing module 207.

[0118] in:

[0119] The preloading module 201 is used to preload the audio data to be played.

[0120] The data segmentation module 202 is used to segment audio data into multiple audio segments.

[0121] The feature parameter determination module 203 is used to determine the feature parameters of each audio segment and the feature parameters of the audio data. The feature parameters of the audio segment include the mean amplitude and the variance of the amplitude, and the feature parameters of the audio data include the maximum amplitude, the minimum amplitude, the mean amplitude, and the variance of the amplitude.

[0122] The basic score determination module 204 is used to determine the basic score of the audio data based on the characteristic parameters of the audio data.

[0123] The score rate determination module 205 is used to determine the score rate of each audio segment based on the feature parameters of the audio segment and the feature parameters of the audio data. The score rate of an audio segment is positively correlated with the difference between the feature parameters of the audio segment and the feature parameters of the audio data.

[0124] The audio segment score determination module 206 is used to determine the score of each audio segment based on the audio segment's score rate and base score.

[0125] The special effects processing module 207 is used to display corresponding visual effects based on the score of the audio segment being played during the playback of audio data.

[0126] In practice, a pre-established correspondence between the scores of audio segments and visual effects is constructed. While playing audio data, the extended reality device determines the visual effect corresponding to the score of the currently playing audio segment based on this correspondence and displays that visual effect to the user.

[0127] It should be noted that the extended reality device determines the score of the audio segment before playing it.

[0128] The visual effects in this application include, but are not limited to, fireworks effects and lighting effects.

[0129] Fireworks and lighting effects can be further categorized based on their special effects parameters. For example, fireworks effects can be further divided into multiple categories based on one or more of the firework color and release frequency. Similarly, lighting effects can be further divided into multiple categories based on one or more of the light color and flashing frequency.

[0130] Optionally, in the aforementioned correspondence between audio segment scores and visual effects, the greater the difference in audio segment scores, the greater the difference in corresponding visual effects.

[0131] Optionally, in the aforementioned correspondence between audio segment scores and visual effects, the higher the score of the audio segment, the more prominent the visual effect of the corresponding visual effect. For example, if the first score is higher than the second score, the fireworks effect corresponding to the first score will contain more colors and have a higher release frequency, presenting a more prominent visual effect compared to the fireworks effect corresponding to the second score.

[0132] The special effects processing device disclosed in this application preloads audio data to be played, divides the audio data into multiple audio segments, and determines the score of each audio segment. The score of each audio segment is determined based on the base score of the audio data and the score rate of the audio segment. During the playback of the audio data, the corresponding visual effects are displayed according to the score of the currently playing audio segment, providing users with richer display content and enhancing the user's visual experience.

[0133] Optionally, the base score determination module 204 includes:

[0134] The first basic score determination unit is used to determine the first basic score based on the mean amplitude of the audio data, determine the second basic score based on the variance of the amplitude of the audio data, and determine the basic score based on the first basic score, the second basic score, and the preset weights.

[0135] Optionally, the base score determination module 204 includes:

[0136] The second basic score determination unit is used to determine the basic score of the audio data based on the average amplitude of the audio data.

[0137] Optionally, the base score determination module 204 includes:

[0138] The third basic score determination unit is used to determine the basic score of the audio data based on the amplitude variance of the audio data.

[0139] Optionally, the score determination module 205 includes:

[0140] The first score rate determination unit is used to determine the score rate according to the formula. Calculate the initial score rate of the audio segment, normalize the initial score rate of the audio segment, and obtain the score rate of the audio segment.

[0141] Where ScoreRate′ is the initial score rate of the audio segment, var is the amplitude variance of the audio segment, var0 is the amplitude variance of the audio data, max0 is the maximum amplitude of the audio data, and min0 is the minimum amplitude of the audio data.

[0142] Optionally, the score determination module 205 includes:

[0143] The second score rate determination unit is used to determine the score rate according to the formula. Calculate the initial score rate of the audio segment, normalize the initial score rate of the audio segment, and obtain the score rate of the audio segment.

[0144] Where ScoreRate′ is the initial score rate of the audio segment, ave is the mean amplitude of the audio segment, ave0 is the mean amplitude of the audio data, max0 is the maximum amplitude of the audio data, and min0 is the minimum amplitude of the audio data.

[0145] Optionally, the audio segment score determination module 206 includes:

[0146] The first audio segment determination unit is used to calculate the score of the audio segment according to the following formula;

[0147] Score=BaseScore+ScoreRate*(BaseScore+HighScore)

[0148] Wherein, Score is the score of the audio segment, BaseScore is the base score, ScoreRate is the score rate of the audio segment, and HighScore is the score corresponding to the climax indicator.

[0149] Optionally, the audio segment score determination module 206 includes:

[0150] The second audio segment determination unit is used to calculate the score of the audio segment according to the following formula;

[0151] Score=BaseScore+ScoreRate*BaseScore

[0152] Wherein, Score is the score of the audio segment, BaseScore is the base score of the audio data, and ScoreRate is the score rate of the audio segment.

[0153] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0154] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. As the special effects processing apparatus disclosed in the embodiments corresponds to the special effects processing methods disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0155] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method of special effects processing, characterized by, The special effect processing method is applied to an extended reality device, and the method comprises: Preloading audio data to be played; Segmenting the audio data into a plurality of audio segments; Determining feature parameters of each audio segment and feature parameters of the audio data, wherein the feature parameters of each audio segment comprise an average amplitude and an amplitude variance, and the feature parameters of the audio data comprise a maximum amplitude, a minimum amplitude, an average amplitude, and an amplitude variance; Determining a base score of the audio data according to the feature parameters of the audio data; For each audio segment, determining a score rate of the audio segment according to the feature parameters of the audio segment and the feature parameters of the audio data, wherein the score rate of the audio segment is positively correlated with a difference between the feature parameters of the audio segment and the feature parameters of the audio data; For each audio segment, determining a score of the audio segment according to the score rate of the audio segment and the base score; During playing of the audio data, displaying a corresponding visual special effect according to the score of the audio segment being played; The determining of the base score of the audio data according to the feature parameters of the audio data comprises: Determining a first base score according to the average amplitude of the audio data; Determining a second base score according to the amplitude variance of the audio data; Determining the base score according to the first base score, the second base score, and a preset weight.

2. The special effect processing method according to claim 1, wherein The determining of the score rate of the audio segment according to the feature parameters of the audio segment and the feature parameters of the audio data comprises: According to the formula calculate an initial score rate for the audio segment; Normalizing an initial score rate of the audio segment to obtain the score rate of the audio segment. wherein, is an initial score rate for the audio segment, is an amplitude variance for the audio segment, is an amplitude variance for the audio data, is an amplitude maximum for the audio data, is an amplitude minimum for the audio data.

3. The special effect processing method according to claim 1, wherein The determining of the score rate of the audio segment according to the feature parameters of the audio segment and the feature parameters of the audio data comprises: According to the formula calculate an initial score rate for the audio segment; Normalizing an initial score rate of the audio segment to obtain the score rate of the audio segment. wherein, is an initial score rate for the audio segment, is an amplitude mean for the audio segment, is an amplitude mean for the audio data, is an amplitude maximum for the audio data, is an amplitude minimum for the audio data.

4. The special effect processing method according to claim 1, wherein The determining of the score of the audio segment according to the score rate of the audio segment and the base score comprises: The score of the audio segment is calculated according to the formula score = 1 - exp(-0.1 * (1 - similarity)2) wherein, is a score for the audio segment, is the base score, is a score rate for the audio segment, is a score corresponding to the climax identification.

5. A special effect processing apparatus characterized by comprising: The special effect processing device is applied to an extended reality device, and the device comprises: A preloading module configured to preload audio data to be played; A data segmentation module configured to segment the audio data into a plurality of audio segments; A feature parameter determination module configured to determine feature parameters of each audio segment and feature parameters of the audio data, wherein the feature parameters of each audio segment comprise an average amplitude and an amplitude variance, and the feature parameters of the audio data comprise a maximum amplitude, a minimum amplitude, an average amplitude, and an amplitude variance; A base score determination module configured to determine a base score of the audio data according to the feature parameters of the audio data; A score rate determination module configured to, for each audio segment, determine a score rate of the audio segment according to the feature parameters of the audio segment and the feature parameters of the audio data, wherein the score rate of the audio segment is positively correlated with a difference between the feature parameters of the audio segment and the feature parameters of the audio data; and A score determination module configured to, for each audio segment, determine a score of the audio segment according to the score rate of the audio segment and the base score. The audio segment score determination module is configured to determine, for each audio segment, a score of the audio segment according to a score rate of the audio segment and the base score; The special effect processing module is configured to display a corresponding visual special effect according to the score of the audio segment being played during playing of the audio data. The base score determination module includes: The first base score determination unit is configured to determine a first base score according to an amplitude mean of the audio data, determine a second base score according to an amplitude variance of the audio data, and determine a base score according to the first base score, the second base score, and a preset weight.

6. The special effects apparatus of claim 5, wherein, The score rate determination module includes: The first score rate determining unit is configured to calculate an initial score rate of the audio segment according to a formula and normalize the initial score rate of the audio segment to obtain the score rate of the audio segment. wherein, is an initial score rate for the audio segment, is an amplitude variance for the audio segment, is an amplitude variance for the audio data, is an amplitude maximum value for the audio data, is an amplitude minimum value for the audio data.

7. The special effects processing apparatus of claim 5, wherein The score rate determination module includes: The second score rate determining unit is configured to calculate an initial score rate of the audio segment according to a formula and normalize the initial score rate of the audio segment to obtain the score rate of the audio segment. wherein, is an initial score rate for the audio segment, is an amplitude mean for the audio segment, is an amplitude mean for the audio data, is an amplitude maximum for the audio data, is an amplitude minimum for the audio data.

8. The special effects processing apparatus of claim 5, wherein, The audio segment score determination module includes: The first audio segment determination unit is configured to calculate the score of the audio segment according to the following formula: wherein, is a score for the audio segment, is the base score, is a score rate for the audio segment, is a score corresponding to the climax identification.

Images