Sound effect configuration method and device, smart speaker, computer equipment and storage medium

Abstract

The present application relates to a method and device for configuring sound effects, a smart speaker, a computer device, and a computer device storage medium; the method includes: obtaining a target song selected by a user, searching for a song file of the target song from a song library; enabling a player to read the song file and identify a classification tag of the song file; wherein the song library stores song files, and each song file is provided with a classification tag; searching for a target sound effect configuration file from a sound effect configuration file library according to the classification tag; wherein the sound effect configuration file library stores sound effect configuration files corresponding to each classification tag, and the sound effect configuration file records sound effect parameters; sending the target sound effect configuration file to the audio processor of the sound system, and configuring the sound effect parameters of each sound channel of the sound system according to the target sound effect configuration file. This technical solution can improve the accuracy of sound effect pattern recognition, reduce the difficulty of sound effect configuration for users, and improve user experience.

Description

Technical Field

[0001] The present application relates to the field of audio processing technology, and in particular to a method and apparatus for configuring sound effects, a smart speaker, a computer device, and a computer device storage medium. Background Art

[0002] In audio-visual entertainment equipment, sound processing is a very important part. Good sound effects can allow users to experience the most beautiful auditory enjoyment and enjoy the charm of music.

[0003] At present, there are two main ways to adjust the sound effects: manual and adaptive adjustment. The adaptive adjustment method mainly uses software to identify the type of audio files and other information, and then selects the corresponding sound effect mode for setting. For example, China Patent Publication No. "CN104811864B" discloses a method and system for adaptively adjusting sound effects, and China Patent Publication No. "CN103731722A" discloses a method and device for adaptively adjusting sound effects, and China Patent Publication No. "CN107590152A" discloses a method and device for adjusting the sound effect mode of audio. These technical solutions mainly implement adaptive sound effect parameter adjustment on the player, identify the sound effect mode of the audio being played, and then perform corresponding sound effect processing on the audio played by the player according to the pre-configured sound effect parameters and then output it.

[0004] However, in actual applications, the applicant found that the above-mentioned technical solutions, which rely on the adaptive method, are prone to errors in matching the sound effect mode and the sound effect parameters; and the sound effect adjustment is based on the player. Due to the insufficient digital processing capabilities of the player, the precision and professionalism of the sound effect processing are low, making it difficult to apply to professional entertainment equipment; and using these technical solutions, it is difficult for users to customize audio configurations and expand other configuration methods. Summary of the invention

[0005] In order to solve one of the above-mentioned defects, the present application provides a sound effect configuration method and device, a smart speaker, a computer device and a computer device storage medium. This technical solution can avoid matching errors and facilitate the expansion of custom audio configurations and other configuration methods, and is particularly suitable for professional entertainment equipment.

[0006] A sound effect configuration method, comprising:

[0007] Obtain a target song selected by a user, and search for a song file of the target song from a song library;

[0008] Enabling a player to read the song file and identify the classification mark of the song file; wherein the song library stores song files, each of which is provided with a classification mark;

[0009] Searching for a target sound effect configuration file from a sound effect configuration file library according to the classification mark; wherein the sound effect configuration file library stores the sound effect configuration files corresponding to each classification mark, and the sound effect configuration files record sound effect parameters;

[0010] The target sound effect configuration file is sent to the audio processor of the sound system, and the sound effect parameters of each sound channel of the sound system are configured according to the target sound effect configuration file.

[0011] In one embodiment, the sound effect configuration method further includes:

[0012] Modify the audio configuration file by custom modification or online configuration modification;

[0013] The modified sound effect configuration file replaces the original sound effect configuration file and is saved in the sound effect configuration file library, and loaded into the personal database of the user.

[0014] In one embodiment, the sound effect configuration method further includes:

[0015] An audio configuration file is constructed according to a predetermined format, wherein the audio configuration file includes various sound effect setting items and parameter options.

[0016] Corresponding audio parameters are set respectively according to the classification, and the audio parameters are recorded in the parameter options.

[0017] The audio configuration file is associated with the corresponding classification tag, and the audio configuration file is stored in the audio configuration file library.

[0018] In one embodiment, the sound effect configuration method further includes:

[0019] Call the system's sound configuration tool;

[0020] Modifying the target sound effect configuration file using the sound effect configuration tool;

[0021] The modified sound effect configuration file replaces the original sound effect configuration file and is saved in the sound effect configuration file library, and loaded into the personal database of the user.

[0022] In one embodiment, the sound effect configuration method further includes:

[0023] Apply for online tuning assistance from the platform server;

[0024] Send the song file to the platform server for online tuning;

[0025] Receive the tuned song file returned by the platform server, and play the song file for the user to confirm;

[0026] After the user confirms, the sound effect configuration file generated by the online tuning is saved to the sound effect configuration file library and loaded into the user's personal database.

[0027] In one embodiment, the sound effect configuration method further includes:

[0028] Record the song sung by the user to obtain an initial song file;

[0029] Upload the initial song file to the platform server, add accompaniment and sound effect configuration to the initial song file online, and obtain a self-created song file;

[0030] The self-created song file returned by the receiving platform server is stored in the song library after adding a classification mark to the self-created song file, and is loaded into the personal database of the user.

[0031] In one embodiment, the sound effect configuration method further includes:

[0032] Acquiring somatosensory interaction data of the user;

[0033] The somatosensory interaction data is uploaded to the platform server, and accompaniment and sound effect configuration are added to the initial song file online according to the somatosensory interaction data.

[0034] In one embodiment, the sound effect configuration method further includes:

[0035] Establishing communication with an external terminal device and receiving a song file transmitted by the external terminal;

[0036] Uploading the song file to the platform server; extracting the accompaniment data of the song file on the platform server, matching the video background according to the category of the song file, and generating a new song file according to the accompaniment data and the video background;

[0037] The new song file returned by the receiving platform server is stored in the song library after adding a classification mark to the new song file, and is loaded into the personal database of the user.

[0038] In one embodiment, the sound effect configuration method further includes:

[0039] Get the songs of interest and their category information selected by the user;

[0040] Calling a sound effect configuration tool to extract the accompaniment data of the song of interest;

[0041] Extracting sound effect parameters according to the accompaniment data and generating a self-created sound effect configuration file;

[0042] A correspondence between the self-created sound effect configuration file and the category tag of the song file is established according to the category information, and the self-created sound effect configuration file is saved to the sound effect configuration file library and loaded into the user's personal database.

[0043] In one embodiment, the classification mark is disco dance, and the sound effect configuration parameters of the target sound effect configuration file are:

[0044] The bass volume is increased by 3-9dB, the 80Hz frequency is increased by 3-9dB, and the Q value is 0.5 to 2;

[0045] The full-range speaker channel volume attenuation is 1-3dB, the filter frequency is 1KHz~5KHz, the amplitude is 1~3dB, and the Q value is 0.5~2;

[0046] The bass channel limiting threshold is -6dB to -1dB, the compression ratio is 5:1 to 20:1, the start time is 5 to 20ms, and the recovery time is 100 to 200ms;

[0047] or

[0048] The classification mark is Tai Chi songs, and the sound effect configuration parameters of the target sound effect configuration file are:

[0049] The high-pass filter frequency is 60-120 Hz, and the filter order is second order;

[0050] The bass channel volume attenuation is 1 to 6 dB, and the low-pass filter frequency of the bass channel is 300 to 800 Hz;

[0051] The first EQ frequency point parameter of the full-range speaker channel is 200Hz~300Hz, the Q value is 0.5~2, and the amplitude is 1~6dB; the second EQ frequency point parameter is set to 500Hz~1000Hz, the Q value is 0.2~0.8, the amplitude is 1~3dB, and the third EQ frequency point parameter is set to 3KHz~8KHz, the Q value is 0.5~2, and the amplitude is 1~6dB;

[0052] or

[0053] The classification mark is karaoke mode, and the sound effect configuration parameters of the target sound effect configuration file are: the level of the microphone signal is always 3 to 6 dB higher than the level of the music signal.

[0054] A sound effect configuration device, comprising:

[0055] A song search unit, used to obtain a target song selected by a user and search for a song file of the target song from a song library;

[0056] A tag recognition unit, used to enable the player to read the song file and recognize the classification tag of the song file; wherein the song library stores song files, each of which is provided with a classification tag;

[0057] a target search unit, configured to search for a target sound effect configuration file from a sound effect configuration file library according to the classification mark; wherein the sound effect configuration file library stores the sound effect configuration files corresponding to each classification mark, and the sound effect configuration files record sound effect parameters;

[0058] The sound effect configuration unit is used to send the target sound effect configuration file to the audio processor of the sound system, and configure the sound effect parameters of each sound channel of the sound system according to the target sound effect configuration file.

[0059] A smart speaker, comprising: a processor system, and an image processing system and an audio system respectively connected to the processor system; wherein:

[0060] The processor system is used for the steps of the above-mentioned sound effect configuration method;

[0061] The image processing system is used to obtain the user's image data and feed it back to the processor system;

[0062] The sound system is used to set the sound effect parameters of each sound channel through the audio processor and play the song files output by the processor system.

[0063] A computer device comprising:

[0064] one or more processors;

[0065] Memory;

[0066] One or more application programs, wherein the one or more application programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs are configured to: execute the above-mentioned sound effect configuration method.

[0067] A computer-readable storage medium stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, at least one program, the code set or the instruction set is loaded by the processor and executes the above-mentioned sound effect configuration method.

[0068] The technical solution of this application has the following beneficial effects:

[0069] The technical solution of the above-mentioned embodiment sets classification tags for song files in advance, sets special sound effect parameters for each classification feature, and records the sound effect parameters through sound effect configuration files. The sound effect configuration files are stored in a sound effect configuration file library, and a sound effect processor is used to perform refined and professional sound effect adjustments on each sound channel; the player can accurately identify the target sound effect configuration file through the classification tags, thereby avoiding recognition errors; at the same time, by establishing a sound effect configuration file library, users can easily modify and expand the sound effect configuration files in the sound effect configuration file library. The equalizer of the player is highly professional for ordinary users, and it is difficult for users to adjust it accurately. The technical solution provided by the present application reduces the difficulty of users in sound effect configuration and improves user experience.

[0070] Additional aspects and advantages of the present application will be partially given in the following description, which will become apparent from the following description, or will be understood through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0072] Figure 1 is a schematic diagram of the structure of a smart speaker according to an embodiment;

[0073] Figure 2 is a schematic diagram of the electrical structure of a smart speaker according to an embodiment;

[0074] Figure 3 is an exploded diagram of the hardware structure of a somatosensory interaction device in one embodiment;

[0075] Figure 4 is a flow chart of a method for configuring sound effects in one embodiment;

[0076] Figure 5 This is an example timing diagram of the sound effect configuration method;

[0077] Figure 6 is a state diagram for an example custom audio profile;

[0078] Figure 7 is a schematic diagram of an example online tuning assistance;

[0079] Figure 8 is a schematic diagram of generating a self-created song according to an embodiment;

[0080] Fig. 9 is a schematic diagram of new song synthesis of an embodiment;

[0081] Fig.10 This is another example of a new song file synthesis flow chart;

[0082] Fig.11 It is a structural schematic diagram of the sound effect configuration device of the present application. DETAILED DESCRIPTION

[0083] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be interpreted as limiting the present application.

[0084] Those skilled in the art will appreciate that, unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present application refers to the presence of the features, integers, steps, operations, but does not exclude the presence or addition of one or more other features, integers, steps, operations.

[0085] To facilitate the description of the technical solution of the present application, a hardware device is used as an example for description below. In practical applications, the technical solution of the present application is not limited to a specific hardware device structure in the following embodiments, but can also be implemented on other hardware devices with the same functions. In addition, the song files targeted in the present application are not limited to music files, but can include various audio-visual entertainment files, audio files, audio and video files, etc., which is hereby explained.

[0086] refer to Figure 1 As shown, Figure 1 is a schematic diagram of the structure of a smart speaker in an embodiment. The technical solution of the audio configuration method of the present application can be applied to Figure 1 The smart speaker 100 shown includes: an image processing system 01, a processor system 13 and an audio system 03; the image processing system 01 is connected to the processor system 13, and the audio system 03 is connected to the processor system 13.

[0087] The image processing system 01 is used to capture image data associated with the user and send it to the processor system; the processor system 13 is responsible for the main functional parts of the system, including using a player to play song files, decoding the song files and outputting them to the audio system 03, and receiving image data fed back in real time by the image processing system 01; the audio system 03 is the audio processing part, receiving the decoded code stream of the song files output by the processor system 13, receiving the sound effect configuration file issued by the processor system 13, setting the sound effect parameters of each sound channel through the audio processor, that is, the DSP (Digital Signal Processing) chip, playing the song files output by the processor system, etc. Further, the image processing system 01 includes a camera 12 and an image recognition module 19, and the audio system 03 includes an audio processing circuit 14 and a speaker unit 15, wherein the camera 12 is configured to capture the user image and output image data in a specified format; the image recognition module 19 is configured to perform recognition processing on the image data.

[0088] Continue to refer Figure 1 The smart speaker 100 may specifically include a box body 11, a camera 12, an image recognition module 19, an audio system 03, and a processor system 13; the processor system 13 is connected to the speaker unit 15 through an audio processing circuit 14.

[0089] refer to Figure 2 As shown, Figure 2 The figure is a schematic diagram of the electrical structure of an intelligent speaker of an embodiment; as shown in the figure, the audio processing circuit 14 includes a DSP chip 141, a digital-to-analog conversion chip 142 and a power amplifier module 143 connected in sequence, and a wireless microphone receiving module 144 connected to the DSP chip 141; wherein the DSP chip 141 is connected to the processor system 13, and the power amplifier module 143 is connected to the speaker unit 15. The working principle of the audio processing circuit 14 is as follows: the DSP chip 141 processes the sound effects of the song file output by the processor system 13; the digital-to-analog conversion chip 142 can convert the digital signal into an analog signal; the power amplifier module 143 amplifies the power of the analog song file and outputs it to the speaker unit 15 for playback; the voice signal of the wireless microphone can be directly processed by the DSP chip 141 and sent to the speaker unit 15 for playback, or it can be input into the processor system 13 as a control signal for processing.

[0090] like Figure 2As shown, in order to enrich the peripheral functions of the smart speaker 100, the processor system 13 can also be provided with a video signal interface 131a, a microphone peripheral interface 131b, etc.; wherein the video signal interface 131a can be connected to an external display device, such as a TV, a projector, etc. The microphone peripheral interface 131b can be connected to an external microphone; the user can input operation instructions through the microphone button, and the processor system 13 executes the functions corresponding to these operation instructions. The processor system 13 can also be connected to an infrared receiving module 132, a Bluetooth module 133, a voice recognition module 134, etc.; wherein the infrared receiving module 132 can receive the control signal of the infrared remote control, the Bluetooth module 133 can receive the control signal of the Bluetooth remote control (such as a watch, a bracelet, a U-segment microphone with integrated Bluetooth transmission, etc.), and the voice recognition module 134 can recognize the voice signal input by the user through the pickup microphone 134A. The processor system 13 may also be provided with a motion capture peripheral interface 135 for connecting at least one external motion capture device 135A, which may be a dance mat, a dance pedal, etc., and may detect the user's footsteps and send the data to the processor system 13; the connection mode may be a wired connection or a wireless connection. For example, a USB connection mode may be used, or a wireless mode may be used, such as Bluetooth, WIFI, 2.4G / 5.8G, etc. Preferably, the smart speaker 100 may be connected to multiple motion capture devices 135A, and the camera 12 may simultaneously capture real-time motion images of multiple users.

[0091] refer to Figure 3 As shown, Figure 3It is an exploded diagram of the hardware structure of a somatosensory interactive device of an embodiment; a panel with holes 110 is provided at the front of the box 11, and the camera 12 is fixed to the panel with holes 110 through a shock-absorbing structure 111 to prevent the vibration of the speaker unit 15 during operation from causing the vibration of the camera 12. The panel with holes 110 and the box 11 can be softly connected through a third soft shock-absorbing member 111e. Preferably, the speaker unit 15 of the present application adopts a 2.1 dual-channel design, specifically a "2.1 channel + inverted phase tube" solution, as shown in the figure, specifically including a dual-voice coil mid-bass channel speaker 154 and a left channel tweeter 157L and a right channel tweeter 157R, and an inverted phase tube 155 is provided on the back plate 112 of the box 11. Preferably, the tweeter in the speaker unit 15 is installed on the hole position 110a; a plurality of circular holes 110a are arranged on the perforated panel 110, and the camera 12 and the speaker unit 15 (tweeter) can be assembled to any circular hole 110a on the perforated panel 110; a plurality of cameras 12 can be adapted to the circular hole 110a; in addition, in combination with the selection of the speaker unit 15, a plurality of tweeters can be adapted to the perforated panel 110 to meet different functional and cost requirements. A speaker mesh 15A is arranged between the speaker unit 15 and the perforated panel 110; a pickup microphone 134A and a voice recognition module 134 are arranged on the top of the box 11 to facilitate capturing voice signals. The infrared receiving module 132 is arranged at the front of the box 11 to receive infrared signals; the power module 16 and the power amplifier module 143 are arranged on a PCB board, and a shielding cover 113 is arranged between the processor system 13 and the power amplifier module 143 to avoid mutual interference; the motion capture peripheral interface 135, the microphone peripheral interface 131b and the external power interface can be arranged at the rear of the back plate 112. In addition, an electric rotating base 18 can be arranged under the box 11, and the box 11 can be rotated by the rotating base 18 to control the shooting direction of the camera 12 and track the user's movement position for shooting.

[0092] The following will take the smart speaker provided in the above example as an example to describe the embodiment of the sound effect configuration method of the present application.

[0093] refer to Figure 4 , Figure 4 The flowchart of the sound effect configuration method of an embodiment includes the following steps:

[0094] S110, obtaining a target song selected by a user, and searching a song file of the target song from a song library.

[0095] The processor system can accept user operations and control instructions, select the target song to be played, and the system can search for the song file of the target song in the song library of the platform server and download it. In addition, the song library can be set up locally on the smart speaker to store song files, and then the local song library will be searched accordingly.

[0096] In one embodiment, the sound effect configuration method of the present application may further include, before step S110:

[0097] S100, obtaining song files stored in the song library, and classifying the song files according to preset classification rules; constructing classification tags for each classification, associating the classification tags with corresponding song files, and storing them in the song library.

[0098] The scheme of the above-mentioned embodiment classifies and marks the stored song files, which is convenient for the player to read when playing the song files, and is used to retrieve the sound effect configuration file, thereby ensuring the accuracy of the song files and the sound effect configuration parameters that match them.

[0099] S120, enabling the player to read the song file and identify the classification mark of the song file; wherein the song library stores song files, each of which is provided with a classification mark;

[0100] In this step, the processor system starts the player to read the song file and the classification mark pre-set in the song file; in the present application, the song files are pre-set with corresponding classification marks to distinguish the classification type. For the classification method, the current standard classification method can be used, such as Chinese dance, rock, disco, square dance, hip-hop, HI-POP, Tai Chi, etc.; it can also be classified according to a custom method.

[0101] S130, searching for a target sound effect configuration file from a sound effect configuration file library according to the classification mark; wherein the sound effect configuration file library stores sound effect configuration files corresponding to each classification mark, and the sound effect configuration files record sound effect parameters.

[0102] In the scheme of this embodiment, before playing the song file, the processor system stores the sound effect configuration files corresponding to each classification tag through the sound effect configuration file library. The sound effect configuration files record the sound effect parameters, which are used to adjust the frequency range, attenuation value, limiting amplitude, etc. of each sound channel; the sound effect configuration files have a corresponding relationship with the classification tags, and each classification tag can correspond to a sound effect configuration file; the target sound effect configuration file can be found from the library sound effect configuration files through the classification tags.

[0103] In one embodiment, the sound effect configuration method of the present application, step S130 may further include:

[0104] 1) Constructing an audio configuration file according to a predetermined format, wherein the audio configuration file includes various sound effect setting items and parameter options.

[0105] 2) Setting corresponding audio parameters respectively according to the classification, and recording the audio parameters in the parameter options.

[0106] 3) Establishing an association between the audio configuration file and the corresponding classification tag, and storing the audio configuration file in the audio configuration file library.

[0107] The scheme of the above-mentioned embodiment provides a scheme for generating an audio configuration file. For the audio configuration file, the platform server can pre-set it on the system, or it can be set by the user. The user can update the audio parameters in the audio configuration file through the customized audio configuration file. Each user can establish a personal audio configuration file list, which stores a list of all default audio configuration files provided by the system, and can also save audio configuration files generated by user-defined methods. The user can log in to the account on any terminal device and download the personal audio configuration file for use by accessing the platform server, thereby greatly expanding the audio parameter configuration method.

[0108] S140: Send the target sound effect configuration file to the audio processor of the sound system, and configure the sound effect parameters of each sound channel of the sound system according to the target sound effect configuration file.

[0109] In this step, the player sends the target sound effect configuration file to the audio processor of the sound system, where the audio processor is implemented by a DSP chip. After receiving the sound effect configuration file, the DSP chip configures the sound effect parameters of each sound channel according to the recorded sound effect parameters; when playing a song file, the player decodes the song file into an audio bit stream; then the audio bit stream is output to the DSP chip, and the DSP chip processes the sound effect according to the configured sound effect parameters.

[0110] For the timing status of the above embodiment, refer to Figure 5 As shown, Figure 5 This is an example timing diagram of the sound effect configuration method; after the user selects the target song, the processor system searches for and downloads the song file and starts the player to prepare for playback. The player reads the classification tag and uses it to find the target sound effect configuration file, and then sends the target sound effect configuration file to the DSP chip. The DSP chip configures the sound effects for each sound channel through the content algorithm. After the configuration is completed, the player starts to play the song file, decodes it into a bit stream and outputs it to the DSP chip for sound effect processing, and then outputs it to the power amplifier module and speaker for playback.

[0111] The technical solution of the above-mentioned embodiment sets classification tags for song files in advance, sets special sound effect parameters for each classification feature, and records the sound effect parameters through sound effect configuration files, which are stored in a sound effect configuration file library. The sound effect processor, i.e., the digital processing capability of the DSP chip, is used to perform refined and professional sound effect adjustments on each sound channel. The player can accurately identify the target sound effect configuration file through the classification tags, thereby avoiding recognition errors. At the same time, by establishing a sound effect configuration file library, users can conveniently perform related operations on the sound effect configuration files in the sound effect configuration file library, such as updating configuration files, adding new configuration files, etc. When users need to change the sound effect parameters, they only need to modify and replace the original audio configuration file of the system. If the sound effect is set through the player, the equalizer of the player is highly professional for ordinary users, and it is difficult for users to adjust it accurately. The technical solution provided by the present application reduces the difficulty of sound effect configuration for users and improves the user experience.

[0112] In order to make the technical solution of the present application more clear, it is described below in conjunction with more embodiments.

[0113] In one embodiment, for the audio configuration file generation method of the present application, during the user's use process, the user can configure and modify it by himself, or can configure and modify it online by accessing the platform server; accordingly, the audio configuration method of the present application may also include:

[0114] (1) Modify the audio configuration file by custom modification or online modification configuration; specifically, since the sound effect configuration is professional, capable users can make custom modifications, while those who do not have the corresponding capabilities can use the online modification method provided by the system to make modifications.

[0115] (2) The modified sound effect configuration file replaces the original sound effect configuration file and is saved in the sound effect configuration file library, and loaded into the personal database of the user.

[0116] In the two methods provided in the above step (1), the customized modification scheme can call the system's audio configuration tool to modify the audio parameters by itself. For the online modification method, the platform server can apply for assistance and upload relevant song files and other materials. During the online assistance process, through relevant confirmation operations, a personalized audio configuration file can be formed, so that good sound effects can be obtained when playing songs.

[0117] In one embodiment, the sound effect configuration method of the present application can also provide a solution for users to configure audio configuration files. Figure 6 As shown, Figure 6is a state diagram of an example custom audio configuration file; specifically, the scheme can be as follows:

[0118] s201, calling the system's sound effect configuration tool; specifically, the platform server provides related calling services for the sound effect configuration tool, and the user can call the sound effect configuration tool for debugging.

[0119] s202, modifying the target sound effect configuration file using the sound effect configuration tool; specifically, the audio configuration file can be customized through the tool. Generally, since it involves professional issues, capable users can customize the sound effect parameters.

[0120] s203, replacing the original sound effect configuration file with the modified sound effect configuration file, saving it to the sound effect configuration file library, and loading it into the personal database of the user.

[0121] Specifically, the above embodiment provides a solution for users to customize and modify sound effect configuration files. In order to allow users who are able to modify the sound effect configuration files themselves to modify / add sound effect parameters of their favorite style classification song files, a sound effect configuration tool can be provided on the platform server. When the user needs to modify / add a sound effect configuration file, or modify sound effect parameters, etc., the sound effect configuration tool can be used to independently debug and generate a sound effect configuration file, replace the original sound effect configuration file, and load the modified or newly added sound effect configuration file into the user's personal database. Subsequently, the user can log in to his or her account and select a customized sound effect configuration file to obtain the sound effect of his or her favorite sound style.

[0122] In one embodiment, in order to facilitate users to debug the sound effects to obtain the sound effects they like, the solution of this embodiment also provides a solution for online tuning assistance. Figure 7 As shown, Figure 7 This is a schematic diagram of an example of online tuning assistance, which can be as follows:

[0123] s301, apply for online tuning assistance from the platform server; specifically, the user can apply for online assistance from the platform server.

[0124] s302, sending the song file to the platform server for online tuning; specifically, the song file can be from the song library or uploaded locally.

[0125] s303, receiving the tuned song file returned by the platform server, and playing the song file for the user to confirm; specifically, the user auditions the song according to the needs, and confirms when satisfied.

[0126] s304, after the user confirms, the sound effect configuration file generated by the online tuning is saved to the sound effect configuration file library, and loaded into the personal database of the user.

[0127] The technical solution of the above embodiment provides a solution for modifying the audio configuration file online. For users who do not adjust the sound effects by themselves, they can apply for the assistance of an online tuner on the platform server. The online tuner of the platform server can assist in adjusting the sound effects, accompaniment and other information of the song file, and finally generate a new song file for the user to audition. Continuous adjustments can be made until the user is satisfied. This technical solution enriches the operation method of the sound effect configuration and improves the user application experience.

[0128] In addition, in one embodiment, in order to enrich the user's tuning needs, the solution of this embodiment can also configure the sound effects of the songs recorded by the user in real time. Figure 8 As shown, Figure 8 This is a schematic diagram of generating a self-created song according to an embodiment, which specifically includes the following:

[0129] s401, recording the song sung by the user to obtain an initial song file; specifically, the song can be recorded through the recording module of the intelligent sound effect and then uploaded.

[0130] s402, upload the initial song file to the platform server.

[0131] s403, the platform server adds accompaniment and sound effect configuration to the initial song file online to obtain a self-created song file; specifically, the platform server matches the corresponding accompaniment content and sound effect parameters for the user online to obtain a new song file.

[0132] s404, receiving the self-created song file returned by the platform server.

[0133] s405, adding a classification mark to the self-created song file and storing it in the song library, and loading it into the user's personal database; specifically, the user can save the song to the personal database, and also store it in the song library, so as to share it with other users.

[0134] In another embodiment, when obtaining the song file in step s401, the user's image data can also be captured by the camera of the smart speaker, and then the processor system obtains the somatosensory interaction data through the image data, and then uploads the somatosensory interaction data to the platform server in step s402. The platform server can add accompaniment and sound effect configuration to the initial song file online based on the somatosensory interaction data. During this process, the processor platform can also play the song file to the user for confirmation, wherein the sound effect parameters can also be recorded in the sound effect configuration file and saved in the sound effect configuration file library; for example, the user's image data captured by the camera can be used in combination with body movements to affect the configuration of the sound effect parameters, and the user's expressions and movements can be identified through the image data, and then the user's emotional state, control intentions, etc. can be identified, which can then be used to adjust the sound effect parameters, thereby achieving better use results.

[0135] The technical solution of the above-mentioned embodiment can complete the sound effect configuration process with the assistance of an online tuner. During this process, users can also create their own song files and share them with other users to achieve greater intelligence, greatly expanding the means and methods of sound effect configuration and improving user experience.

[0136] In one embodiment, in order to increase the user's usage range, when a user needs to use a song file outside the platform server, it is transmitted through an external terminal device. Fig. 9 As shown, Fig. 9 This is a schematic diagram of new song synthesis in an embodiment. The solution of this embodiment may also include:

[0137] s501, establishing communication with an external terminal device (a mobile phone is used as an example in the figure) and receiving a song file transmitted by the external terminal.

[0138] S502, uploading the song file to the platform server.

[0139] S503, the platform server extracts the accompaniment data of the song file, matches the video background according to the category of the song file, and generates a new song file according to the accompaniment data and the video background; for the video background, other copyrighted videos can be imported, or it can be a video shot by itself.

[0140] S504, receiving the new song file returned by the platform server.

[0141] S505, adding a classification mark to the new song file, storing it in the song library, and loading it into the user's personal database.

[0142] The solution of the above embodiment connects the smart speaker to an external terminal device, such as a mobile phone, tablet, etc., imports the song files of the external device into the smart speaker, and then the processor system uploads the song files to the platform server. The platform server can extract the accompaniment and then select a suitable video background to synthesize a new song file. Through this solution, users can use the smart speaker to import their favorite songs and finally make their own songs, which can be shared with others.

[0143] refer to Fig.10 As shown, Fig.10 This is another example of a new song file synthesis flow chart, which mainly includes the following processes:

[0144] (1) The mobile phone is connected to the smart speaker via Bluetooth;

[0145] (2) The processor system of the smart speaker receives the song file data transmitted by Bluetooth;

[0146] (3) The processor system generates audio data in MP3 or WAV format from the song file;

[0147] (4) The processor system uploads the audio data to the platform server;

[0148] (5) The platform server separates the human voice and accompaniment of the audio data;

[0149] (6) Match the corresponding MV background video to the accompaniment according to the song type;

[0150] (7) Synthesize the accompaniment and the MV video into a new song file;

[0151] (8) Generate a new song file ID and load it to the platform server and the user's personal database;

[0152] (9) Share the ID with other users, who can then play the song through the link.

[0153] In the scheme of the above embodiment, the system can provide tools to import song files through other terminal devices and synthesize new song files in combination with MV backgrounds. The new song files can be used by the users themselves or shared with other users for playback, thereby expanding the functions of sound effect configuration and song generation and improving the user experience.

[0154] In order to further reduce the difficulty of sound effect configuration, this embodiment also provides a solution for automatically configuring the target song sound effects based on other song files. Specifically, the solution is as follows:

[0155] (a) Obtaining songs of interest selected by the user and their category information; specifically, the user may select songs of interest based on the sound effects that the user hears, and then determine their category information based on prompts, so as to facilitate category marking in subsequent processing.

[0156] (b) calling a sound effect configuration tool to extract the accompaniment data of the song of interest; specifically, the system provides the sound effect configuration tool to the user, and the user can input the link of the song of interest into the sound effect configuration tool.

[0157] (c) extracting sound effect parameters according to the accompaniment data and generating a self-created sound effect configuration file; specifically, the sound effect configuration tool can extract the sound effect parameters from the song.

[0158] (d) establishing a correspondence between the self-created sound effect configuration file and the category tag of the song file according to the category information, saving the self-created sound effect configuration file to the sound effect configuration file library, and loading it into the user's personal database.

[0159] The scheme of the above embodiment takes into account that there are many sound effect adjustment parameters and the technical difficulty is high. Users often do not know how to adjust the sound effects, but users can determine the sound effects of their favorite songs by listening to the songs. Therefore, the sound effects of other songs are used. For example, if a user likes a certain song (or multiple songs), the song is saved, the sound effect parameters of the song are extracted using a software algorithm, and then a sound effect configuration file is generated and saved. It can then be directly applied to the sound effect configuration of other songs. This scheme provides users with the function of transplanting and using the sound effects of other songs, expands the sound effect configuration method, and improves the user experience.

[0160] As described in the above embodiments, the present application provides a smart speaker that can execute the sound effect configuration method of the above embodiments, such as Figure 2-3 An implementation scheme of a smart speaker with a 2.1 dual-channel sound system is provided; sound effect profiles can be set according to different category tags.

[0161] Taking a 2.1 dual-channel smart speaker as an example, the following provides audio parameters for two dance styles, "Disco" and "Tai Chi":

[0162] (1) For a sound effect profile classified as disco dance, its sound effect configuration parameters can be set to:

[0163] ① The bass volume is increased by 3-9dB, the 80Hz frequency is increased by 3-9dB, and the Q value is 0.5~2; ② The full-range speaker channel volume is attenuated by 1-3dB, the filter frequency is 1KHz~5KHz, the amplitude is 1~3dB, and the Q value is 0.5~2; ③ The bass channel limiting threshold is -6dB~-1dB, the compression ratio is 5:1~20:1, the startup time is 5~20ms, and the recovery time is 100~200ms.

[0164] Specifically, when the user selects the "disco" dance style, the processor system sends the sound effect configuration parameters to the DSP chip and performs the following configuration:

[0165] The bass volume is increased by 6dB, 80Hz is increased by 6dB, the Q value is 1, the volume of the full-range speaker channel (left and right speakers) is attenuated by 1dB, and a HISHIFT filter is turned on with parameters of frequency 3KHz, amplitude 2, and Q value 1. At the same time, the bass channel limiter is turned on and the parameters are configured as threshold ~3dB, compression ratio 10:1, attack time 10ms, and recovery time 200ms.

[0166] The above-mentioned sound effect parameters can adapt to the strong, indiscriminate, metronome-like 4 / 4 beat of disco music, as well as the simple lyrics and melody, so that users can get a better application experience.

[0167] (2) For a sound effect configuration file classified as Tai Chi, the sound effect configuration parameters of the sound effect configuration file can be set to:

[0168] ① The high-pass filter frequency is 60~120Hz, and the filter order is second order; ② The bass channel volume attenuation is 1~6dB, and the low-pass filter frequency of the bass channel is 300~800Hz; ③ The first EQ frequency point parameter of the full-range speaker channel is 200Hz~300Hz, the Q value is 0.5~2, and the amplitude is 1~6dB; the second EQ frequency point parameter is set to 500Hz~1000Hz, the Q value is 0.2~0.8, and the amplitude is 1~3dB. The third EQ frequency point parameter is set to 3KHz~8KHz, the Q value is 0.5~2, and the amplitude is 1~6dB.

[0169] Specifically, when the user selects the Tai Chi style song category, the processor system sends sound effect configuration parameters to the DSP chip (for example: open a high-pass filter and set the frequency to 80Hz and the order to second order, the bass channel volume is attenuated by 3dB, the bass channel low-pass filter frequency is changed from the default 120Hz to 500Hz, and the full-range speaker channel (left and right speakers) opens an EQ frequency point with parameters set to a frequency of 250HZ, a Q value of 1 and an amplitude of +3dB, opens the second EQ frequency point, sets the parameters to a frequency of 600Hz, a Q value of 0.5dB and an amplitude of +2dB), opens the third EQ frequency point, sets the parameters to a frequency of 6.3KHz, a Q value of 1 and an amplitude of +3dB.

[0170] Through the above-mentioned sound effect configuration parameters, it is possible to adapt to the characteristics of Tai Chi style songs. The sound effect configuration can produce full, pleasant, clear and transparent Tai Chi music, allowing users to get a better application experience.

[0171] (3) The sound effect configuration can also be configured as karaoke mode;

[0172] Specifically, when the system detects that the microphone is turned on, it will automatically switch to karaoke mode. At this time, the processor system sends a sound effect configuration file to the DSP, first turning on the DSP internal microphone channel switch and turning on the reverberation effect. The user can request songs through the microphone.

[0173] For example: "Play Forget Love Water or I want to sing Forget Love Water". At this time, multiple versions of Forget Love Water will be displayed on the screen connected to the smart speaker. Users can use the buttons on the microphone to quickly order songs. In addition, the buttons on the microphone can also increase and decrease the microphone volume; increase and decrease the music volume; change songs; previous song, next song; switch between original singer and accompaniment singer; mute and other functions.

[0174] Karaoke is a real-time mix of accompaniment music and vocals. Therefore, the ratio of the mix directly affects the singer's experience. In order to obtain the best mixing ratio, this embodiment detects the average level of the accompaniment music and the average level of the vocal signal in real time, and automatically modifies the microphone channel gain in real time according to the detection value, so that the level of the microphone signal is always 3 to 6 dB higher than the music signal level. The singer can always easily listen to his or her own singing. For recording playback, according to the listening habits, the accompaniment music level is usually greater than the vocal level, which makes the effect more pleasant to listen to.

[0175] As an embodiment, the singing channel and the recording channel are processed independently. According to the real-time detected average level of the accompaniment music and the average level of the vocal signal, the music channel gain is adjusted in real time to ensure that the accompaniment music level of the recording signal is always 3 to 6 dB higher than the vocal level. This ensures that the singing can be done with ease and the best mixing ratio can be achieved during playback.

[0176] The following describes an embodiment of the sound effect configuration device of the present application, referring to Fig.11 , Fig.11 It is a schematic diagram of the structure of the sound effect configuration device of this application, including:

[0177] The song search unit 110 is used to obtain a target song selected by a user and search for a song file of the target song from a song library;

[0178] The tag identification unit 120 is used to enable the player to read the song file and identify the classification tag of the song file; wherein the song library stores song files, and each song file is provided with a classification tag;

[0179] A target search unit 130 is used to search for a target sound effect configuration file from a sound effect configuration file library according to the classification mark; wherein the sound effect configuration file library stores the sound effect configuration files corresponding to each classification mark, and the sound effect configuration files record sound effect parameters;

[0180] The sound effect configuration unit 140 is used to send the target sound effect configuration file to the audio processor of the sound system, and configure the sound effect parameters of each sound channel of the sound system according to the target sound effect configuration file.

[0181] The sound effect configuration device of this embodiment can execute a sound effect configuration method provided in the embodiment of the present application, and its implementation principle is similar. The actions performed by each module in the sound effect configuration device in each embodiment of the present application correspond to the steps in the sound effect configuration method in each embodiment of the present application. For the detailed functional description of each module of the sound effect configuration device, please refer to the description in the corresponding sound effect configuration method shown in the previous text, which will not be repeated here.

[0182] An embodiment of a computer device of the present application is described below. The computer device comprises:

[0183] one or more processors;

[0184] Memory;

[0185] One or more applications, wherein the one or more applications are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs are configured to: execute the sound effect configuration method according to any of the above embodiments.

[0186] An embodiment of the computer-readable storage medium of the present application is described below, wherein the storage medium stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded by the processor and executes the sound effect configuration method of any of the above embodiments.

[0187] The above description is only a partial implementation method of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A sound effect configuration method, applied to a smart speaker, characterized in that: The smart speaker is provided with an audio system and a processor system; the processor system is used to play song files using a player, and decode the song files and output them to the audio system; the audio system receives the decoded code stream of the song files output by the processor system, receives the sound effect configuration file issued by the processor system, sets the sound effect parameters of each sound channel through the audio processor chip, and plays the song files output by the processor system; The method comprises: Obtaining a target song selected by a user, and searching for a song file of the target song from a song library; wherein the song file is classified according to a preset classification rule, associated with a classification tag of each classification constructed, and stored in the song library; Enabling a player to read the song file and identify the classification mark of the song file; wherein the song library stores song files, each of which is provided with a classification mark; Searching for a target sound effect configuration file from a sound effect configuration file library according to the classification mark; wherein the sound effect configuration file library stores the sound effect configuration files corresponding to each classification mark, calling a sound effect configuration tool of the system, using the sound effect configuration tool to modify the target sound effect configuration file, replacing the original sound effect configuration file with the modified sound effect configuration file and saving it to the sound effect configuration file library; the sound effect configuration file records the sound effect parameters; The target sound effect configuration file is sent to the audio processor of the audio system through the player. When playing a song file, the player decodes the song file into an audio code stream and outputs it to the audio processor. The audio processor configures the sound effect parameters of each sound channel of the audio system according to the target sound effect configuration file and processes the audio code stream.

2. The sound effect configuration method according to claim 1, characterized in that: Also includes: The sound effects profile is loaded into the user's personal database.

3. The sound effect configuration method according to claim 1, characterized in that: Also includes: Apply for online tuning assistance from the platform server; Send the song file to the platform server for online tuning; Receive the tuned song file returned by the platform server, and play the song file for the user to confirm; After the user confirms, the sound effect configuration file generated by the online tuning is saved to the sound effect configuration file library and loaded into the user's personal database.

4. The sound effect configuration method according to claim 1, characterized in that: Also includes: Record the song sung by the user to obtain an initial song file; Upload the initial song file to the platform server, add accompaniment and sound effect configuration to the initial song file online, and obtain a self-created song file; The self-created song file returned by the receiving platform server is stored in the song library after adding a classification mark to the self-created song file, and is loaded into the personal database of the user.

5. The sound effect configuration method according to claim 4, characterized in that: Also includes: Acquiring somatosensory interaction data of the user; The somatosensory interaction data is uploaded to the platform server, and accompaniment and sound effect configuration are added to the initial song file online according to the somatosensory interaction data.

6. The sound effect configuration method according to claim 1, characterized in that: Also includes: Establishing communication with an external terminal device and receiving a song file transmitted by the external terminal; Uploading the song file to the platform server; Extracting the accompaniment data of the song file on the platform server, matching the video background according to the category of the song file, and generating a new song file according to the accompaniment data and the video background; The new song file returned by the receiving platform server is stored in the song library after adding a classification mark to the new song file, and is loaded into the personal database of the user.

7. The sound effect configuration method according to claim 1, characterized in that: Also includes: Get the songs of interest and their category information selected by the user; Calling a sound effect configuration tool to extract the accompaniment data of the song of interest; Extracting sound effect parameters according to the accompaniment data and generating a self-created sound effect configuration file; A correspondence between the self-created sound effect configuration file and the category tag of the song file is established according to the category information, and the self-created sound effect configuration file is saved to the sound effect configuration file library and loaded into the user's personal database.

8. The sound effect configuration method according to claim 1, characterized in that: The classification mark is disco dance, and the sound effect configuration parameters of the target sound effect configuration file are: The bass volume is increased by 3-9dB, the 80Hz frequency is increased by 3-9dB, and the Q value is 0.5~2; The full-range speaker channel volume attenuation is 1-3dB, the filter frequency is 1KHz~5KHz, the amplitude is 1~3dB, and the Q value is 0.5~2; The bass channel limiting threshold is -6dB~-1dB, the compression ratio is 5:1~20:1, the attack time is 5~20ms, and the recovery time is 100~200ms; or The classification mark is Tai Chi songs, and the sound effect configuration parameters of the target sound effect configuration file are: The high-pass filter frequency is 60~120Hz, and the filter order is second order; The bass channel volume attenuation is 1~6dB, and the low-pass filter frequency of the bass channel is 300~800Hz; The first EQ frequency point parameter of the full-range speaker channel is 200Hz~300Hz, the Q value is 0.5~2, and the amplitude is 1~6dB; the second EQ frequency point parameter is set to 500Hz~1000Hz, the Q value is 0.2~0.8, the amplitude is 1~3dB, and the third EQ frequency point parameter is set to 3KHz~8KHz, the Q value is 0.5~2, and the amplitude is 1~6dB; or The classification mark is karaoke mode, and the sound effect configuration parameters of the target sound effect configuration file are: the level of the microphone signal is always 3-6 dB higher than the level of the music signal.

9. A sound effect configuration device, applied to a smart speaker, characterized in that: The smart speaker is provided with an audio system and a processor system; the processor system is used to play song files using a player, and decode the song files and output them to the audio system; the audio system receives the decoded code stream of the song files output by the processor system, receives the sound effect configuration file issued by the processor system, sets the sound effect parameters of each sound channel through the audio processor chip, and plays the song files output by the processor system; The device comprises: A song search unit, used to obtain a target song selected by a user, and search for a song file of the target song from a song library; wherein the song file is classified according to a preset classification rule, associated with a classification mark of each classification constructed, and stored in the song library; A tag recognition unit, used to enable the player to read the song file and recognize the classification tag of the song file; wherein the song library stores song files, each of which is provided with a classification tag; a target search unit, configured to search for a target sound effect configuration file from a sound effect configuration file library according to the classification mark; wherein the sound effect configuration file library stores the sound effect configuration files corresponding to each classification mark, calls a sound effect configuration tool of the system, uses the sound effect configuration tool to modify the target sound effect configuration file, replaces the original sound effect configuration file with the modified sound effect configuration file and saves it to the sound effect configuration file library; the sound effect configuration file records the sound effect parameters; The sound effect configuration unit is used to send the target sound effect configuration file to the audio processor of the sound system through the player. When playing a song file, the player decodes the song file into an audio code stream and outputs it to the audio processor. The audio processor configures the sound effect parameters of each sound channel of the sound system according to the target sound effect configuration file and processes the audio code stream.

10. A smart speaker, characterized in that: include: A processor system, and an image processing system and an audio system respectively connected to the processor system; wherein, The processor system is used to execute the steps of the sound effect configuration method according to any one of claims 1 to 8; The image processing system is used to obtain the user's image data and feed it back to the processor system; The sound system is used to set the sound effect parameters of each sound channel through the audio processor and play the song files output by the processor system.

Images