Tone adjustment method, apparatus, device, and storage medium

Abstract

The application discloses a pitch adjustment method and device, equipment and storage medium, and belongs to the technical field of sound source processing. The application obtains a pitch value and a sound source duration of an initial sound source, constructs a sound source coordinate system based on the pitch value and the sound source duration, generates a pitch waveform graph according to the sound source coordinate system, obtains operation data for the pitch waveform graph, and adjusts the pitch of the initial sound source according to the operation data, so that a user who is not a professional can also adjust the sound source according to personal preferences.

Description

Technical Field

[0001] This invention relates to the field of audio source processing technology, and in particular to a method, apparatus, device and storage medium for adjusting tone. Background Technology

[0002] In daily life, we often see multiple versions of a piece of music created by various artists or users, such as a DJ version, a female vocal version, a live version, and a purely instrumental version. However, creating such versions requires professional software to modify the complex musical spectrum. This method demands a high level of professional skill and can only be completed by professionals with relevant expertise. Ordinary users do not possess this professional skill and cannot modify the music version according to their own preferences.

[0003] The above content is only used to help understand the technical solution of the present invention and does not represent an admission that the above content is prior art. Summary of the Invention

[0004] The main objective of this invention is to provide a tone adjustment method, apparatus, device, and storage medium, aiming to solve the technical problem in the prior art that users cannot modify the sound source.

[0005] To achieve the above objectives, the present invention provides a pitch adjustment method, the pitch adjustment method comprising the following steps:

[0006] Obtain the pitch value and duration of the initial sound source;

[0007] A sound source coordinate system is constructed based on the pitch value and sound source duration;

[0008] Generate a pitch waveform diagram based on the sound source coordinate system;

[0009] Obtain operation data for the aforementioned pitch waveform;

[0010] The pitch of the initial sound source is adjusted according to the operation data.

[0011] Optionally, generating the pitch waveform diagram based on the sound source coordinate system includes:

[0012] Obtain the coordinates of each pitch node corresponding to the initial sound source in the sound source coordinate system;

[0013] Select an initial sound node from each sound node corresponding to the initial sound source;

[0014] The slope between the initial pitch node and each adjacent pitch node is determined based on the coordinates.

[0015] The pitch waveform diagram is obtained by dividing the pitch nodes in the sound source coordinate system according to the slope.

[0016] Optionally, the step of dividing the pitch nodes in the sound source coordinate system according to the slope to obtain a pitch waveform diagram includes:

[0017] Obtain the slope difference between each slope;

[0018] When the slope difference is within a preset difference range, it is determined that the phonological nodes corresponding to the slope difference within the preset difference range are in the same syllable change trend;

[0019] Based on the syllable change trend corresponding to each syllable, the syllables in the sound source coordinate system with the same change trend are divided into the same sub-time window;

[0020] The time span of each sub-time window is determined based on the partitioning results;

[0021] The sound source coordinate system is divided into sound nodes according to the time span of each sub-time window to obtain a pitch waveform diagram.

[0022] Optionally, adjusting the pitch of the initial sound source based on the operation data includes:

[0023] When multiple users are detected to be performing operations, target operation data is determined based on multiple operation data related to the tone waveform.

[0024] The initial sound source is pitched according to the target operation data.

[0025] Optionally, determining the target operation data based on multiple operation data for the tone waveform includes:

[0026] The pitch adjustment time corresponding to each operation data is determined based on the pitch waveform diagram.

[0027] Extract the operation type and sliding parameters corresponding to each pitch adjustment moment from multiple operation data for the pitch waveform diagram;

[0028] Target operation data for each pitch adjustment moment is generated based on the operation type and the sliding parameters.

[0029] Optionally, adjusting the pitch of the initial sound source based on the target operation data includes:

[0030] Obtain the operation type, number of swipes, and swipe range corresponding to the target operation data;

[0031] Determine the target sliding effect value based on the operation type;

[0032] The target sound source adjustment value is determined based on the number of slides, the slide amplitude, and the target slide effect value.

[0033] The pitch value and / or duration of the initial sound source are adjusted according to the target sound source adjustment value.

[0034] Optionally, after adjusting the pitch of the initial sound source based on the operation data, the method further includes:

[0035] Obtain the background image of the sound source corresponding to the initial sound source;

[0036] The sound source adjustment result is determined based on the initial sound source and the adjusted initial sound source;

[0037] The background image of the sound source is adjusted according to the sound source adjustment result to obtain the target sound source background image.

[0038] Furthermore, to achieve the above objectives, the present invention also proposes a pitch adjustment device, the pitch adjustment device comprising:

[0039] The acquisition module is used to obtain the pitch value and duration of the initial sound source;

[0040] The construction module is used to construct a sound source coordinate system based on the pitch value and the sound source duration;

[0041] The generation module is used to generate a pitch waveform diagram based on the sound source coordinate system;

[0042] The receiving module is used to acquire operation data for the tone waveform diagram;

[0043] The adjustment module is used to adjust the pitch of the initial sound source according to the operation data.

[0044] Furthermore, to achieve the above objectives, the present invention also proposes a tone adjustment device, the tone adjustment device comprising: a memory, a processor, and a tone adjustment program stored in the memory and executable on the processor, the tone adjustment program being configured to implement the tone adjustment method as described above.

[0045] In addition, to achieve the above objectives, the present invention also proposes a storage medium storing a pitch adjustment program, which, when executed by a processor, implements the pitch adjustment method as described above.

[0046] This invention obtains the pitch value and duration of an initial sound source; constructs a sound source coordinate system based on the pitch value and duration; generates a pitch waveform based on the sound source coordinate system; obtains operation data for the pitch waveform; and adjusts the pitch of the initial sound source based on the operation data, enabling non-professional users to adjust the sound source according to their own preferences. Attached Figure Description

[0047] Figure 1 This is a schematic diagram of the structure of the tone adjustment device in the hardware operating environment involved in the embodiments of the present invention;

[0048] Figure 2 This is a flowchart illustrating the first embodiment of the pitch adjustment method of the present invention;

[0049] Figure 3 This is a schematic diagram of the overall process in one embodiment of the pitch adjustment method of the present invention;

[0050] Figure 4 This is a flowchart illustrating the second embodiment of the pitch adjustment method of the present invention;

[0051] Figure 5 This is a pitch waveform diagram in one embodiment of the pitch adjustment method of the present invention;

[0052] Figure 6 This is a flowchart illustrating the third embodiment of the pitch adjustment method of the present invention;

[0053] Figure 7 This is a structural block diagram of the first embodiment of the tone adjustment device of the present invention.

[0054] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0055] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of the invention.

[0056] Reference Figure 1 , Figure 1 This is a schematic diagram of the tone adjustment device structure in the hardware operating environment involved in the embodiments of the present invention.

[0057] like Figure 1As shown, the tone adjustment device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen and an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wireless-Fidelity (Wi-Fi) interface). The memory 1005 may be a high-speed random access memory (RAM) or a stable non-volatile memory (NVM), such as a disk drive. The memory 1005 may also optionally be a storage device independent of the aforementioned processor 1001.

[0058] Those skilled in the art will understand that Figure 1 The structure shown does not constitute a limitation on the tone adjustment device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0059] like Figure 1 As shown, the memory 1005, which serves as a storage medium, may include an operating system, a network communication module, a user interface module, and a tone adjustment program.

[0060] exist Figure 1 In the pitch adjustment device shown, the network interface 1004 is mainly used for data communication with the network server; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the pitch adjustment device of the present invention can be set in the pitch adjustment device, and the pitch adjustment device calls the pitch adjustment program stored in the memory 1005 through the processor 1001 and executes the pitch adjustment method provided in the embodiment of the present invention.

[0061] This invention provides a pitch adjustment method, referring to... Figure 2 , Figure 2 This is a schematic flowchart of a first embodiment of a pitch adjustment method according to the present invention.

[0062] In this embodiment, the pitch adjustment method includes the following steps:

[0063] Step S10: Obtain the pitch value and duration of the initial sound source.

[0064] In this embodiment, the executing entity can be a tone adjustment device, which can be an electronic device such as a personal computer, server, or vehicle terminal, or other devices or servers that can achieve the same or similar functions. This embodiment does not limit this. In this embodiment and the following embodiments, the tone adjustment method of the present invention is described using a tone adjustment device as an example.

[0065] It should be noted that in life, we often see multiple versions of a piece of music created by artists or users. The main difference between each version is the pitch. These different versions are modified by artists or users, but these artists or users usually have professional skills and professional mixing equipment. Ordinary users do not have these conditions and cannot modify the music according to their own preferences.

[0066] In order to solve the above problems, this embodiment can be implemented in the following way.

[0067] In specific implementation, combined with Figure 3 The overall process of this solution is described below. Users play music through mobile phones or tablets. The audio source processing server receives the audio source sent by the user through the terminal and processes it. The server can be a standalone server, a server network, or a server cluster. For example, the server described in this embodiment includes, but is not limited to, computers, network hosts, single network servers, multiple network server sets, or cloud servers composed of multiple servers. A cloud server consists of a large number of computers or network servers based on cloud computing. After dividing the audio source into time windows, the audio source processing server sends the audio source data to the terminal. Users can adjust the audio source through the terminal. During this adjustment process, the audio source processing server collects the user's swiping behavior and adjusts the audio source data accordingly, ultimately creating a new audio source and feeding it back to the terminal. The user can then play the modified new audio source through the terminal.

[0068] It should be noted that when a user wants to adjust the music being played, the user can send the audio source corresponding to the currently playing music, i.e., the initial audio source, to the tone adjustment device through the terminal device. Specifically, the user can send the initial audio source to the tone adjustment device by operating an application installed on the terminal device, or they can choose other methods to send the initial audio source to the tone adjustment device. The specific method can be selected according to the user's actual needs, and this embodiment does not impose any restrictions on this.

[0069] In this embodiment, the initial audio source is the one the user wants to adjust. Before adjustment, the original audio source can be backed up, and the backed-up version becomes the initial audio source. This ensures that if the user is not satisfied with the adjustment result, they can still continue playing the original audio source through the terminal device. Furthermore, the user may send multiple audio sources to the tone adjustment device simultaneously. To easily distinguish each different audio source, this embodiment uses the hash value of the audio source as a unique identifier, and different audio sources are distinguished based on this unique identifier.

[0070] Furthermore, in this embodiment, in order to facilitate ordinary users to adjust the sound source, after receiving the initial sound source from the terminal device, a corresponding pitch waveform diagram will be generated based on the initial sound source. If there are multiple initial sound sources, a corresponding number of pitch waveform diagrams will also be generated.

[0071] After generating the pitch waveform, this embodiment will feed the generated pitch waveform back to the terminal device. After receiving the pitch waveform, the terminal device will display the pitch waveform to the user. Compared with the complex music spectrogram, this pitch waveform is simple, easy to understand and easy to operate. Even ordinary users without professional skills can adjust the sound source according to their own preferences through the pitch waveform.

[0072] Step S20: Construct a sound source coordinate system based on the pitch value and sound source duration.

[0073] In practice, the pitch value and duration of the initial sound source can be obtained based on the initial sound source data. The pitch value represents the highness or lowness of the initial sound source, and the duration represents the length of time the initial sound source is played. For example, if the duration of the music played by the user is 2 minutes, then the duration of the sound source can be determined to be 2 minutes.

[0074] Step S30: Generate a pitch waveform diagram based on the sound source coordinate system.

[0075] In this specific implementation, the pitch waveform diagram is constructed based on the pitch value and duration of the initial sound source. First, a sound source coordinate system is constructed based on the pitch value and duration. Specifically, the pitch value of the initial sound source is used as the Y-axis, a time window is determined based on the duration of the sound source, and this time window is used as the X-axis. The initial moment of this time window is used as the origin. Then, the sound source coordinate system is constructed based on the determined origin, X-axis, and Y-axis. The constructed sound source coordinate system is as follows: Figure 5 As shown.

[0076] It should be noted that the duration corresponding to the time window is the same as the duration corresponding to the target sound source. The time window can be extracted from the duration of the sound source. For example, if the duration of the initial sound source is 3 minutes, the time window in this embodiment can be set to the time period from the 30th second to the 50th second of the initial sound source. At this time, the duration of the time window is 20, and the corresponding pitch value is the pitch value within the time period from the 30th second to the 50th second.

[0077] Step S40: Obtain operation data for the tone waveform.

[0078] In this embodiment, not only does it support single-user adjustment of the sound source, but it also supports multiple users adjusting the same sound source simultaneously. During the user's adjustment of the sound source, operation data on the pitch waveform is recorded in real time. This operation data is input by the user through the received pitch waveform.

[0079] Furthermore, when multiple users simultaneously adjust the same audio source, this embodiment records not only the users' operation data but also their identity information, and establishes a mapping relationship between the users' identity information and the operation data. After the adjustment operation is completed, this embodiment also inputs corresponding prompt information, such as user A raising the pitch, user B extending the audio source duration by 500 millimeters, etc. This ensures that each user clearly understands the adjustment operations performed by other users and facilitates subsequent adjustments to the audio source.

[0080] Step S50: Adjust the pitch of the initial sound source according to the operation data.

[0081] In practice, after acquiring multiple operation data, this embodiment will synthesize the operation data and adjust the pitch of the initial sound source based on the final synthesized operation data. For example, assuming that the acquired operation data shows that user C raised the pitch by 0.5 and user D lowered the pitch by 0.2, combining the operations of users C and D, it can be determined that the final pitch was raised by 0.3, that is, the pitch of the initial sound source was raised by 0.3.

[0082] In practice, after adjusting the initial audio source, the user can play the adjusted initial audio source through their terminal device. Furthermore, if the user is not satisfied with the adjusted initial audio source, they can continue the above steps to readjust the audio source until a satisfactory adjusted initial audio source is obtained.

[0083] Furthermore, to enhance the user's enjoyment of adjusting the sound source, this embodiment can be implemented in the following manner.

[0084] In this specific implementation, when the audio source is played, a background image corresponding to the initial audio source is displayed on the terminal device. This background image includes wavy lines, anime characters, and 3D models of celebrities. In this embodiment, the corresponding background image can be obtained from the initial audio source. When the initial audio source is adjusted, the background image is also adjusted accordingly. Specifically, the background image can be adjusted based on the audio source adjustment result determined by the initial and adjusted initial audio sources. For example, the pitch can be represented as the speed of the 3D anime character's dance rotation; when the pitch increases, the 3D anime character's dance rotation speed increases, and when the pitch decreases, the 3D anime character's dance rotation speed decreases.

[0085] This embodiment obtains the pitch value and duration of an initial sound source; constructs a sound source coordinate system based on the pitch value and duration; generates a pitch waveform based on the sound source coordinate system; obtains operation data for the pitch waveform; and adjusts the pitch of the initial sound source based on the operation data, enabling non-professional users to adjust the sound source according to their own preferences.

[0086] refer to Figure 4 , Figure 4 This is a flowchart illustrating a second embodiment of a pitch adjustment method according to the present invention.

[0087] Based on the first embodiment described above, in the pitch adjustment method of this embodiment, step S30 specifically includes:

[0088] Step S301: Obtain the coordinates of each pitch node corresponding to the initial sound source in the sound source coordinate system.

[0089] In practical implementation, a sound source corresponds to multiple pitch nodes. Based on the pitch node corresponding to each moment in the initial sound source, and the pitch value corresponding to each pitch node, the coordinates corresponding to each pitch node can be obtained in the constructed sound source coordinate system. For example... Figure 5 As shown, in Figure 5 In the initial sound source, p1 is a pitch node. Based on the pitch value of this point and the time it appears in the time window, the coordinates corresponding to the pitch node p1 can be determined as (1,2).

[0090] Step S302: Select an initial sound node from each sound node corresponding to the initial sound source.

[0091] In specific implementation, for example Figure 5 As shown, in this embodiment, the initial sound node P1 can be used as the initial sound node. Of course, other sound nodes can also be selected as the initial sound node. In this embodiment, the settings can be made according to actual needs, and there are no restrictions on this.

[0092] Step S303: Determine the slope between the initial pitch node and each adjacent pitch node based on the coordinates.

[0093] Step S304: Divide the tone nodes in the sound source coordinate system according to the slope to obtain a tone waveform diagram.

[0094] In the specific implementation, after selecting the initial sound node from the sound nodes corresponding to the initial sound source, the slope between the initial sound node and the first adjacent sound node can be calculated based on the coordinates of each sound node. Then, the slope between the initial sound node and the second adjacent sound node is calculated, and so on. If the slope difference is within a preset range, it can be determined that the syllables have the same trend of change. The preset range can be set to -0.05 to 0.05, and of course, it can be set to other ranges according to actual needs. This embodiment does not impose any restrictions on this. Furthermore, in this embodiment, sound nodes with the same trend of change are divided into a sub-time window. It should be emphasized that when adjacent sound nodes with different trends of change appear, the adjacent sound node is taken as a new initial sound node, and the slope is calculated and classified again according to the above method.

[0095] For ease of understanding, this embodiment uses Figure 5 The following example will be used for illustration. The specific process can also be referred to the following phonetic node classification table, as shown in Table 1;

[0096] Table 1

[0097]

[0098] exist Figure 5In this case, assuming the preset range is -0.05 to 0.05, p1 is taken as the initial syllable node. The slope between p1 and its next adjacent point p2 is calculated. Assuming the slope between p1 and p2 is k1 = 1, the slope between p1 and p3 is calculated. Assuming the slope between p1 and p3 is k2 = 1, we can get k1 - k2 = 0. 0 is within the preset range of -0.05 to 0.05, so it is determined that the syllable change trends between p1, p2, and p3 are the same. In this case, the slope between p1 and p4 is calculated. Assuming that the slope between p1 and p4 is also k3 = 1, it can be determined that the four syllable nodes p1, p2, p3, and p4 have the same change trend. Then, the slope k4 between p1 and p5 is calculated. Assuming k4 = 1.25, k4 - k3 = 0.25. Since 0.25 is not within the preset range of -0.05 to 0.05, it is determined that the syllable change trend of p5 is different from that of p1, p2, p3, and p4. In this case, in this embodiment, p1, p2, p3, and p4 are treated as a type of syllable node and assigned to sub-time windows T1 to T4. Then, p5 is taken as the new initial syllable node. The slope between p5 and p6 is calculated, and p5 to p8 are classified in the same way as described above. Finally, the division result described above can be obtained.

[0099] In practical implementation, to make the waveform of the entire sound source clearer to the user, after determining the changing trend of the sound nodes, this embodiment divides the sound nodes with the same changing trend into the same sub-time window, for example... Figure 5 The pitch nodes p1 to p8 shown are divided into three sub-time windows: p1 to p4 are placed in the same sub-time window W1 (T1-T4); p4 to p6 are placed in the same sub-time window W2 (T4-T5); p5 to p6 are placed in the same sub-time window W3 (T5-T7); and W4 (p6 to p8) are placed in the same sub-time window T7-T9. Based on the above division results, the time span of each sub-time window can be determined in this embodiment. Then, the X-axis of the sound source coordinate system is divided according to each time span, and the pitch nodes are assigned to their respective sub-time windows to obtain the pitch waveform diagram.

[0100] This embodiment obtains the coordinates of each pitch node corresponding to the initial sound source in the sound source coordinate system; selects an initial pitch node from the pitch nodes corresponding to the initial sound source; determines the slope between the initial pitch node and each adjacent pitch node according to the coordinates; and divides the pitch nodes in the sound source coordinate system according to the slope, thereby obtaining an accurate pitch waveform diagram.

[0101] refer to Figure 6 , Figure 6 This is a flowchart illustrating a third embodiment of a pitch adjustment method according to the present invention.

[0102] Based on the first or second embodiment described above, a third embodiment of the pitch adjustment method of the present invention is proposed.

[0103] Taking the first embodiment described above as an example, in this embodiment, step S50 specifically includes:

[0104] Step S501: When multiple users are detected to be performing operations, target operation data is determined based on multiple operation data for the tone waveform.

[0105] Step S502: Adjust the pitch of the initial sound source according to the target operation data.

[0106] In this embodiment, the operation data will be integrated, and the pitch of the initial sound source will be adjusted based on the final integrated target operation data.

[0107] In this embodiment, in order to accurately obtain the target operation data, the pitch adjustment time corresponding to each operation data can be obtained first. Since each user may adjust the pitch at different times, the pitch adjustment time can determine the time when different users perform the operation.

[0108] It is easy to understand that multiple operation data exist at each pitch adjustment moment. Specifically, in this embodiment, the operation type and sliding parameters can be obtained from the operation data. The operation type includes, for example, adjusting the pitch value or the duration of the sound source. The sliding parameters include the sliding amplitude and the number of sliding operations. The sliding amplitude represents the adjustment range of the pitch value or the adjustment range of the sound source duration. Finally, based on the operation type and sliding parameters at each pitch adjustment moment, the target operation data for each pitch adjustment moment can be obtained.

[0109] In specific implementation, this embodiment illustrates the above process with an example. Assume that the effect value on the x-axis is 10 milliseconds and the effect value on the y-axis is 0.1, where the effect value represents the duration of the sound source and the pitch value adjusted by the user sliding 1mm. Three users perform operations simultaneously at time T: (1) User A performs a sliding operation at time T (the effect value is [0,-y], the y-axis effect value is 0.1, so the final effect value is [0,-0.1]), sliding 3 times with sliding amplitudes of 25mm, 30mm, and 35mm respectively. According to the formula, the operation data of user A at time T is (25+30+35)×[0,-0.1]=[0,- 9];(2) User B performed an upward swipe operation at time T, swiping 4 times with swipe amplitudes of 21mm, 22mm, 25mm, and 26mm. According to the formula, the operation data of user B at time T is (21+22+25+26)×[0,0.1]=[0,9.4];(3) User C performed an expansion operation at time T, swiping 5 times with swipe amplitudes of 18mm, 19mm, 20mm, 24mm, and 25mm. According to the formula, the operation data of user C at time T is (18+19+20+24+25)×[10,0]=[1060,0]. Combining the operation data corresponding to time T for users A, B, and C, the target operation data at time T can be determined as [0+0+1060,-9+9.4+0]=[106,0.4].

[0110] Furthermore, after determining the target operation data, this embodiment can adjust the pitch of the initial sound source based on the target operation data. Specifically, this embodiment can determine the target sliding effect value based on the corresponding operation type, number of slides, and sliding amplitude obtained from the target operation data, determine the target sound source adjustment value based on the operation type, determine the target sound source adjustment value based on the number of slides, sliding amplitude, and target sliding effect value, and finally adjust according to the target sound source adjustment value. For example, if the target operation data is a downward sliding operation at time T, the downward sliding operation corresponds to the adjustment of the pitch value, and the sliding effect value corresponding to the pitch value is 0.1, the target sliding effect value can be determined to be [0, -0.1], and the sliding was performed once with a sliding amplitude of 35mm, the target sound source adjustment value can be determined to be [0, -3.5], that is, the pitch value of the initial sound source is lowered by 3.5.

[0111] This embodiment determines the target operation data through multiple operation data of the tone waveform; adjusts the tone of the initial sound source according to the target operation data, and accurately obtains the target operation data through multiple data, so that multiple users can simultaneously and accurately adjust the sound source.

[0112] Furthermore, embodiments of the present invention also propose a storage medium storing a pitch adjustment program, wherein when the pitch adjustment program is executed by a processor, it implements the steps of the pitch adjustment method described above.

[0113] Since this storage medium adopts all the technical solutions of all the above embodiments, it has at least all the beneficial effects brought about by the technical solutions of the above embodiments, which will not be repeated here.

[0114] Reference Figure 7 , Figure 7 This is a structural block diagram of the first embodiment of the tone adjustment device of the present invention.

[0115] like Figure 7 As shown, the tone adjustment device proposed in this embodiment of the invention includes:

[0116] The acquisition module 10 is used to acquire the pitch value and duration of the initial sound source.

[0117] The construction module 20 is used to construct a sound source coordinate system based on the pitch value and the sound source duration.

[0118] The generation module 30 is used to generate a pitch waveform diagram based on the sound source coordinate system.

[0119] The receiving module 40 is used to acquire operation data for the tone waveform diagram.

[0120] The adjustment module 50 is used to adjust the pitch of the initial sound source according to the operation data.

[0121] This embodiment obtains the pitch value and duration of an initial sound source; constructs a sound source coordinate system based on the pitch value and duration; generates a pitch waveform based on the sound source coordinate system; obtains operation data for the pitch waveform; and adjusts the pitch of the initial sound source based on the operation data, enabling non-professional users to adjust the sound source according to their own preferences.

[0122] In one embodiment, the acquisition module 10 is further configured to acquire the coordinates of each pitch node corresponding to the initial sound source in the sound source coordinate system; select an initial pitch node from the pitch nodes corresponding to the initial sound source; determine the slope between the initial pitch node and each adjacent pitch node according to the coordinates; and divide the pitch nodes in the sound source coordinate system according to the slope to obtain a pitch waveform diagram.

[0123] In one embodiment, the acquisition module 10 is further configured to acquire the slope difference between each slope; when the slope difference is within a preset difference range, determine that the pitch nodes corresponding to the slope differences within the preset difference range are in the same syllable change trend; divide the pitch nodes in the sound source coordinate system that are in the same change trend into the same sub-time window according to the syllable change trend corresponding to each pitch node; determine the time span of each sub-time window based on the division result; divide the pitch nodes in the sound source coordinate system according to the time span of each sub-time window to obtain a pitch waveform diagram.

[0124] In one embodiment, the adjustment module 50 is further configured to determine target operation data based on multiple operation data for the tone waveform when multiple users are detected to be operating; and to adjust the tone of the initial sound source based on the target operation data.

[0125] In one embodiment, the adjustment module 50 is further configured to determine the pitch adjustment time corresponding to each operation data based on the pitch waveform diagram; extract the operation type and sliding parameter corresponding to each pitch adjustment time from multiple operation data for the pitch waveform diagram; and generate target operation data for each pitch adjustment time according to the operation type and the sliding parameter.

[0126] In one embodiment, the adjustment module 50 is further configured to acquire the operation type, number of slides, and slide amplitude corresponding to the target operation data; determine the target slide effect value according to the operation type; determine the target sound source adjustment value according to the number of slides, the slide amplitude, and the target slide effect value; and adjust the pitch value and / or sound source duration of the initial sound source according to the target sound source adjustment value.

[0127] In one embodiment, the adjustment module 50 is further configured to acquire a sound source background image corresponding to the initial sound source; determine a sound source adjustment result based on the initial sound source and the adjusted initial sound source; and adjust the sound source background image based on the sound source adjustment result to obtain a target sound source background image.

[0128] It should be understood that the above are merely illustrative examples and do not constitute any limitation on the technical solutions of the present invention. In specific applications, those skilled in the art can make settings as needed, and the present invention does not impose any restrictions on this.

[0129] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of this invention. In practical applications, those skilled in the art can select some or all of the workflow to achieve the purpose of this embodiment according to actual needs, and no restrictions are imposed here.

[0130] In addition, for technical details not described in detail in this embodiment, please refer to the tone adjustment method provided in any embodiment of the present invention, which will not be repeated here.

[0131] Furthermore, it should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0132] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0133] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as read-only memory (ROM) / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0134] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.

Claims

1. A pitch adjustment method, characterized in that, The pitch adjustment method includes: Obtain the pitch value and duration of the initial sound source; A sound source coordinate system is constructed based on the pitch value and sound source duration; Obtain the coordinates of each pitch node corresponding to the initial sound source in the sound source coordinate system; Select an initial sound node from each sound node corresponding to the initial sound source; The slope between the initial pitch node and each adjacent pitch node is determined based on the coordinates. The pitch nodes in the sound source coordinate system are divided according to the slope to obtain a pitch waveform diagram; Obtain operation data for the tone waveform, wherein the operation data is input by the user through the received tone waveform; The pitch of the initial sound source is adjusted according to the operation data.

2. The pitch adjustment method as described in claim 1, characterized in that, The step of dividing the pitch nodes in the sound source coordinate system according to the slope to obtain a pitch waveform diagram includes: Obtain the slope difference between each slope; When the slope difference is within a preset difference range, it is determined that the phonological nodes corresponding to the slope difference within the preset difference range are in the same syllable change trend; Based on the syllable change trend corresponding to each syllable, the syllables in the sound source coordinate system with the same change trend are divided into the same sub-time window; The time span of each sub-time window is determined based on the division results; The sound source coordinate system is divided into sound nodes according to the time span of each sub-time window to obtain a pitch waveform diagram.

3. The pitch adjustment method as described in claim 1, characterized in that, The step of adjusting the pitch of the initial sound source based on the operation data includes: When multiple users are detected to be performing operations, target operation data is determined based on multiple operation data related to the tone waveform. The initial sound source is pitched according to the target operation data.

4. The pitch adjustment method as described in claim 3, characterized in that, The step of determining the target operation data based on multiple operation data for the tone waveform includes: The pitch adjustment time corresponding to each operation data is determined based on the pitch waveform diagram. Extract the operation type and sliding parameters corresponding to each pitch adjustment moment from multiple operation data for the pitch waveform diagram; Target operation data for each pitch adjustment moment is generated based on the operation type and the sliding parameters.

5. The pitch adjustment method as described in claim 3, characterized in that, The step of adjusting the pitch of the initial sound source according to the target operation data includes: Obtain the operation type, number of swipes, and swipe range corresponding to the target operation data; Determine the target sliding effect value based on the operation type; The target sound source adjustment value is determined based on the number of slides, the slide amplitude, and the target slide effect value. The pitch value and / or duration of the initial sound source are adjusted according to the target sound source adjustment value.

6. The pitch adjustment method according to any one of claims 1 to 5, characterized in that, After adjusting the pitch of the initial sound source according to the operation data, the method further includes: Obtain the background image of the sound source corresponding to the initial sound source; The sound source adjustment result is determined based on the initial sound source and the adjusted initial sound source; The background image of the sound source is adjusted according to the sound source adjustment result to obtain the target sound source background image.

7. A tone adjustment device, characterized in that, The tone adjustment device includes: The acquisition module is used to obtain the pitch value and duration of the initial sound source; The construction module is used to construct a sound source coordinate system based on the pitch value and the sound source duration; The generation module is used to obtain the coordinates of each pitch node corresponding to the initial sound source in the sound source coordinate system; select an initial pitch node from the pitch nodes corresponding to the initial sound source; determine the slope between the initial pitch node and each adjacent pitch node according to the coordinates; and divide the pitch nodes in the sound source coordinate system according to the slope to obtain a pitch waveform diagram. A receiving module is used to acquire operation data for the tone waveform, wherein the operation data is input by the user through the received tone waveform; The adjustment module is used to adjust the pitch of the initial sound source according to the operation data.

8. A tone adjustment device, characterized in that, The tone adjustment device includes: a memory, a processor, and a tone adjustment program stored in the memory and running on the processor, the tone adjustment program being configured to implement the tone adjustment method as described in any one of claims 1 to 6.

9. A storage medium, characterized in that, The storage medium stores a pitch adjustment program, which, when executed by a processor, implements the pitch adjustment method as described in any one of claims 1 to 6.

Images