Music making method and device, storage medium and electronic equipment

Abstract

The invention discloses a music production method and device, a storage medium and electronic equipment, and the method comprises the steps: obtaining user data which comprises user operation parameters and user generated audio; classifying the user generated audios, and adjusting the classified user generated audios according to the user operation parameters to obtain compiled audios; and fusing the compiled audio with the target song to obtain a personalized song. According to the method, the user generated audio generated in the car using process of the user is adjusted based on the user operation parameters generated in the car using process of the user, the compiled audio obtained through adjustment is fused with the target song, the personalized target song of the user is generated, and the personalized music playing requirement of the user is met.

Description

Technical Field

[0001] The present invention relates to the technical field of music production, and in particular, to a music production method, apparatus, storage medium, and electronic device. Background Art

[0002] The music played during the user's driving is highly homogeneous. The user has no time to specifically learn the ability to compose and produce songs, and the music played during the user's driving cannot meet the user's need for personalized music playback. Summary of the Invention

[0003] The present invention aims to solve at least one of the technical problems in the related art to some extent. To this end, an object of the present invention is to provide a music production method, which can generate personalized songs based on the user's driving habits to meet the user's need for personalized music playback when the user does not have the ability to compose and produce songs.

[0004] A second object of the present invention is to provide a music production apparatus.

[0005] A third object of the present invention is to provide a computer-readable storage medium.

[0006] A fourth object of the present invention is to provide an electronic device.

[0007] To achieve the above object, an embodiment of the first aspect of the present invention provides a music production method, the method including: obtaining user data, where the user data includes user operation parameters and user-generated audio; classifying the user-generated audio, and adjusting the classified user-generated audio according to the user operation parameters to obtain compiled audio; and fusing the compiled audio with a target song to obtain a personalized song.

[0008] According to the music production method of the embodiment of the present invention, the user-generated audio generated during the user's driving is adjusted based on the user operation parameters generated during the user's driving, and the adjusted compiled audio is fused with the target song to generate a personalized target song for the user. Even if the user does not have the ability to compose and produce songs, personalized songs based on the user's driving habits can be generated to meet the user's need for personalized music playback.

[0009] In addition, the music production method proposed according to the above embodiment of the present invention may further have the following additional technical features:

[0010] According to an embodiment of the present invention, the classifying the user-generated audio includes: using preset parameters to perform similarity matching classification on the user-generated audio and the songs in the user song library, where the preset parameters include music elements.

[0011] According to an embodiment of the present invention, the user operation parameter at least includes one of the intensity, duration, and angle for the operation object. Adjusting the classified user-generated audio according to the user operation parameter includes: adjusting the decibel of the classified user-generated audio according to the intensity for the operation object in the user operation parameter, adjusting the rhythm of the classified user-generated audio according to the duration for the operation object in the user operation parameter, and adjusting the beat of the classified user-generated audio according to the angle for the operation object in the user operation parameter.

[0012] According to an embodiment of the present invention, fusing the compiled audio with the target song includes: obtaining the music elements of the target song and determining the target compiled audio according to the music elements; calculating the similarity between the target compiled audio and the song segment in the target song; and replacing the song segment in the target song with the target compiled audio whose similarity is greater than a preset threshold.

[0013] According to an embodiment of the present invention, the music elements at least include one of rhythm, harmony, melody, tempo, intensity, form, mode, texture, and timbre.

[0014] According to an embodiment of the present invention, the operation object at least includes one of operating a steering wheel, stepping on a pedal, opening or closing a car door, a button, and a joystick.

[0015] According to an embodiment of the present invention, the user-generated audio at least includes one of a screen click sound, an operation button sound, a keyboard click sound, a walking sound, a sound of a mobile phone rubbing against clothes, a car door opening or closing sound, a sound of buckling or unbuckling a seat belt, a tire rubbing against the ground sound, a motor / engine sound, an in-car conversation sound, and a vehicle button sound.

[0016] To achieve the above object, an embodiment of the second aspect of the present invention provides a music production device, which includes: an acquisition module for acquiring user data, where the user data includes user operation parameters and user-generated audio; a matching module for classifying the user-generated audio and adjusting the classified user-generated audio according to the user operation parameters to obtain a compiled audio; and a production module for fusing the compiled audio with a target song to obtain a personalized song.

[0017] To achieve the above object, an embodiment of the third aspect of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the music production method as proposed in the embodiment of the first aspect of the present invention.

[0018] To achieve the above object, an embodiment of the fourth aspect of the present invention provides an electronic device, including a memory and a processor. A computer program is stored on the memory. When the computer program is executed by the processor, the music production method proposed in the embodiment of the first aspect of the present invention is implemented.

[0019] Additional aspects and advantages of the present invention will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of the present invention. Description of the Drawings

[0020] Figure 1 is a flowchart of a music production method according to an embodiment of the present invention;

[0021] Figure 2 is a flowchart of fusing and arranging an audio and a target song according to an embodiment of the present invention;

[0022] Figure 3 is a schematic diagram of a music production device according to an embodiment of the present invention;

[0023] Figure 4 is a structural block diagram of a controller according to an embodiment of the present invention. Detailed Embodiments

[0024] Embodiments of the present invention will be described in detail below. Examples of the embodiments are shown in the drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the drawings are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0025] The following combines the specification appendices Figure 1 - Appendices Figure 4 and specific implementation manners to detail the music production method, device, storage medium, and electronic device of the embodiments of the present invention.

[0026] Figure 1 is a flowchart of a music production method according to an embodiment of the present invention. As Figure 1 shown, the music production method may include:

[0027] S101, obtaining user data, where the user data includes user operation parameters and user-generated audio.

[0028] In an embodiment of the present invention, the user data includes user operation parameters and user-generated audio. Among them, the user operation parameters are parameters generated when the user operates the vehicle, and the user-generated audio is audio generated during the user's vehicle use. Among them, the audio generated during the user's vehicle use can be recorded by a recording module.

[0029] In one embodiment of the present invention, the user-generated audio includes at least one of a screen click sound, an operation button sound, a keyboard click sound, a walking sound, a sound of the mobile phone rubbing against clothes, a car door opening / closing sound, a seat belt buckle plugging / unplugging sound, a tire rubbing against the ground sound, a motor / engine sound, an in-vehicle conversation sound, and a vehicle button sound.

[0030] Implementable, the sound generated by the user during vehicle use is recorded by using a recording module in the vehicle or a mobile device such as a mobile phone. Specifically, a user mobile device, such as the user's mobile phone, can be used to collect and store the user's screen click sound, operation button sound, keyboard click sound, walking sound, sound of the mobile phone rubbing against clothes, car door opening / closing sound, seat belt buckle plugging / unplugging sound, tire rubbing against the ground sound, motor / engine sound, in-vehicle conversation sound, vehicle button sound, etc. Among them, the sounds generated inside the vehicle, such as the car door opening / closing sound, seat belt buckle plugging / unplugging sound, tire rubbing against the ground sound, motor / engine sound, and in-vehicle conversation sound, can be collected and stored by using the recording module in the vehicle.

[0031] In an embodiment of the present invention, the user operation parameter includes at least one of the force, duration, and angle for the operation object.

[0032] In one embodiment of the present invention, the operation object includes at least one of operating the steering wheel, stepping on the pedal, opening / closing the car door, button, and joystick.

[0033] Exemplarily, the user operation parameters include the force, duration, and angle when the user operates the steering wheel. The force, duration, and angle when the user steps on the pedal. The force, duration, and angle when the user opens / closes the car door. The force, duration, and angle when the user presses the button.

[0034] It should be noted that the operation object in the embodiment of the present invention is not limited to operating the steering wheel, stepping on the pedal, opening / closing the car door, and pressing the button, but also includes the operation of other vehicle components, which will not be elaborated one by one here.

[0035] S102, classify the user-generated audio, and adjust the classified user-generated audio according to the user operation parameters to obtain the compiled audio.

[0036] In one embodiment of the present invention, classifying the user-generated audio may include:

[0037] Using preset parameters, perform similarity matching classification on the user-generated audio and the songs in the user song library, where the preset parameters include music elements.

[0038] In one embodiment of the present invention, the music elements include at least one of rhythm, harmony, melody, tempo, dynamics, form, mode, texture, and timbre.

[0039] Implementable. Obtain the song classifications in the user's song library. Different song classifications correspond to different music styles. Different music styles have different musical elements, such as rhythm, harmony, melody, tempo, dynamics, form, mode, texture, timbre, etc. Obtain the music styles of each song in each song classification. Use preset parameters, such as rhythm, harmony, melody, tempo, dynamics, form, mode, texture, timbre, etc., to perform similarity matching on the segments of the user-generated audio and the songs in the above three song categories to obtain the classification result of the user-generated audio.

[0040] In an embodiment of the present invention, the song classifications in the user's song library can be the songs marked as liked in the user's song library, the songs marked as disliked, and the songs marked as not yet contacted. The classification result corresponding to the user-generated audio corresponds to the song classifications in the user's song library, and liked, disliked, and not-yet-contacted user-generated audio can be obtained.

[0041] It should be noted that the song classifications are not limited to the above methods and can also be classified according to song styles, such as rock, folk, classical, etc. Corresponding to the above song classifications, the user-generated audio corresponding to the song classifications is obtained.

[0042] In an embodiment of the present invention, the user operation parameters at least include one of the force, duration, and angle for the operation object. Adjusting the classified user-generated audio according to the user operation parameters may include:

[0043] Adjust the decibel of the classified user-generated audio according to the force for the operation object in the user operation parameters, adjust the rhythm of the classified user-generated audio according to the duration for the operation object in the user operation parameters, and adjust the beat of the classified user-generated audio according to the angle for the operation object in the user operation parameters.

[0044] It should be noted that the production of songs with different music styles involves specific musical instruments. For example, for a drum set, the sound changes are related to the speed and force of percussion; for a violin, the sound changes are related to the pushing and pulling length of the bow and the force of finger pressing; for example, the sound changes of a piano are related to the force and time of user pressing...

[0045] Exemplarily, when it is detected that the user operates the steering wheel, obtain the force, duration, and angle when the user operates the steering wheel, and adjust the decibel, rhythm, and beat of the audio generated by the classified user according to the force, duration, and angle when the user operates the steering wheel. When it is detected that the user steps on the pedal, obtain the force and duration when the user steps on the pedal, and adjust the decibel and rhythm of the audio generated by the classified user according to the force, duration, and angle when the user steps on the pedal. When it is detected that the user opens or closes the car door, obtain the force, duration, and angle when the user opens or closes the car door, and adjust the decibel and rhythm of the audio generated by the classified user. When it is detected that the user presses a button, obtain the force, duration, and angle when the user presses the button, and adjust the decibel and rhythm of the audio generated by the classified user according to the force, duration, and angle when the user presses the button.

[0046] It should be noted that the operation objects in the embodiments of the present invention are not limited to operating the steering wheel, stepping on the pedal, opening or closing the car door, buttons, and joysticks. For operations on other objects of the vehicle, the adjustment method for the audio generated by the classified user is the same as the above adjustment method, and will not be elaborated here.

[0047] In the embodiments of the present invention, when the user's adjustment of the operation object does not involve the angle, the beat of the audio generated by the classified user is not adjusted. When the force is not involved, the decibel of the audio generated by the classified user is not adjusted.

[0048] S103, fuse the compiled audio with the target song to obtain a personalized song.

[0049] Specifically, obtain the target song, such as the song being played by the user or the song to be played in the music library. Fuse the compiled audio with the target song to obtain a personalized song based on the user's driving habits.

[0050] In an embodiment of the present invention, Figure 2 As shown, fusing the compiled audio with the target song includes:

[0051] S201, obtain the music elements of the target song and determine the target compiled audio according to the music elements;

[0052] S202, calculate the similarity between the target compiled audio and the song segment in the target song;

[0053] S203, replace the song segment in the target song with the target compiled audio whose similarity is greater than the preset threshold.

[0054] Specifically, obtain the music elements of the target song, that is, obtain the rhythm, harmony, melody, tempo, dynamics, form, mode, texture, and timbre of the target song. Determine one or more target compiled audio from the compiled audio corresponding to the user-generated audio after the above classification according to the music elements of the target song. The target compiled audio is the compiled audio that can be integrated with the style of the target song. Calculate the similarity between the determined target compiled audio and each section of the target song. Replace the corresponding section of the target song with the target compiled audio whose similarity is greater than the preset threshold, such as the similarity is greater than 80%, so as to generate a personalized song that meets the personalized needs of the user. It should be noted that if there are multiple target compiled audio with similarities greater than the preset threshold, replace the corresponding section of the target song with the target compiled audio corresponding to the maximum similarity.

[0055] The music production method of the embodiment of the present invention adjusts the user-generated audio generated during the user's driving process based on the user operation parameters generated during the user's driving process, and integrates the adjusted compiled audio with the target song to generate a personalized target song for the user. Even if the user does not have the ability to compose and produce songs, personalized songs based on the user's driving habits can be generated to meet the user's need for personalized music playback.

[0056] The present invention provides a music production device.

[0057] Figure 3 It is a schematic diagram of the music production device according to an embodiment of the present invention. As Figure 3 shown, the music production device 100 may include: an acquisition module 10 for acquiring user data, where the user data includes user operation parameters and user-generated audio; a matching module 20 for classifying the user-generated audio and adjusting the classified user-generated audio according to the user operation parameters to obtain compiled audio; a production module 30 for integrating the compiled audio with the target song to obtain a personalized song.

[0058] It should be noted that for other specific implementation manners of the music production device provided in the embodiment of the present invention, reference may be made to other specific implementation manners of the music production method of the above embodiment of the present invention.

[0059] The music production device of the embodiment of the present invention adjusts the user-generated audio generated during the user's driving process based on the user operation parameters generated during the user's driving process, and integrates the adjusted compiled audio with the target song to generate a personalized target song for the user. Even if the user does not have the ability to compose and produce songs, personalized songs based on the user's driving habits can be generated to meet the user's need for personalized music playback.

[0060] The present invention provides a computer-readable storage medium.

[0061] In this embodiment, a computer program is stored on a computer-readable storage medium. When the computer program is executed by a processor, the music production method as described above is implemented.

[0062] The present invention provides an electronic device.

[0063] In this embodiment, the electronic device may include a memory and a processor. A computer program is stored on the memory. When the computer program is executed by the processor, the music production method as described above is implemented.

[0064] Figure 4 It is a structural block diagram of a controller according to an embodiment of the present invention.

[0065] As Figure 4 shown, the controller 500 includes: a processor 501 and a memory 503. Among them, the processor 501 and the memory 503 are connected, such as connected through a bus 502. Optionally, the controller 500 may further include a transceiver 504. It should be noted that in practical applications, the number of transceivers 504 is not limited to one, and the structure of the controller 500 does not constitute a limitation to the embodiments of the present invention.

[0066] The processor 501 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in connection with the disclosure of the present invention. The processor 501 may also be a combination that realizes computing functions, such as a combination including one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0067] The bus 502 may include a path for transmitting information between the above components. The bus 502 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The bus 502 may be divided into an address bus, a data bus, a control bus, etc. For the sake of representation, Figure 4 only a thick line is used to represent it in the figure, but it does not mean that there is only one bus or one type of bus.

[0068] The memory 503 is used to store a computer program corresponding to the music production method of the foregoing embodiments of the present invention, and the execution of the computer program is controlled by the processor 501. The processor 501 is used to execute the computer program stored in the memory 503 to implement the content shown in the foregoing method embodiments.

[0069] Among them, the controller 500 includes but is not limited to: mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4 The shown controller 500 is only an example and should not impose any limitation on the functions and usage scope of the embodiments of the present invention.

[0070] The computer-readable storage medium and electronic device of the embodiments of the present invention utilize the above music production method to adjust the user-generated audio generated during the user's driving process based on the user operation parameters generated during the user's driving process, and fuse the adjusted compiled audio with the target song to generate a user-personalized target song. Even if the user does not have the ability to compose and produce songs, personalized songs based on the user's driving habits can be generated to meet the user's need for personalized music playback.

[0071] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a definite sequence list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other systems that can fetch and execute instructions from the instruction execution system, apparatus, or device), or in combination with these instruction execution systems, apparatuses, or devices. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by or in combination with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: an electrical connection portion having one or more wirings (electronic device), a portable computer diskette (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can even be paper or other suitable media on which the program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpretation, or otherwise processing as appropriate, and then storing it in a computer memory.

[0072] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or a combination of the following techniques well known in the art can be used: discrete logic circuits having logic gate circuits for implementing logical functions on data signals, application specific integrated circuits having appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

[0073] In the description of this specification, the description with reference to terms such as "one embodiment", "some embodiments", "example", "specific example", or "some examples", etc. means that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples.

[0074] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings. They are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as a limitation to the present invention.

[0075] In addition, the terms "first" and "second" are only used for descriptive purposes and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of such features. In the description of the present invention, the meaning of "a plurality of" is at least two, such as two, three, etc., unless otherwise specifically and clearly defined.

[0076] In the present invention, unless otherwise clearly specified and limited, the terms "mounted", "connected", "coupled", "fixed", etc. should be understood in a broad sense. For example, it may be a fixed connection, a detachable connection, or integrated; it may be a mechanical connection or an electrical connection; it may be directly connected or indirectly connected through an intermediate medium, and it may be the internal communication of two elements or the interaction relationship between two elements, unless otherwise clearly limited. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0077] In the present invention, unless otherwise clearly specified and limited, the first feature being "on" or "under" the second feature may be that the first and second features are in direct contact, or the first and second features are indirectly in contact through an intermediate medium. Moreover, the first feature being "above", "over" and "on top of" the second feature may be that the first feature is directly above or obliquely above the second feature, or merely indicates that the first feature has a higher horizontal height than the second feature. The first feature being "under", "beneath" and "underneath" the second feature may be that the first feature is directly below or obliquely below the second feature, or merely indicates that the first feature has a lower horizontal height than the second feature.

[0078] Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as a limitation to the present invention. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present invention.

Claims

1. A music production method, characterized in that, The method includes: Obtaining user data, where the user data includes user operation parameters and user-generated audio; Classifying the user-generated audio and adjusting the classified user-generated audio according to the user operation parameters to obtain compiled audio; Fusing the compiled audio with a target song to obtain a personalized song.

2. The music production method according to claim 1, wherein The classifying the user-generated audio includes: Using preset parameters to perform similarity matching classification on the user-generated audio and the songs in the user song library, where the preset parameters include musical elements.

3. The music production method according to claim 1, characterized in that, The user operation parameters at least include one of the force, duration, and angle for the operation object, and the adjusting the classified user-generated audio according to the user operation parameters includes: Adjusting the decibel of the classified user-generated audio according to the force for the operation object in the user operation parameters, adjusting the rhythm of the classified user-generated audio according to the duration for the operation object in the user operation parameters, and adjusting the beat of the classified user-generated audio according to the angle for the operation object in the user operation parameters.

4. The music production method according to claim 1, wherein The fusing the compiled audio with the target song includes: Obtaining the musical elements of the target song and determining the target compiled audio according to the musical elements; Calculating the similarity between the target compiled audio and the song segment in the target song; Replacing the song segment in the target song with the target compiled audio whose similarity is greater than a preset threshold.

5. The music production method according to claim 2 or 4, characterized in that The musical elements at least include one of rhythm, harmony, melody, tempo, dynamics, form, mode, texture, and timbre.

6. The music production method according to claim 4, wherein The operation object at least includes one of an operation steering wheel, a pedal to be stepped on, a car door to be opened or closed, a button, and a joystick.

7. The music production method according to claim 1, characterized in that, The user-generated audio at least includes one of a screen click sound, an operation button sound, a keyboard click sound, a walking sound, a sound of a mobile phone rubbing against clothes, a car door opening or closing sound, a sound of buckling or unbuckling a seat belt, a sound of a tire rubbing against the ground, a motor / engine sound, an in-vehicle conversation sound, and a vehicle button sound.

8. A music production device, characterized in that, The device includes: An obtaining module, configured to obtain user data, where the user data includes user operation parameters and user-generated audio; A matching module, configured to classify the user-generated audio and adjust the classified user-generated audio according to the user operation parameters to obtain compiled audio; A production module, configured to fuse the compiled audio with a target song to obtain a personalized song.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the music production method according to any one of claims 1-7.

10. An electronic device, comprising a memory and a processor, wherein a computer program is stored on the memory, characterized in that, When the computer program is executed by the processor, it implements the music production method according to any one of claims 1-7.

Images