Audio production method, medium, device and computing equipment
By designing a soft sound source suitable for string sweeping and its sampling library, a mapping relationship with a single note MIDI track was established, and the problem of poor performance effect of AI arrangement module in string sweeping performance was solved, and a more realistic guitar string sweeping was achieved. Audio generation improves user experience.
Patent Information
- Application Number
- CN202411129816.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-15
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-08-15
AI Technical Summary
When performing string sweeping, the performance effect is poor, and it is impossible to effectively simulate the audio characteristics of guitar string sweeping.
By designing a soft sound source suitable for string sweeping and its sampling library, a mapping relationship with a single note MIDI track is established, chords related to string sweeping are generated based on the arrangement template, and rendered using the soft sound source engine to generate corresponding chords corresponding to the chords. audio.
提高了扫弦演奏时的演奏效果真实性,增强了用户体验,用户感知不到对扫弦轨道的任何处理。
Smart Images

Figure CN119068853A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present disclosure relate to the technical field of digital signal processing, and more specifically, the embodiments of the present disclosure relate to an audio production method, medium, apparatus, and computing device. Background Art
[0002] This section is intended to provide a background or context to the embodiments of the present disclosure. No description herein is admitted to be prior art by virtue of its inclusion in this section.
[0003] Artificial Intelligence (AI) music arrangement refers to the process of using artificial intelligence technology to automatically generate or assist in the creation of music. With the advancement of machine learning and deep learning technologies, AI music arrangement has made significant progress.
[0004] At present, by setting up a set of Musical Instrument Digital Interface (MIDI) for arranging and a soft sound source inside the AI arranging module containing different instrument tracks, users can realize MIDI performance of different instruments based on the AI arranging module. However, when strumming and playing through the AI arranging module, the authenticity of the performance effect is poor. Summary of the invention
[0005] The present disclosure provides an audio production method, medium, device and computing equipment to solve the problem of poor authenticity of performance effects when strumming is performed through an existing AI arrangement module.
[0006] In a first aspect of the embodiments of the present disclosure, there is provided an audio production method, comprising:
[0007] Obtaining a target chord, where the target chord is a chord related to the strumming generated based on an arrangement template;
[0008] Mapping the target chord onto a single-note Musical Instrument Digital Interface (MIDI) key position to obtain a target single-note MIDI track;
[0009] Based on the mapping relationship between the sampling files in the sampling library of the soft sound source corresponding to the strumming track and the single-note MIDI track, determining the target sampling file corresponding to the target single-note MIDI track, wherein the sampling files in the sampling library correspond one-to-one to the chords included in the arrangement template;
[0010] The soft sound source-based engine applies the target single-note MIDI track to render the target sample file to obtain the audio corresponding to the target chord.
[0011] In one possible implementation, a single note MIDI track is obtained by:
[0012] Obtain a first chord list; for each predefined chord in the first chord list, determine the chord type corresponding to other notes in the predefined chord except the root note; combine the chord type with different predefined root notes respectively to obtain the chords included in the arrangement template; for each chord included in the arrangement template, map the chord to a MIDI key position to obtain a single-note MIDI track.
[0013] In a possible implementation, the soft sound source is tested in the following manner:
[0014] Get the multi-note MIDI track corresponding to the strumming track; get the second chord list corresponding to the multi-note MIDI track according to the multi-note MIDI track; get the single-note MIDI track corresponding to the multi-note MIDI track according to the second chord list; determine the sampling file corresponding to the single-note MIDI track based on the mapping relationship between the sampling file in the sampling library of the soft sound source corresponding to the strumming track and the single-note MIDI track; based on the engine of the soft sound source, use the single-note MIDI track to render the sampling file.
[0015] In a possible implementation, obtaining a second chord list corresponding to a multi-note MIDI track according to a multi-note MIDI track includes: parsing the multi-note MIDI track and extracting at least one note interval included in the multi-note MIDI track from the parsed multi-note MIDI track, where one note interval is used to represent one chord; for each note interval, determining a chord name corresponding to the note interval based on a chord recognition algorithm; and determining a set of chord names as a second chord list.
[0016] In a possible implementation, based on a chord recognition algorithm, determining the chord name corresponding to the note interval includes: determining a root note from the notes included in the note interval; arranging all the notes above the root note in order of pitch from low to high modulo an octave to obtain the chord properties corresponding to the note interval; and determining the chord name corresponding to the note interval based on the chord properties.
[0017] In a possible implementation, the audio production method further includes: generating a target multi-note MIDI track corresponding to the target single-note MIDI track; and outputting the target multi-note MIDI track.
[0018] In a possible implementation, generating a target multi-note MIDI track corresponding to a target single-note MIDI track includes: determining a chord name corresponding to the target single-note MIDI track according to a target sampling file; determining all notes of the chord corresponding to the chord name based on a chord recognition algorithm; and generating a target multi-note MIDI track according to all the notes.
[0019] In a possible implementation, the soft sound source further includes a soft sound source type, and based on the engine of the soft sound source, a target single-note MIDI track is applied to render the target sampling file to obtain audio corresponding to the target chord, including: determining the soft sound source type corresponding to the target sampling file, the soft sound source type includes a first sound source type and a second sound source type; if the soft sound source type is the first sound source type, a first MIDI control signal is sent to the engine of the soft sound source, the first MIDI control signal carries the target single-note MIDI track and the target sampling file, and the engine is used to render the target sampling file using the target single-note MIDI track to obtain audio corresponding to the target chord; if the soft sound source type is the second sound source type, a second MIDI control signal is sent to the engine of the soft sound source, the second MIDI control signal carries the target single-note MIDI track and the target sampling file, and the engine is used to render the target sampling file using the target single-note MIDI track to obtain audio corresponding to the target chord.
[0020] In a second aspect of the embodiments of the present disclosure, there is provided an audio production device, comprising:
[0021] An acquisition module, used for acquiring a target chord, where the target chord is a chord related to the strumming and generated based on the arrangement template;
[0022] A mapping module, used for mapping a target chord onto a single-note MIDI key position to obtain a target single-note MIDI track;
[0023] A determination module, for determining a target sampling file corresponding to a target single-note MIDI track based on a mapping relationship between sampling files in a sampling library of a soft sound source corresponding to a strumming track and a single-note MIDI track, wherein the sampling files in the sampling library correspond one-to-one to the chords included in the arrangement template;
[0024] The rendering module is used for the engine based on the soft sound source, and applies the target single-note MIDI track to render the target sampling file to obtain the audio corresponding to the target chord.
[0025] In one possible implementation, a single note MIDI track is obtained by:
[0026] Obtain a first chord list; for each predefined chord in the first chord list, determine the chord type corresponding to other notes in the predefined chord except the root note; combine the chord type with different predefined root notes respectively to obtain the chords included in the arrangement template; for each chord included in the arrangement template, map the chord to a MIDI key position to obtain a single-note MIDI track.
[0027] In a possible implementation, the soft sound source is tested in the following manner:
[0028] Get the multi-note MIDI track corresponding to the strumming track; get the second chord list corresponding to the multi-note MIDI track according to the multi-note MIDI track; get the single-note MIDI track corresponding to the multi-note MIDI track according to the second chord list; determine the sampling file corresponding to the single-note MIDI track based on the mapping relationship between the sampling file in the sampling library of the soft sound source corresponding to the strumming track and the single-note MIDI track; based on the engine of the soft sound source, use the single-note MIDI track to render the sampling file.
[0029] In a possible implementation, the audio production device also includes a processing module, which is used to: parse a multi-note MIDI track, and extract at least one note interval included in the multi-note MIDI track from the parsed multi-note MIDI track, where a note interval is used to represent a chord; for each note interval, based on a chord recognition algorithm, determine the chord name corresponding to the note interval; and determine a set of chord names as a second chord list.
[0030] In a possible implementation, the processing module is also used to: determine the root note from the notes included in the note interval; arrange all the notes above the root note in order of pitch from low to high modulo an octave to obtain the chord properties corresponding to the note interval; and determine the chord name corresponding to the note interval based on the chord properties.
[0031] In a possible implementation, the audio production device further includes a generation module, which is used to: generate a target multi-note MIDI track corresponding to the target single-note MIDI track; and output the target multi-note MIDI track.
[0032] In a possible implementation, the generation module is further used to: determine the chord name corresponding to the target single-note MIDI track based on the target sampling file; determine all notes of the chord corresponding to the chord name based on the chord recognition algorithm; and generate the target multi-note MIDI track based on all the notes.
[0033] In a possible implementation, the soft sound source also includes a soft sound source type, and the rendering module is specifically used to: determine the soft sound source type corresponding to the target sampling file, the soft sound source type includes a first sound source type and a second sound source type; if the soft sound source type is the first sound source type, a first MIDI control signal is sent to the engine of the soft sound source, the first MIDI control signal carries a target single-note MIDI track and a target sampling file, and the engine is used to apply the target single-note MIDI track to render the target sampling file to obtain audio corresponding to the target chord; if the soft sound source type is the second sound source type, a second MIDI control signal is sent to the engine of the soft sound source, the second MIDI control signal carries a target single-note MIDI track and a target sampling file, and the engine is used to apply the target single-note MIDI track to render the target sampling file to obtain audio corresponding to the target chord.
[0034] In a third aspect of the embodiments of the present disclosure, a computing device is provided, comprising: a processor, and a memory communicatively connected to the processor;
[0035] Memory stores computer-executable instructions;
[0036] The processor executes the computer-executable instructions stored in the memory to implement the audio production method provided in the first aspect of the present disclosure.
[0037] In a fourth aspect of the embodiments of the present disclosure, a storage medium is provided, in which computer program instructions are stored. When the computer program instructions are executed, the audio production method provided in the first aspect of the present disclosure is implemented.
[0038] In a fifth aspect of the embodiments of the present disclosure, a computer program product is provided, including a computer program, which implements the audio production method provided in the first aspect of the present disclosure when the computer program is executed.
[0039] The audio production method, medium, device and computing device provided by the present disclosure obtain the target chord related to the strumming generated based on the arrangement template, map the target chord on the single note MIDI key position, obtain the target single note MIDI track, determine the target sampling file corresponding to the target single note MIDI track based on the mapping relationship between the sampling file in the sampling library of the soft sound source corresponding to the strumming track and the single note MIDI track, and render the target sampling file based on the engine of the soft sound source using the target single note MIDI track to obtain the audio corresponding to the target chord. The present disclosure can improve the authenticity of the performance effect when performing the strumming performance based on the arrangement template by designing the soft sound source corresponding to the strumming track, and the mapping relationship between the sampling file in the soft sound source sampling library and the single note MIDI track, and rendering the target sampling file corresponding to the target single note MIDI track based on the engine of the soft sound source. At the same time, because the user who uses the arrangement template is completely unaware of any processing done by the client to the strumming track, the user experience can be improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] The above and other objects, features and advantages of the exemplary embodiments of the present disclosure will become readily understood by reading the detailed description below with reference to the accompanying drawings. In the accompanying drawings, several embodiments of the present disclosure are shown in an exemplary and non-limiting manner, in which:
[0041] Figure 1 A schematic diagram of an application scenario provided by an embodiment of the present disclosure;
[0042] Figure 2 A flowchart of an audio production method provided by an embodiment of the present disclosure;
[0043] Figure 3 A flowchart of a method for obtaining a single-note MIDI track provided in an embodiment of the present disclosure;
[0044] Figure 4 A flow chart of a test pass method of a soft sound source provided by an embodiment of the present disclosure;
[0045] Figure 5 A logical diagram of chord property judgment provided by an embodiment of the present disclosure;
[0046] Figure 6 A schematic diagram of mapping a multi-note MIDI track to a single-note MIDI track provided in an embodiment of the present disclosure;
[0047] Figure 7 A schematic diagram of a storage medium provided in an embodiment of the present disclosure;
[0048] Figure 8 A schematic diagram of the structure of an audio production device provided by an embodiment of the present disclosure;
[0049] Fig. 9 A schematic diagram of the structure of a computing device provided in one embodiment of the present disclosure.
[0050] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts. DETAILED DESCRIPTION
[0051] The principles and spirit of the present disclosure will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present disclosure, and are not intended to limit the scope of the present disclosure in any way. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.
[0052] Those skilled in the art will appreciate that the embodiments of the present disclosure may be implemented as a system, device, apparatus, method or computer program product. Therefore, the present disclosure may be specifically implemented in the following forms, namely: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.
[0053] According to an embodiment of the present disclosure, an audio production method, medium, apparatus and computing device are proposed.
[0054] In this article, it is important to understand that the terms used have the following meanings:
[0055] Term 1, Composition and Arrangement: Composition is a musician's creation of new musical works based on his own inspiration and understanding, through creative arrangement of tune, melody, harmony and rhythm; arrangement is a musical creation activity based on existing musical materials. Arrangement rearranges and designs various musical elements to generate new musical works and give the musical works a specific musical style and form.
[0056] Term 2, MIDI: MIDI is a digital protocol for transmitting music information between electronic music devices. MIDI signals contain data on music parameters such as notes, pitch, volume, timbre, as well as information such as control instructions and time codes. A "MIDI file" is a computer file in a specific format that contains music information such as notes, volume, timbre, etc. recorded in the form of MIDI signals. Due to its small file size and strong editability, MIDI files are widely used in electronic music production and communication. In the present disclosure, a MIDI file is a carrier for storing information about the work of a musician who arranges music.
[0057] Term 3, soft sound source: referred to as sound source, also known as virtual instrument, refers to the software entity that generates the sound of musical instruments through MIDI signal control, often in the form of plug-ins for digital music production. There are two types of soft sound sources:
[0058] ① Sampler sound source, which consists of a sampling library / audio processing algorithm and can simulate real musical instruments;
[0059] ②The synthesizer sound source is composed of a wavetable synthesis algorithm / audio processing algorithm and can generate a synthesized timbre.
[0060] Term 4, sampler sound source: includes three parts: sampling library / sound library, engine and preset. Only after these three parts are determined, the rendering effect of the soft sound source can be uniquely determined. Among them:
[0061] ① Sample library / tone library: usually contains samples of different pitches, different key strengths and different techniques;
[0062] ②Engine: implements all control logic of MIDI and sampling library as well as sampling rendering logic;
[0063] ③Preset: Defines the configuration and tells the engine how to control and render MIDI and sample libraries.
[0064] Term 5, soft sound source arrangement: refers to the process in a digital audio workstation (DAW) where the arranger inputs MIDI signals through a MIDI keyboard to drive the soft sound source plug-in to play / render the sound to produce the instrument part of a musical work.
[0065] Term 6, strumming: refers to a technique for playing chords on the guitar. Its component unit is: a loop under a certain chord and a certain rhythm pattern is played as a measure (the strumming rhythm pattern can be subdivided into techniques such as up-sweep, down-sweep, and mute sweep, but this disclosure does not consider such fine details); for common guitar sound sources, the arranger needs to select a certain rhythm pattern and then use a MIDI keyboard to input chords (press multiple notes at the same time) to trigger the strumming performance.
[0066] Term 7, single-note MIDI and multi-note MIDI: Single-note MIDI is when a MIDI input device presses one note to trigger a sound, and multi-note MIDI is when a MIDI input device presses multiple notes to trigger a sound. Multi-note MIDI is mostly used for advanced techniques such as guitar strumming.
[0067] Term 8, NetEase Tianyin: is an AI music production website, which includes an AI arrangement module, which is used to provide hundreds of arrangement style templates. In the technical background: each arrangement template consists of a set of arrangement MIDI and soft sound sources (including various instrument tracks). In the pop rock style, there will be more or less guitar strumming tracks.
[0068] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0069] In addition, any number of elements in the drawings is for illustration and not limitation, and any naming is only for distinction and does not have any limiting meaning.
[0070] The principle and spirit of the present disclosure are explained in detail below with reference to several representative embodiments of the present disclosure. SUMMARY OF THE INVENTION
[0072] The inventors have found that the chords played by strumming, such as the chords played by guitar strumming, are determined by the physical properties of the guitar, which makes the number of notes played by guitar strumming smaller than that played by piano, that is, there are often omissions of notes. Therefore, when playing guitar strumming, the method of identifying chords from MIDI tracks will be different from that of other musical instruments; on the other hand, the soft sound source design of guitar strumming is different from that of piano playing chords, and it cannot be achieved by simply superimposing multiple single-note samples in the chord. Among them, the piano playing chords is formed by superimposing multiple single-note samples from the sounding principle.
[0073] At present, the soft sound source of guitar strumming can be the following: First, it can be based on the superposition of multiple single-note samples to simulate the strumming performance, but this soft sound source also adds a lot of undisclosed audio processing technologies on the basis of superimposing multiple single-note samples, so that it can be close to the real performance effect when playing guitar strumming. In this soft sound source, the undisclosed audio processing technology is not available. Therefore, the authenticity of the performance effect of using multiple single-note samples to simulate the strumming performance is poor; second, each chord is analyzed into two parts: ① 1 basic strumming loop sample (consisting of root note + 5th note) ② 1 single-note sample that determines the chord attributes. However, this soft sound source is a commercial solution, which cannot be directly obtained, and the cost of self-development is relatively high.
[0074] Since the soft sound source set inside the AI arrangement module containing different instrument tracks is not suitable for guitar strumming performance, when the user performs MIDI performance of guitar strumming based on the AI arrangement module, the authenticity of the performance effect is poor.
[0075] Based on the above problems, the present disclosure provides an audio production method, medium, device and computing device, by designing a soft sound source suitable for strumming, and a mapping relationship between sampling files in the sampling library of the soft sound source and single-note MIDI tracks, and establishing an arrangement template, chords related to strumming generated based on the arrangement template, and a mapping control logic between the soft sound source and the single-note MIDI track, so as to realize the rendering of the chords related to strumming generated based on the arrangement template, obtain audio corresponding to the chords, and improve the authenticity of the performance effect when strumming.
[0076] After introducing the basic principles of the present disclosure, various non-limiting embodiments of the present disclosure are described in detail below.
[0077] Application Scenario Overview
[0078] First reference Figure 1 The application scenarios of the solutions provided in the present disclosure are illustrated by examples.
[0079] Figure 1 A schematic diagram of an application scenario provided by an embodiment of the present disclosure, such as Figure 1 As shown, the application scenario includes: a client. The client is, for example, a desktop computer, a notebook, a tablet computer, etc. Exemplarily, the user selects a strumming arrangement template in the AI arrangement module of the client interface, and generates chords related to the strumming based on the arrangement template, maps the chords to single-note MIDI keys through the client, obtains a single-note MIDI track, and based on the mapping relationship between the sampling files in the sampling library of the soft sound source corresponding to the strumming track and the single-note MIDI track, determines the sampling file corresponding to the single-note MIDI track, further based on the engine of the soft sound source, applies the single-note MIDI track to render the sampling file, obtains audio corresponding to the chord, and exports the audio based on the export control of the client interface.
[0080] In some optional embodiments, the scenario may also include a server.
[0081] Among them, the server is a business point that provides data processing, database and other functions. The server can be an integrated server or a distributed server across multiple computers or computer data centers. The server can include hardware, software, or embedded logic components or a combination of two or more such components for executing appropriate functions supported or implemented by the server. The server is, for example, a blade server, a cloud server, etc., or it can be a server group consisting of multiple servers.
[0082] The client and the server may communicate via a wired network or a wireless network. In the disclosed embodiment, the server may perform some functions of the client.
[0083] Exemplarily, the user selects a strumming arrangement template in the AI arrangement module of the client interface, and generates chords related to the strumming based on the arrangement template. The client sends the chord to the server, and after receiving the chord, the server maps the chord to a single-note MIDI key to obtain a single-note MIDI track. Based on the mapping relationship between the sampling file in the sampling library of the soft sound source corresponding to the strumming track and the single-note MIDI track, the sampling file corresponding to the single-note MIDI track is determined. Further, based on the engine of the soft sound source, the single-note MIDI track is used to render the sampling file to obtain audio corresponding to the chord, and the audio is sent to the client. The user exports the audio based on the export control of the client interface.
[0084] Exemplarily, the AI arrangement module of the client interface includes guitar strumming. Accordingly, the arrangement template may include a guitar strumming track.
[0085] It can be understood that a specific application scenario of the embodiment of the present disclosure may be audio production suitable for a guitar strumming track.
[0086] It can be seen that the embodiments of the present disclosure can perform audio production through the client, and can also perform audio production through the interaction between the client and the server.
[0087] It should be noted that Figure 1 This is only a schematic diagram of an application scenario provided by the embodiment of the present disclosure. Figure 1 does not limit the equipment included in Figure 1 The positional relationship between the devices is limited.
[0088] Exemplary Methods
[0089] Combine the following Figure 1 For application scenarios, refer to Figure 1 To describe the method for audio production according to an exemplary embodiment of the present disclosure. It should be noted that the above application scenarios are only shown to facilitate understanding of the spirit and principles of the present disclosure, and the embodiments of the present disclosure are not limited in this regard. On the contrary, the embodiments of the present disclosure can be applied to any applicable scenario.
[0090] The audio production method provided by the present disclosure is described in detail below in conjunction with specific embodiments.
[0091] Figure 2The flowchart of the audio production method provided by an embodiment of the present disclosure is shown in FIG. The method of the embodiment of the present disclosure can be applied to a computing device, such as a client. Figure 2 As shown, the specific implementation of the audio production method includes the following steps:
[0092] S201, obtaining a target chord, where the target chord is a chord related to strumming generated based on an arrangement template.
[0093] Exemplarily, the arrangement template may be an arrangement template that includes a strumming track in the AI arrangement module, and the instrument applicable to the arrangement template may be a guitar, that is, the strumming track may be a guitar strumming track.
[0094] In one possible implementation, the user can edit the chords based on the arrangement template contained in the AI arrangement module of the client interface to obtain the target chords.
[0095] Exemplarily, the target chord may be a triad, a seventh chord, or the like.
[0096] S202, mapping the target chord onto a single-note MIDI key position to obtain a target single-note MIDI track.
[0097] For example, a single note MIDI key can trigger a chord sound by pressing a MIDI key.
[0098] In a possible implementation, a relationship between chords and single-note MIDI key positions may be established, and based on the mapping relationship, a target chord may be mapped onto a single-note MIDI key position to obtain a target single-note MIDI track.
[0099] S203, based on the mapping relationship between the sampling files in the sampling library of the soft sound source corresponding to the strumming track and the single-note MIDI track, determine the target sampling file corresponding to the target single-note MIDI track, and the sampling files in the sampling library correspond one-to-one to the chords included in the arrangement template.
[0100] Exemplarily, in the audio production method provided by the embodiment of the present disclosure, the soft sound source corresponding to the strumming track can be a sound source in a single sampling file format controlled by a single note MIDI.
[0101] Exemplarily, the soft sound source includes a sampling library, an engine, and a preset. Among them, the sampling library can be a loop sampling library of guitar strumming, and the number of presets can be 1 or more. In the embodiment of the present disclosure, the number of presets in the soft sound source is not limited, and can be determined according to actual application requirements.
[0102] For example, the sample files in the guitar strumming Loop sample library can be audio files recorded by oneself.
[0103] Exemplarily, the format of the sampling file may be one or more of wav format, flac format and ogg format.
[0104] It can be understood that each sample file in the sample library is used to represent a chord.
[0105] Exemplarily, the arrangement template includes a predefined chord list, and the sample files in the sample library correspond one-to-one to the chords in the predefined chord list.
[0106] Exemplarily, in the audio production method provided by the embodiment of the present disclosure, the soft sound source corresponding to the strumming track may also include a mapping relationship between a sampling file in the sampling library of the soft sound source and a single-note MIDI track.
[0107] S204, based on the soft sound source engine, using the target single note MIDI track to render the target sampling file to obtain audio corresponding to the target chord.
[0108] Exemplarily, the engine of the soft sound source is used to render the target sample file using the target single-note MIDI track to obtain audio corresponding to the target chord.
[0109] In the disclosed embodiment, the target chord is obtained, the target chord is mapped on the single-note MIDI key position, and the target single-note MIDI track is obtained. Based on the mapping relationship between the sampling file in the sampling library of the soft sound source corresponding to the strumming track and the single-note MIDI track, the target sampling file corresponding to the target single-note MIDI track is determined, and based on the engine of the soft sound source, the target sampling file is rendered using the target single-note MIDI track to obtain the audio corresponding to the target chord, wherein the target chord is a chord related to the strumming generated based on the arrangement template. In the disclosed embodiment, the soft sound source corresponding to the strumming track is designed, and the mapping relationship between the sampling file in the soft sound source sampling library and the single-note MIDI track, and the target sampling file corresponding to the target single-note MIDI track is rendered based on the engine of the soft sound source, so as to improve the authenticity of the performance effect when the strumming performance is performed based on the arrangement module. At the same time, because the user using the arrangement module is completely unaware of any processing done by the client to the strumming track, the user experience is improved.
[0110] It is understandable that, compared with the related art, the usage scenarios of the arrangement templates are all for instrument users to perform MIDI performances, or for C-end users to play instruments for entertainment. In the audio production method provided by the present disclosure, the usage scenario of the arrangement template can be to use strumming as a kind of instrument sound source of the arrangement template, so that users can create audio based on the arrangement template.
[0111] Combine the following Figure 3The method for obtaining the single-note MIDI track provided in the embodiment of the present disclosure is described in detail.
[0112] Figure 3 A flowchart of a method for obtaining a single-note MIDI track provided in an embodiment of the present disclosure.
[0113] like Figure 3 As shown, the method for obtaining the single note MIDI track may include the following steps:
[0114] S301, obtaining a first chord list.
[0115] Exemplarily, a first chord list is obtained from the AI composition module.
[0116] Table 1 is a first chord list provided by an embodiment of the present disclosure.
[0117] As shown in Table 1, the chords in the first chord list may be based on the C note as the root note, which are suitable for the chord components of guitar strumming, such as triads and seventh chords.
[0118] As shown in Table 1, in the triad / suspended chord, the chord named Cmaj is composed of the root note C and the notes 1, 3 and 5; the chord named Cmin is composed of the root note C and the notes 1, b3 and 5.
[0119] In Table 1, note 3 indicates that there is a 3rd note, which is a major third; note b3 indicates that there is a 3rd note, which is a minor third; note 2 indicates that there is no 3rd note, only a major second; note 4 indicates that there is no 3rd note, only a perfect fourth; note (5) indicates that there is no 5th note; note 5 indicates that there is a 5th note, which is a perfect fifth; note #5 indicates that there is a 5th note, which is an augmented fifth; note b5 indicates that there is a 5th note, which is a diminished fifth; note 7 indicates that there is a 7th note, which is a major seventh; note b7 indicates that there is a 7th note, which is a minor seventh; note 6 indicates that there is no 7th note, only a major sixth; note 9or 2 indicates that there are 9th note or 2th note, which is a major ninth.
[0120] It should be noted that in Table 1, the numbers 1, 3 and 5 in Note 1, Note 3 and Note 5 are used to indicate the interval distance between the note and the root note, and the note (5) is used to indicate that the 5th note can be omitted on the guitar of the chord.
[0121] Table 1
[0122]
[0123] It should be noted that the chord list shown in Table 1 can be a chord list defined for users based on the business's composing habits, and provides users with any notes as transposed root notes, but the transposed chords are not considered internally in the technical background of the client. The "transposed chords" can be approximated to a certain "original chord" in the chord list, such as Am / C is equivalent to the C6 chord.
[0124] S302: for each predefined chord in the first chord list, determine the chord type corresponding to other notes in the predefined chord except the root note; and combine the chord type with different predefined root notes respectively to obtain the chords included in the arrangement template.
[0125] Exemplarily, taking the predefined chord as the Cmaj chord shown in Table 1 above as an example, in this chord, the root note is C, and the other notes except the root note are 1 note, 3 notes and 5 notes, and the chord types corresponding to the other notes can be expressed as maj.
[0126] Exemplarily, taking the Cmaj chord shown in Table 1 as an example of a predefined chord, in which the root note is C, and the chord types maj corresponding to the other notes except the root note are respectively combined with the root note A, the root note B, the root note D, the root note E, the root note F and the root note G to obtain the chords Amaj, Bmaj, Dmaj, Emaj, Fmaj and Gmaj.
[0127] In one possible implementation, for each predefined chord shown in Table 1 above, the chord types maj corresponding to the other notes in the chord except the root note are respectively combined with the root note A, root note B, root note D, root note E, root note F and root note G to obtain different chords, and the set of all the obtained chords is used as the chords included in the arrangement template.
[0128] S303, for each chord included in the arrangement template, map the chord to a MIDI key position to obtain a single-note MIDI track.
[0129] For example, a single-note MIDI track may also be described as a single-note MIDI file.
[0130] In this step, by mapping a chord to a MIDI key, it can be achieved that on the MIDI device, each time a MIDI key is pressed, the sound of a chord can be triggered.
[0131] It should be noted that the chords shown in Table 1 above include triads / suspended chords, and seventh chords and their derivative chords. Among them, triads / suspended chords are described as Class A chords, of which there are 6 types, and seventh chords and their derivative chords are described as Class B chords, of which there are 8 types. Since there are 12 keys corresponding to 12 root chords in an octave, it can be calculated that there are 72 chords in Class A chords and 96 chords in Class B chords. However, the total number of notes in a MIDI keyboard is 108, that is, a MIDI keyboard contains 108 MIDI keys, so 72+96 chords cannot be mapped in a MIDI keyboard. Based on this, in the audio production method provided by the present disclosure, Class A chords and Class B chords can be respectively assigned to the 108 MIDI keys of two soft sound source presets (presets), and the two presets can be switched using MIDI control signals (Program).
[0132] In an embodiment of the present disclosure, a first chord list is obtained, and for each predefined chord in the first chord list, the chord type corresponding to the other notes in the predefined chord except the root note is determined, and the chord type is respectively combined with different predefined root notes to obtain the chords included in the arrangement template, and further for each chord included in the arrangement template, the chord is mapped to a MIDI key position to obtain a single-note MIDI track of the sampling file in the soft sound source corresponding to the strumming track.
[0133] The related art lacks a soft sound source suitable for a strumming track, such as a guitar strumming track. The audio production method provided in the embodiment of the present disclosure designs a soft sound source suitable for a strumming track. The soft sound source is tested based on an existing multi-note MIDI track to obtain a rendering link suitable for a strumming track, so that the strumming track can be correctly rendered by the soft sound source, thereby improving the authenticity of the performance effect when performing a strumming performance.
[0134] Combine the following Figure 4 The test method of the soft sound source provided by the embodiment of the present disclosure is described in detail.
[0135] Figure 4 Flow chart of the test method of the soft sound source provided by the embodiment of the present disclosure. Figure 4 As shown, the test method of the soft sound source may include the following steps:
[0136] S401, obtaining a multi-note MIDI track corresponding to the strumming track.
[0137] Exemplarily, the strumming track may be a guitar strumming track.
[0138] In one possible implementation, in an AI arrangement module with guitar strumming, a multi-note MIDI track of the strumming track is exported separately.
[0139] Exemplarily, the multi-note MIDI track may be produced by a professional composer.
[0140] S402: Obtain a second chord list corresponding to the multi-note MIDI track according to the multi-note MIDI track.
[0141] Exemplarily, the second chord list is similar to the chord list shown in Table 1 above, and will not be described in detail here.
[0142] It can be understood that the chords included in the second chord list may be one or more chords in the first chord list shown in Table 1 above.
[0143] Optionally, in a possible implementation, a multi-note MIDI track is parsed, and at least one note interval included in the multi-note MIDI track is extracted from the parsed multi-note MIDI track, where one note interval is used to represent a chord; for each note interval, based on a chord recognition algorithm, a chord name corresponding to the note interval is determined; and a set of chord names is determined as a second chord list.
[0144] Exemplarily, after parsing a multi-note MIDI track, the start time (note-on) and the end time (note-off) of the note can be queried from the parsed multi-note MIDI track, and the interval corresponding to each start time and end time is called a note interval.
[0145] Among them, a note interval is used to represent a chord, that is, a note interval can correspond to a chord name.
[0146] Based on the chord recognition algorithm, the chord name corresponding to the note interval is determined. In a possible implementation method, the root note is determined from the notes included in the note interval; all the notes above the root note are arranged in order from low to high pitch modulo an octave to obtain the chord properties corresponding to the note interval; based on the chord properties, the chord name corresponding to the note interval is determined.
[0147] Exemplarily, the implementation method of determining the root note from the notes included in the note interval may be: without considering the transition, the lowest note in the note interval is determined as the root note. The root note may be root note A, root note B, root note C, root note D, root note E, root note F and root note G.
[0148] Modulate all the notes above the root note by an octave. It can be understood that when the note is note 8, its pitch is equivalent to the pitch corresponding to note 1, when the note is note 9, its pitch is equivalent to the pitch corresponding to note 2, when the note is note 11, its pitch is equivalent to the pitch corresponding to note 4, and when the note is note 13, its pitch is equivalent to the pitch corresponding to note 6, that is, note 8 becomes note 1, note 9 becomes note 2, note 11 becomes note 4, note 13 becomes note 6, and so on.
[0149] In one possible implementation, the chord property corresponding to the note interval is determined by:
[0150] First, determine the position of note 3, or the 3rd tone. There will be four situations: ① there is a 3rd tone, which is a major third; ② there is a 3rd tone, which is a minor third; ③ there is no 3rd tone, only a major second; ④ there is no 3rd tone, only a perfect fourth; then determine the position of note 5, or the 5th tone. There will be four situations: ① there is a 5th tone, which is an augmented fifth; ② there is a 5th tone, which is a perfect fifth; ③ there is a 5th tone, which is a diminished fifth; ④ there is no 5th tone; then determine the position of note 7, or the 7th tone. There will be four situations: ① there is a 7th tone, which is a major seventh; ② there is a 7th tone, which is a minor seventh; ③ there is no 7th tone, only a major sixth; ④ there is no 7th tone; then determine the position of note 9, or the 9th tone (2nd tone). There will be two situations: ① there is a 9th tone or a 2nd tone, which is a major ninth; ② there is no 9th tone or a 2nd tone; finally, determine the special chord interval. There will be two situations: ① there is a diminished fifth; ② there is an augmented fifth.
[0151] Among them, when judging the position of the 3rd note, as shown in the above Table 1, the note 3 indicates that there is a 3rd note, which is a major third; the note b3 indicates that there is a 3rd note, which is a minor third; the note 2 indicates that there is no 3rd note, only a major second; the note 4 indicates that there is no 3rd note, only a major fourth.
[0152] When judging the position of the 5th note, as shown in Table 1 above, the note 5 indicates that there is a 5th note, which is a perfect fifth; the note #5 indicates that there is a 5th note, which is an augmented fifth; the note b5 indicates that there is a 3rd note, which is a diminished fifth; and the note (5) indicates that there is no 5th note.
[0153] When judging the position of the 7th note, as shown in Table 1 above, the note 7 indicates that there is a 7th note, which is a major seventh; the note b7 indicates that there is a 7th note, which is a minor seventh; and the note 6 indicates that there is no 7th note, only a major sixth.
[0154] When determining the position of the 9th note, as shown in Table 1 above, the note 9or 2 indicates that there is a 9th note or a 2nd note, which is a major ninth.
[0155] Figure 5 This is a logical diagram of chord property judgment provided by the embodiment of the present disclosure. Figure 5As shown, for a note interval, all the notes above the root note are arranged modulo octave, and note 3, note 5, note 7 and note 9 are judged in order from top to bottom. The chord properties are judged according to the judgment logic to obtain the chord name corresponding to the chord property.
[0156] like Figure 5 As shown, when judging the note 3, i.e., the 3rd tone, if the 3rd tone corresponds to a major second, and the root note is the root note C, the chord name corresponding to the chord property can be determined as Csus2; if the 3rd tone corresponds to a major third, by further judging the note 5, i.e., the 5th tone, and if the 5th tone corresponds to an augmented fifth, and the root note is the root note C, the chord name corresponding to the chord property can be determined as Caug, etc., according to Figure 5 The judgment logic of the chord properties shown can determine the chord names corresponding to the chord properties in turn.
[0157] S403: Obtain a single-note MIDI track corresponding to the multi-note MIDI track according to the second chord list.
[0158] In one possible implementation, for each chord in the second chord list, according to the chord name of the chord, the chord types corresponding to the other notes in the chord except the root note are respectively combined with different predefined root notes to obtain different chords, and each chord is mapped to a MIDI key position, and the MIDI key position mapped with the chord is stored as a single-note MIDI track.
[0159] Figure 6 A schematic diagram of mapping a multi-note MIDI track to a single-note MIDI track provided in an embodiment of the present disclosure.
[0160] like Figure 6 As shown, the chord types corresponding to the other notes except the root note can be one or more of maj, min, sus2, sus4, aug, dim, maj7, 7, min7, m7b5, add9, madd9, 6 and 7sus4. Among them, the chord types of maj, min, sus2, sus4, aug and dim can be defined as type A chords, and the chord types of maj7, 7, min7, m7b5, add9, madd9, 6 and 7sus4 can be defined as type B chords, and the type A chords and the type B chords are respectively assigned to the 108 MIDI key positions preset by two different soft sound sources.
[0161] like Figure 6As shown, when the chord type is maj, the chord type is respectively combined with different predefined root notes, and each combined chord name is mapped to a MIDI key corresponding to a type A chord, so as to obtain a single-note MIDI track corresponding to the combined chord name; when the chord type is maj7, the chord type is respectively combined with different predefined root notes, and each combined chord name is mapped to a MIDI key corresponding to a type B chord, so as to obtain a single-note MIDI track corresponding to the combined chord name.
[0162] S404, determining a sampling file corresponding to the single-note MIDI track based on a mapping relationship between a sampling file in a sampling library of a soft sound source corresponding to the strumming track and the single-note MIDI track.
[0163] The specific implementation method is similar to the above and will not be repeated here.
[0164] S405, a soft sound source based engine, uses a single note MIDI track to render the sample file.
[0165] Exemplarily, the engine of the soft sound source is used to render the sample file using a single-note MIDI track.
[0166] In this step, if the engine based on the soft sound source applies a single-note MIDI track to render the sample file, and the response rendering is successful, the test of the soft sound source passes; if the response rendering fails, the test of the soft sound source fails, and the soft sound source needs to be tested again based on the above test method.
[0167] In an embodiment of the present disclosure, a multi-note MIDI track corresponding to a strumming track is obtained, and a second chord list corresponding to the multi-note MIDI track is obtained according to the multi-note MIDI track. A single-note MIDI track corresponding to the multi-note MIDI track is obtained according to the second chord list. Based on a mapping relationship between sampling files in a sampling library of a soft sound source corresponding to the strumming track and the single-note MIDI track, the sampling file corresponding to the single-note MIDI track is determined, and the sampling file is rendered using the single-note MIDI track based on an engine of the soft sound source. In the embodiments of the present disclosure, on the one hand, based on the multi-note MIDI track corresponding to the strumming track in the arrangement template, the multi-note MIDI track is first mapped to chords, and then the chords are mapped to single-note MIDI tracks, so as to realize the recognition of chords from the strumming multi-note MIDI track, and the computational complexity of the recognition process is relatively small, and further the mapping from the multi-note MIDI track to the single-note MIDI track is also realized; on the other hand, the soft sound source provided by the embodiments of the present disclosure is a sound source of a single sampling file controlled by a single-note MIDI track, and the multi-note MIDI track is mapped to a single-note MIDI track, and the sampling file in the soft sound source is controlled based on the single-note MIDI track, so as to realize the rendering logic of the soft sound source, and then obtain the rendering link corresponding to the strumming track in the arrangement template, and the audio corresponding to the chords related to the strumming is rendered based on the rendering link, so as to improve the authenticity of the strumming performance effect.
[0168] It is understandable that compared with the technology of identifying chords from multi-note MIDI tracks in the related art, since the multi-note MIDI track is not a MIDI track dedicated to a soft sound source suitable for guitar strumming, the characteristics of guitar chords are not taken into account, resulting in a more complicated technology for identifying chords. The technology for identifying chords from a multi-note MIDI track provided by the embodiment of the present disclosure is more concise and reliable.
[0169] Optionally, in the audio production method provided by the embodiment of the present disclosure, when the audio corresponding to the target chord can be obtained based on the arrangement template, the target multi-note MIDI track corresponding to the single-note MIDI track corresponding to the target chord can also be obtained. In a possible implementation, the audio production method also includes generating a target multi-note MIDI track corresponding to the target single-note MIDI track; and outputting the target multi-note MIDI track.
[0170] Exemplarily, based on the client interface, the target multi-note MIDI track is output to the user.
[0171] Exemplarily, the target multi-note MIDI track conforms to the MIDI track corresponding to the business-defined chord table.
[0172] Exemplarily, the target multi-note MIDI track may be a multi-note MIDI track of a guitar strumming track.
[0173] Exemplarily, the chord table that complies with the service definition may be the chord list shown in Table 1 above.
[0174] It can be understood that when the target multi-note MIDI track is a multi-note MIDI track of a guitar strumming track, it has high versatility and can be used by users for secondary creation.
[0175] Optionally, a possible implementation method for generating a target multi-note MIDI track corresponding to a target single-note MIDI track may be: determining a chord name corresponding to the target single-note MIDI track according to a target sampling file; determining all notes of the chord corresponding to the chord name based on a chord recognition algorithm; and generating a target multi-note MIDI track according to all the notes.
[0176] Exemplarily, the chord name corresponding to the target sample file is the chord name corresponding to the target single-note MIDI track.
[0177] Based on the chord recognition algorithm, all notes of the chord corresponding to the chord name are determined. The specific implementation method is similar to the above and will not be repeated here.
[0178] Optionally, the soft sound source related to strumming provided by the embodiment of the present disclosure also includes a sound source type. When the soft sound source includes the sound source type, step S204 is based on the engine of the soft sound source, and a possible implementation method for rendering the target sampling file using the target single note MIDI track to obtain the audio corresponding to the target chord can be: determining the soft sound source type corresponding to the target sampling file, the soft sound source type includes a first sound source type and a second sound source type; if the soft sound source type is the first sound source type, sending a first MIDI control signal to the engine of the soft sound source, the first MIDI control signal carries the target single note MIDI track and the target sampling file, and the engine is used to render the target sampling file using the target single note MIDI track to obtain the audio corresponding to the target chord; if the soft sound source type is the second sound source type, sending a second MIDI control signal to the engine of the soft sound source, the second MIDI control signal carries the target single note MIDI track and the target sampling file, and the engine is used to render the target sampling file using the target single note MIDI track to obtain the audio corresponding to the target chord.
[0179] Exemplarily, when the soft sound source type is the first sound source type, the target chord is determined to be a Class A chord, the first MIDI control signal is set to 0, and the first MIDI control signal is sent to the engine of the soft sound source, so that the engine applies the target single-note MIDI track to render the target sampling file to obtain audio corresponding to the target chord.
[0180] Exemplarily, when the soft sound source type is the second sound source type, the target chord is determined to be a Class B chord, the second MIDI control signal is set to 1, and the second MIDI control signal is sent to the engine of the soft sound source, so that the engine applies the target single-note MIDI track to render the target sampling file to obtain audio corresponding to the target chord.
[0181] Based on the above embodiments, it can be understood that in the audio production method provided by the present invention, on the one hand, by making full use of the business-defined chord list, the multi-note MIDI track is mapped to chords, and then the chords are mapped to single-note MIDI tracks, so as to realize a multi-note MIDI chord recognition method with low computational complexity; on the other hand, by designing a soft sound source of a single-note MIDI control of a single sampling file suitable for a strumming track, and a mapping relationship between the sampling file and the single-note MIDI track in the sampling library of the soft sound source, and testing the designed soft sound source based on the single-note MIDI track obtained by mapping the multi-note MIDI track, a set of soft sound source designs and rendering logics are defined based on low-cost mapping rules; on the other hand, the soft sound source design and rendering logic defined above are applied to the arrangement template of the AI arrangement module, so as to improve the authenticity of the performance effect when strumming the strings. At the same time, because there is no difference in user operation between guitar strumming and other musical instruments, when using AI arrangement, the user cannot perceive any processing of the strumming track by the technical background at all, which can improve the user experience.
[0182] Exemplary Media
[0183] After introducing the method of the exemplary embodiment of the present disclosure, next, refer to Figure 7 A storage medium according to an exemplary embodiment of the present disclosure is described.
[0184] Figure 7 A schematic diagram of a storage medium provided by an embodiment of the present disclosure. Figure 7 As shown, the storage medium 70 stores a program product for implementing the above method according to an embodiment of the present disclosure, which can be a portable compact disk read-only memory (CD-ROM) and includes program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto.
[0185] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0186] The readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, wherein the readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable signal medium may also be any readable medium other than a readable storage medium.
[0187] Program code for performing the disclosed operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN).
[0188] Exemplary Devices
[0189] After introducing the medium of the exemplary embodiment of the present disclosure, next, reference is made to Figure 8 An audio production device according to an exemplary embodiment of the present disclosure is described, which is used to implement a method in any of the above method embodiments. Its implementation principle and technical effects are similar and will not be repeated here.
[0190] Figure 8 This is a schematic diagram of the structure of an audio production device provided by an embodiment of the present disclosure. Figure 8 As shown, the audio production device 80 of the embodiment of the present disclosure includes: an acquisition module 810, a mapping module 820, a determination module 830 and a rendering module 840. Among them:
[0191] An acquisition module 810 is used to acquire a target chord, where the target chord is a chord related to strumming generated based on an arrangement template;
[0192] A mapping module 820 is used to map the target chord onto a single-note MIDI key position to obtain a target single-note MIDI track;
[0193] A determination module 830 is used to determine a target sampling file corresponding to a target single-note MIDI track based on a mapping relationship between sampling files in a sampling library of a soft sound source corresponding to the strumming track and single-note MIDI tracks, wherein the sampling files in the sampling library correspond one-to-one to the chords included in the arrangement template;
[0194] The rendering module 840 is used to render the target sampling file based on the soft sound source engine using the target single note MIDI track to obtain the audio corresponding to the target chord.
[0195] In one possible implementation, a single note MIDI track is obtained by:
[0196] Obtain a first chord list; for each predefined chord in the first chord list, determine the chord type corresponding to other notes in the predefined chord except the root note; combine the chord type with different predefined root notes respectively to obtain the chords included in the arrangement template; for each chord included in the arrangement template, map the chord to a MIDI key position to obtain a single-note MIDI track.
[0197] In a possible implementation, the soft sound source is tested in the following manner:
[0198] Get the multi-note MIDI track corresponding to the strumming track; get the second chord list corresponding to the multi-note MIDI track according to the multi-note MIDI track; get the single-note MIDI track corresponding to the multi-note MIDI track according to the second chord list; determine the sampling file corresponding to the single-note MIDI track based on the mapping relationship between the sampling file in the sampling library of the soft sound source corresponding to the strumming track and the single-note MIDI track; based on the engine of the soft sound source, use the single-note MIDI track to render the sampling file.
[0199] In a possible implementation, the audio production device 80 also includes a processing module 850, which is used to: parse a multi-note MIDI track, and extract at least one note interval included in the multi-note MIDI track from the parsed multi-note MIDI track, where a note interval is used to represent a chord; for each note interval, based on a chord recognition algorithm, determine the chord name corresponding to the note interval; and determine a set of chord names as a second chord list.
[0200] In a possible implementation, the processing module 850 is further used to: determine the root note from the notes included in the note interval; arrange all the notes above the root note in order of pitch from low to high modulo an octave to obtain the chord properties corresponding to the note interval; and determine the chord name corresponding to the note interval based on the chord properties.
[0201] In a possible implementation, the audio production device 80 further includes a generation module 860, and the generation module 860 is used to: generate a target multi-note MIDI track corresponding to the target single-note MIDI track; and output the target multi-note MIDI track.
[0202] In a possible implementation, the generation module 860 is further used to: determine the chord name corresponding to the target single-note MIDI track according to the target sampling file; determine all notes of the chord corresponding to the chord name based on the chord recognition algorithm; and generate the target multi-note MIDI track according to all the notes.
[0203] In a possible implementation, the soft sound source also includes a soft sound source type, and the rendering module 840 is specifically used to: determine the soft sound source type corresponding to the target sampling file, the soft sound source type includes a first sound source type and a second sound source type; if the soft sound source type is the first sound source type, a first MIDI control signal is sent to the engine of the soft sound source, the first MIDI control signal carries a target single-note MIDI track and a target sampling file, and the engine is used to apply the target single-note MIDI track to render the target sampling file to obtain audio corresponding to the target chord; if the soft sound source type is the second sound source type, a second MIDI control signal is sent to the engine of the soft sound source, the second MIDI control signal carries a target single-note MIDI track and a target sampling file, and the engine is used to apply the target single-note MIDI track to render the target sampling file to obtain audio corresponding to the target chord.
[0204] The device of the embodiment of the present disclosure can be used to execute the scheme of the audio production method in any of the above method embodiments. Its implementation principle and technical effect are similar and will not be repeated here.
[0205] Exemplary Computing Devices
[0206] After introducing the method, medium and apparatus of the exemplary embodiments of the present disclosure, next, reference is made to Fig. 9 A computing device according to an exemplary embodiment of the present disclosure is described.
[0207] Fig. 9 The computing device 90 shown is only an example and should not bring any limitation to the functionality and scope of use of the embodiments of the present disclosure.
[0208] Fig. 9A schematic diagram of the structure of a computing device provided in one embodiment of the present disclosure. Fig. 9 As shown, the computing device 90 is in the form of a general computing device. The components of the computing device 90 may include, but are not limited to: at least one processing unit 901, at least one storage unit 902, and a bus 903 connecting different system components (including the processing unit 901 and the storage unit 902). Exemplarily, the processing unit 901 may be specifically a processor, the storage unit 902 stores computer-executable instructions, and the processing unit 901 executes the computer-executable instructions stored in the storage unit 902 to implement the above-mentioned audio production method.
[0209] The bus 903 includes a data bus, a control bus, and an address bus.
[0210] The storage unit 902 may include a readable medium in the form of a volatile memory, such as a random access memory (RAM) 9021 and / or a cache memory 9022 , and may further include a readable medium in the form of a non-volatile memory, such as a read-only memory (ROM) 9023 .
[0211] The storage unit 902 may also include a program / utility 9025 having a set (at least one) of program modules 9024, such program modules 9024 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.
[0212] The computing device 90 may also communicate with one or more external devices 904 (e.g., keyboards, pointing devices, etc.). Such communication may be performed via an input / output (I / O) interface 905. Furthermore, the computing device 90 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 906. Fig. 9 As shown, the network adapter 906 communicates with other modules of the computing device 90 via the bus 903. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the computing device 90, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0213] It should be noted that, although several units / modules or sub-units / modules of the audio production device are mentioned in the above detailed description, such division is merely exemplary and not mandatory. In fact, according to an embodiment of the present disclosure, the features and functions of two or more units / modules described above may be embodied in one unit / module. Conversely, the features and functions of one unit / module described above may be further divided to be embodied by multiple units / modules.
[0214] In addition, although the operations of the disclosed method are described in a specific order in the drawings, this does not require or imply that the operations must be performed in this specific order, or that all the operations shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.
[0215] Although the spirit and principle of the present disclosure have been described with reference to several specific embodiments, it should be understood that the present disclosure is not limited to the disclosed specific embodiments, and the division of various aspects does not mean that the features in these aspects cannot be combined to benefit, and such division is only for the convenience of expression. The present disclosure is intended to cover various modifications and equivalent arrangements included in the spirit and scope of the attached claims.
Claims
1. An audio production method, characterized in that: include: Obtaining a target chord, where the target chord is a chord related to strumming generated based on an arrangement template; Mapping the target chord onto a single-note musical instrument digital interface MIDI key position to obtain a target single-note MIDI track; Determine a target sampling file corresponding to the target single-note MIDI track based on a mapping relationship between sampling files in a sampling library of a soft sound source corresponding to a strumming track and a single-note MIDI track, wherein the sampling files in the sampling library correspond one-to-one to the chords included in the arrangement template; Based on the engine of the soft sound source, the target sampling file is rendered using the target single-note MIDI track to obtain audio corresponding to the target chord.
2. The method according to claim 1, characterized in that: The single note MIDI track is obtained in the following way: Get the first chord list; For each predefined chord in the first chord list, determining the chord type corresponding to other notes in the predefined chord except the root note; combining the chord type with different predefined root notes respectively to obtain the chord included in the arrangement template; For each chord included in the arrangement template, the chord is mapped to a MIDI key position to obtain the single-note MIDI track.
3. The manufacturing method according to claim 1, characterized in that: The soft sound source is tested in the following ways: Get the multi-note MIDI track corresponding to the strum track; According to the multi-note MIDI track, obtaining a second chord list corresponding to the multi-note MIDI track; According to the second chord list, obtaining a single-note MIDI track corresponding to the multi-note MIDI track; Determine the sampling file corresponding to the single-note MIDI track based on the mapping relationship between the sampling file in the sampling library of the soft sound source corresponding to the strumming track and the single-note MIDI track; Based on the engine of the soft sound source, the single-note MIDI track is used to render the sample file.
4. The method according to claim 3, characterized in that: The step of obtaining, according to the multi-note MIDI track, a second chord list corresponding to the multi-note MIDI track comprises: Parsing the multi-note MIDI track, and extracting at least one note interval included in the multi-note MIDI track from the parsed multi-note MIDI track, wherein the one note interval is used to represent a chord; For each note interval, based on a chord recognition algorithm, determining a chord name corresponding to the note interval; The set of chord names is determined as the second chord list.
5. The method according to claim 4, characterized in that: The step of determining the chord name corresponding to the note interval based on the chord recognition algorithm includes: determining a root note from the notes included in the note interval; Arrange all the notes above the root note in the order of pitch from low to high modulo octave to obtain the chord properties corresponding to the note interval; According to the chord property, the chord name corresponding to the note interval is determined.
6. The method according to any one of claims 1 to 5, characterized in that: Also includes: Generate a target multi-note MIDI track corresponding to the target single-note MIDI track; Outputs the target multi-note MIDI track.
7. An audio production device, characterized in that: include: An acquisition module, used for acquiring a target chord, wherein the target chord is a chord related to strumming generated based on an arrangement template; A mapping module, used for mapping the target chord onto a single-note musical instrument digital interface MIDI key position to obtain a target single-note MIDI track; A determination module, for determining a target sampling file corresponding to the target single-note MIDI track based on a mapping relationship between sampling files in a sampling library of a soft sound source corresponding to a strumming track and a single-note MIDI track, wherein the sampling files in the sampling library correspond one-to-one to the chords included in the arrangement template; A rendering module is used to render the target sampling file based on the engine of the soft sound source by applying the target single-note MIDI track to obtain audio corresponding to the target chord.
8. A computing device comprising: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the audio production method according to any one of claims 1 to 6.
9. A storage medium storing computer program instructions, wherein the computer program instructions, when executed, implement the audio production method according to any one of claims 1 to 6.
10. A computer program product, comprising a computer program, wherein when the computer program is executed, the audio production method according to any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
Midi music file generation method, storage medium and terminal
CN114267318A
Music generation method and device and storage medium
CN115881063A
Musical sound generating device
JP2000293169A
Music processing apparatus
JP2007293312A
Musical systems and methods
US20120160079A1
