A voice control method and apparatus for electronic musical instruments

Abstract

This application discloses a voice control method for an electronic musical instrument. The method includes: controlling a voice processing terminal to acquire user voice, and searching for an instruction corresponding to the user voice in an instruction set; establishing a whitelist and / or blacklist between each instruction and the current operating state of the instrument; when an instruction is received, acquiring the current state of the electronic instrument, and determining whether the electronic instrument needs to execute the instruction in the current state based on the correspondence between the instruction and the current state in the whitelist and / or blacklist; wherein the current state is one or more of the instrument's operating states; and executing the instruction when it needs to be executed. During operation, the electronic instrument indicates its current operating state. Instructions are executed based on the current state, enabling the electronic instrument to accurately execute instructions in a voice-based control environment.

Description

Technical Field

[0001] This application relates to the field of voice control technology, and in particular to a language recognition control method and apparatus for electronic musical instruments. Background Technology

[0002] Electronic musical instruments are devices that generate musical sounds, allowing users to create beautiful melodies. With the development of electronic technology, existing electronic musical instruments have become increasingly powerful, offering a wide range of functions to meet users' sound production needs. These include rich and powerful timbre control; some keyboards offer up to hundreds of timbre controls and timbre groups composed of multiple timbres. To enrich the user's performance, numerous fixed rhythms and rhythm groups are also provided. Furthermore, to enhance the functionality of electronic musical instruments and adapt to different performance occasions, musical styles, and emotional expressions, they often offer tonality, sound field effects, dynamic simulation, chords, multiple keyboards, and timbre resonance to assist performance. They also include functions unique to electronic instruments based on their structure, such as imitating piano pedals, string vibrato, and wind instrument flutter tonguing. Add to this auxiliary functions such as recording and metronomes, and the functionality of electronic musical instruments becomes exceptionally complex. If controlled using traditional electronic instruments with buttons, knobs, and levers, the adjustment process would be extremely cumbersome.

[0003] With the development of speech recognition and semantic recognition, as well as the miniaturization and power control of electronic devices, more and more fields are beginning to use voice control as a means of controlling electronic devices. Existing electronic musical instruments only use voice control for power on / off and additional functions such as scoring and teaching assistance, or for single-function control of electronic musical instruments such as music playback.

[0004] Chinese invention patent application, publication number CN111785270A, entitled "Control Method for Electronic Keyboard, Electronic Keyboard and Computer-Readable Storage Medium," discloses a scheme for controlling an electronic keyboard through audio signals via semantic recognition. The control method disclosed in the scheme specifically includes functions such as playing preset music and activating auxiliary teaching functions. However, this scheme cannot perform voice adjustment for specific functions that need to be operated during electronic keyboard playing, such as tonality, sound field effects, dynamic simulation, chords, multiple keyboards, and timbre resonance. This is because the electronic keyboard runs each command directly without discrimination, and when there are many types and numbers of commands, it is obviously easy to make operational errors.

[0005] As mentioned above, electronic musical instruments have multiple functions, and some functions have a logical sequence. For example, in handling keys and chords, commands are issued for specific keys and chords. Operations on these keys and chords can only be performed when the electronic instrument is playing or a chord is being played, and a specific key and chord have been specified. Simply executing control commands directly is clearly insufficient for the complex environment of electronic instrument control, making voice-based control of electronic instruments very limited. There is a lack of a voice-based control method that can liberate users from the complex functions of electronic musical instruments. Summary of the Invention

[0006] The purpose of this application is to provide a voice control method and device for electronic musical instruments to control an electric piano.

[0007] To address the aforementioned technical problems, this application provides a voice control method for electronic musical instruments, employing the following technical solution:

[0008] A voice control method for an electronic musical instrument, the method comprising:

[0009] The voice processing terminal acquires the user's voice and searches for the corresponding instruction in the instruction set based on the user's voice. The instruction set stores the correspondence between the instructions for the functions performed by the electronic musical instrument and the voice information extracted from the user's voice.

[0010] For each instruction, a whitelist and / or blacklist are established between the instruction and the current state of the instrument's operation; wherein the instruction needs to be executed in the current state recorded in the whitelist, and the instruction is not executed in the current state recorded in the blacklist;

[0011] When a command is received, the current state of the electronic instrument is obtained, and based on the correspondence between the command and the current state in the whitelist and / or blacklist, it is determined whether the electronic instrument needs to execute the command in the current state; wherein the current state is one or more of the instrument's operating states;

[0012] Execute the instruction when it is required.

[0013] Furthermore, after executing the instructions, the method further includes:

[0014] The current state of the electronic musical instrument is adjusted or maintained according to the target state corresponding to the instruction, wherein the target state is the state that the electronic musical instrument should be set after the corresponding instruction is executed.

[0015] Furthermore, the states in which the musical instruments operate can be mutually exclusive or mutually coexisting;

[0016] When the current state of the electronic instrument changes, based on the state added to the current state, the state that is mutually exclusive with the added state in the current state is turned off or deleted.

[0017] Furthermore, the instrument's operating states include a performance state group, a song playback state, and a rhythm playback state. The states included in the performance state group coexist with the rhythm playback state and the song playback state, respectively; the song playback state and the rhythm playback state are mutually exclusive.

[0018] The performance state group includes one or more of the following: timbre adjustment state, tonality adjustment state, keyboard split state, reverb state, dual-timbre state, EQ adjustment state, velocity adjustment state, and chord state.

[0019] The instrument's operating state includes an additional state group, which includes one or more of the following: metronome adjustment state, preset control state, and recording state.

[0020] The states in the additional state group coexist with the performance state group, the song playback state, and the rhythm playback state, respectively.

[0021] Furthermore, when the instrument is in a parent state, the parent state includes at least two mutually exclusive child states; when the current state of the electronic instrument includes child states, the current state also includes the parent state corresponding to the child state, and the child states and parent states that are mutually exclusive are mutually exclusive.

[0022] Furthermore, the rhythm playback states include mutually exclusive intro states, outro states, and interlude states;

[0023] The preset control states include mutually exclusive setting saving sub-states and device adjustment sub-states.

[0024] Furthermore, the method for determining whether the electronic musical instrument needs to execute the instruction in its current state specifically includes:

[0025] Based on the instruction to be judged, search for the current state corresponding to the execution of the instruction in the whitelist and / or blacklist;

[0026] Based on the whitelist, which includes the current status, execute the instruction;

[0027] Alternatively, the instruction may be executed if all states included in the blacklist are states other than the current state.

[0028] Alternatively, the instruction can be executed based on the fact that the whitelist includes the current state and the blacklist includes states other than the current state.

[0029] Furthermore, the step of adjusting or maintaining the current state of the electronic musical instrument according to the target state corresponding to the instruction specifically includes:

[0030] Based on the executed instruction, determine the target state corresponding to the instruction;

[0031] Identify the current state of the electronic musical instrument, and maintain the current state when the current state includes the target state;

[0032] When the current state does not include the target state, the target state is added to the current state.

[0033] Furthermore, the voice information is a digitized voice waveform, and the step of searching for the instruction corresponding to the user's voice in the instruction set specifically includes:

[0034] Based on the digitized voice waveform extracted from the user's voice, search for the instruction corresponding to the digitized voice waveform in the instruction set.

[0035] To address the aforementioned technical problems, this application also provides a voice control device for electronic musical instruments, employing the following technical solution:

[0036] A voice control device for an electronic musical instrument, comprising:

[0037] The instruction matching module is used to control the voice processing terminal to acquire the user's voice and search for the instruction corresponding to the user's voice in the instruction set. The instruction set stores the correspondence between the instructions for the functions performed by the electronic musical instrument and the voice information extracted from the user's voice.

[0038] A state specification module is used to establish a whitelist and / or blacklist between each instruction and the current state of the instrument's operation; wherein the instruction needs to be executed in the current state recorded in the whitelist, and the instruction will not be executed in the current state recorded in the blacklist.

[0039] The control module is configured to, upon receiving an instruction, acquire the current state of the electronic musical instrument and, based on the correspondence between the instructions and the current state in a whitelist and / or blacklist, determine whether the electronic musical instrument needs to execute the instruction in the current state; wherein the current state is one or more of the instrument's operating states;

[0040] An execution module is used to execute the instructions when they need to be executed.

[0041] Compared with the prior art, the embodiments of this application have the following main advantages:

[0042] The command is executed in response to the current state of the electronic instrument. A whitelist is established to specify the command to be executed in one or more current states, or a blacklist is established to specify the command to be executed when the electronic instrument is in one or more current states. After the command input by voice is determined, the current state corresponding to the command is obtained through the whitelist or blacklist. The current state of the electronic instrument is compared with the states recorded in the whitelist and blacklist to determine whether the obtained command can be executed. The command is executed only when it is necessary to execute the above command.

[0043] Unlike existing electronic musical instruments that use specific buttons, knobs, and levers to send signals with a one-to-one correspondence between these components and their functions (resulting in explicit commands when a user presses a button or combination), voice-controlled electronic instruments involve picking up sound, extracting voice information from the user's speech, and then extracting commands corresponding to that information. In this process, commands are issued via a voice chip, requiring the electronic instrument to clearly identify the function addressed by each command. Therefore, specific states related to the command's operation are set, and the instrument displays its current state during operation. The command's execution is determined based on the current state, ensuring that commands are executed under appropriate conditions and preventing erroneous commands. This allows the electronic instrument to accurately execute commands in a voice-based control environment. Attached Figure Description

[0044] To more clearly illustrate the solutions in this application, the accompanying drawings used in the description of the embodiments of this application will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0045] Figure 1 A flowchart of an embodiment of a voice control method for an electronic musical instrument according to this application;

[0046] Figure 2 This is a schematic diagram of the structure of one embodiment of the computer device according to this application. Detailed Implementation

[0047] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains; the terminology used herein in the specification of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "comprising" and "having," and any variations thereof, in the specification, claims, and foregoing drawings of this application, are intended to cover non-exclusive inclusion. The terms "first," "second," etc., in the specification, claims, or foregoing drawings of this application are used to distinguish different objects, not to describe a particular order.

[0048] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0049] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

[0050] refer to Figure 1 The diagram shows a flowchart of one embodiment of a voice control method for an electronic musical instrument according to this application.

[0051] A voice control method for an electronic musical instrument, the method comprising:

[0052] Step S100: Control the voice processing terminal to acquire the user's voice, and search for the corresponding instruction in the instruction set according to the user's voice. The instruction set stores the correspondence between the instructions for the functions performed by the electronic musical instrument and the voice information extracted from the user's voice.

[0053] Step S200: For each instruction, establish a whitelist and / or blacklist between the instruction and the current state of the instrument's operation; wherein the instruction needs to be executed in the current state recorded in the whitelist, and the instruction is not executed in the current state recorded in the blacklist.

[0054] Step S300: When a command is received, the current state of the electronic instrument is obtained, and the correspondence between the command and the current state in the whitelist and / or blacklist is used to determine whether the electronic instrument needs to execute the command in the current state; wherein the current state is one or more of the instrument's operating states.

[0055] The command is executed in response to the current state of the electronic instrument. A whitelist is established to specify the command to be executed in one or more current states, or a blacklist is established to specify the command to be executed when the electronic instrument is in one or more current states. After the command input by voice is determined, the current state corresponding to the command is obtained through the whitelist or blacklist. The current state of the electronic instrument is compared with the states recorded in the whitelist and blacklist to determine whether the obtained command can be executed. The command is executed only when it is necessary to execute the above command.

[0056] Unlike existing electronic musical instruments that use specific buttons, knobs, and levers to send signals with a one-to-one correspondence between these components and their functions (resulting in explicit commands when a user presses a button or combination), voice-controlled electronic instruments involve picking up sound, extracting voice information from the user's speech, and then extracting commands corresponding to that information. In this process, commands are issued via a voice chip, requiring the electronic instrument to clearly identify the function being addressed. Therefore, specific states related to the commands are set, and the instrument displays its current state during operation. Command execution is determined based on the current state; by checking the state, the instrument ensures that commands are executed under appropriate conditions, preventing the execution of incorrect commands.

[0057] Voice information is information extracted from the voice spoken by the user. In one embodiment, the voice information is obtained by performing voice and semantic recognition on the voice, extracting characters, extracting specific keywords from the characters, and searching for instructions corresponding to the voice information in the instruction set. Specifically, the instructions corresponding to the keywords are searched in the instruction set.

[0058] In another embodiment, the voice information is acquired by recognizing and extracting the user's digital voice waveform. The instruction set stores the correspondence between specific digital voice waveforms and instructions. The method of finding the instruction corresponding to the voice information in the instruction set is specifically to search for the instruction corresponding to the extracted digital voice waveform in the instruction set.

[0059] Step S400: Execute the instruction when it is required.

[0060] The current state of an electronic musical instrument can be calibrated according to actual needs. An electronic musical instrument can maintain one or more states simultaneously, depending on the functions it can perform and the function it is currently executing. When controlling an electronic musical instrument with voice commands, due to the diversity of commands, the electronic musical instrument cannot determine whether the command can be executed accurately based solely on the command itself. By setting states for the electronic musical instrument, commands correspond to states, and the corresponding commands are executed only when the electronic musical instrument is in a specific state. In this way, the electronic musical instrument can acquire and process a wide variety of commands without producing misoperations, thereby realizing voice control of the electronic musical instrument.

[0061] Furthermore, after executing the instructions, the method further includes:

[0062] The current state of the electronic musical instrument is adjusted or maintained according to the target state corresponding to the instruction, wherein the target state is the state that the electronic musical instrument should be set after the corresponding instruction is executed.

[0063] The execution of some instructions may affect the current state of an electronic musical instrument. The target state is the state the electronic instrument should be in after these instructions are executed. If the current state of the electronic instrument includes the target state, this state is maintained. If the current state does not include the target state, the current state needs to be adjusted to achieve the target state. In one embodiment, if the user requests "switch to piano tone," the electronic instrument executes instruction A: switch the tone to piano. Then, based on the target state corresponding to instruction A, which is tone adjustment state, the tone adjustment state is activated for the electronic instrument. If the user then requests "synthesize the lead group," the electronic instrument executes instruction B: adjust the current tone group to the synthesized lead group. The specific state of instruction B is set to tone adjustment state. Because the electronic instrument activated the tone adjustment state after executing instruction A, instruction B can be executed while the electronic instrument is in tone adjustment state. This scheme can adjust the state of the electronic instrument in real time according to the execution of instructions, helping the electronic instrument to accept instruction execution in an appropriate state.

[0064] Furthermore, the states in which the musical instruments operate can be mutually exclusive or mutually coexisting;

[0065] When the current state of the electronic instrument changes, based on the state added to the current state, the state that is mutually exclusive with the added state in the current state is turned off or deleted.

[0066] Specifically, in this embodiment, the electronic musical instrument includes multiple functions. To accommodate the use of different functions, the electronic musical instrument can simultaneously be in one or more states included in the instrument's operating state. Among the several states included in the electronic musical instrument, some states can coexist with each other. In one embodiment, when adjusting the timbre, the user may also have a need to adjust the tonality and reverb. These adjustable functions can simultaneously have control needs, and the states corresponding to these functions can coexist with each other. In another embodiment, the user only needs to adjust the rhythm during the performance, and will not play the rhythm while playing a preset song. Therefore, the rhythm adjustment state and the song playback state corresponding to the rhythm adjustment function will not exist simultaneously. Thus, the rhythm adjustment state and the song playback state are mutually exclusive, and the current state of the electronic musical instrument cannot include two mutually exclusive states.

[0067] Therefore, when the current state of the electronic instrument changes—specifically, when a new state is added to the current state—all mutually exclusive states that are added to the current state are disabled or deleted. This scheme limits the number of instructions the electronic instrument can execute at any given time by controlling the number of current states it maintains, preventing the instrument from executing incorrect instructions. This scheme results in high accuracy for the electronic instrument's instruction execution.

[0068] Furthermore, the instrument's operating states include a performance state group, a song playback state, and a rhythm playback state. The states included in the performance state group coexist with the rhythm playback state and the song playback state, respectively; the song playback state and the rhythm playback state are mutually exclusive.

[0069] The performance state group includes one or more of the following: timbre adjustment state, tonality adjustment state, keyboard split state, reverb state, dual-timbre state, EQ adjustment state, velocity adjustment state, and chord state.

[0070] The instrument's operating state includes an additional state group, which includes one or more of the following: metronome adjustment state, preset control state, and recording state.

[0071] The states in the additional state group coexist with the performance state group, the song playback state, and the rhythm playback state, respectively.

[0072] Specifically, in this embodiment, the performance state group includes:

[0073] In the tone adjustment state, when an electronic instrument receives the voice command "Adjust to... tone," and executes the command to adjust the electronic instrument to the corresponding tone, a tone adjustment state is added to the current state of the electronic instrument. While the current state includes tone adjustment, if the electronic instrument receives the voice command "Previous tone," it executes the command to switch the number according to the previous / next tone sequence; if the current state includes tone adjustment, if the electronic instrument receives the voice command "Turn to synthesizer main group," it executes the command to adjust the tone group to the synthesizer main group; if the current state includes tone adjustment, if the electronic instrument receives the voice command "Turn to synthesizer tone group," it executes the command to adjust the tone group to the synthesizer tone group; if the current state includes tone adjustment, if the electronic instrument receives the voice command "Synthesizer effects group," it executes the command to adjust the tone group to the synthesizer effects group.

[0074] In the key adjustment state, when an electronic instrument receives the voice command "adjust to... key" and executes the command to adjust the electronic instrument to the corresponding key, a key adjustment state is added to the current state of the electronic instrument. When the current state includes the key adjustment state, if the electronic instrument receives the voice command "add... semitones", the corresponding transposition command is executed;

[0075] Chord state: When an electronic instrument receives a voice command to "open a chord" and executes the command to open the chord, a chord state is added to the instrument's current state. If the current state includes a chord state, and the electronic instrument receives a voice command to "close a chord," the command to close the chord is executed.

[0076] In keyboard split state, when an electronic instrument receives the voice command "Split Keyboard" and executes the command to enable the keyboard split function, the keyboard split state is added to the current state of the electronic instrument. When the current state includes the keyboard split state, if the electronic instrument receives voice commands such as "Switch to XX tone group" or "Next tone group," it will execute the tone adjustment command for the corresponding keyboard area according to the user's request to adjust the XX tone.

[0077] Reverb state: When an electronic instrument receives a voice command to "turn on reverb" and executes the command to turn on the reverb function, a reverb state is added to the current state of the electronic instrument.

[0078] When the electronic instrument receives a voice command to "play a song," it executes the command to enable playback, adds the song playback state to the instrument's current state, and disables or removes the rhythm playback state from the current state. Subsequently, when the electronic instrument receives voice commands such as "switch to intro" or "switch to outro," even if the corresponding rhythm adjustment command is parsed, it will not execute these commands because the corresponding command's blacklist includes the song playback state. When the current state includes the song playback state, and the electronic instrument receives voice commands such as "previous song" or "next song," it executes the preset song order and song switching commands.

[0079] The teaching function state group includes single-key follow-along state, follow-along state, and karaoke state.

[0080] In the single-key follow-along mode, when the user presses any key on the keyboard, the electronic instrument will play the correct note according to the practice piece.

[0081] In follow-along mode, when the user presses the same note on the piano key as in the practice piece, the electronic instrument plays the correct note according to the practice piece.

[0082] In karaoke mode, the electronic instrument plays practice pieces. When the user does not press any key, the instrument plays the lead and accompaniment. When the user presses any key, the instrument only plays the accompaniment and not the lead.

[0083] Furthermore, when the instrument is in a parent state, the parent state includes at least two mutually exclusive child states; when the current state of the electronic instrument includes child states, the current state also includes the parent state corresponding to the child state, and the child states and parent states that are mutually exclusive are mutually exclusive.

[0084] Specifically, some functions are only used in specific usage environments, while different functions may be used in the same specific usage environment. These functions may be mutually exclusive, so it is necessary to set sub-states. Sub-states within the same parent state are mutually exclusive. Thus, when there are many instructions that need to be executed in the parent state, but these instructions cannot be executed simultaneously, sub-states can be set in the parent state. In one embodiment, when the current state of the electronic instrument includes the timbre adjustment state, the electronic instrument can provide several sets of timbre adjustment functions, including the synthesized lead group, synthesized timbre group, and synthesized effects group. However, at any given time, only one set of timbres can be switched up and down to adjust the timbre. Therefore, synthesized lead group sub-states, synthesized timbre group sub-states, and synthesized effects group sub-states are set, which correspond to the above-mentioned timbre adjustment functions and are mutually exclusive.

[0085] When the current state includes a synthesized main tone sub-state, it cannot include sub-states within the synthesized timbre group or synthesized effects group that are mutually exclusive with the synthesized main tone sub-state. If the electronic instrument receives the "previous timbre" command, it will switch timbres up and down within the synthesized main tone group, without selecting or switching timbres within the synthesized timbre group or synthesized effects group. The user can then trigger and execute the command to switch the timbre to synthesized timbre 3 via voice commands, adding the synthesized timbre group sub-state to the electronic instrument's current state while simultaneously closing or deleting the synthesized main tone group sub-state from the current state. Afterward, when the user controls the electronic instrument using the "previous timbre" command, the instrument will switch timbres up and down within the synthesized timbre group. This scheme optimizes the structure of the instrument's commands, controls the number of commands that can be executed within a state and its sub-states, and improves the accuracy of command execution.

[0086] Furthermore, the rhythm playback states include mutually exclusive intro states, outro states, and interlude states;

[0087] The preset control states include mutually exclusive setting saving sub-states and device adjustment sub-states.

[0088] In the intro state of rhythm playback, the electronic instrument only performs the settings for the intro and does not perform the corresponding operations for the interlude or outro. Only when the user sets the command such as "play interlude A" to turn off or delete the intro state in the current state of the electronic instrument and add the interlude state will the electronic instrument perform the settings for the interlude.

[0089] Furthermore, the method for determining whether the electronic musical instrument needs to execute the instruction in its current state specifically includes:

[0090] Based on the instruction to be judged, search for the current state corresponding to the execution of the instruction in the whitelist and / or blacklist;

[0091] Based on the whitelist, which includes the current status, execute the instruction;

[0092] Alternatively, the instruction may be executed if all states included in the blacklist are states other than the current state.

[0093] Alternatively, the instruction can be executed based on the fact that the whitelist includes the current state and the blacklist includes states other than the current state.

[0094] The command and specific state have a one-to-many correspondence. A command can be executed when the instrument's current state has a specific state, or when that specific state is turned off or deleted. When voice information is extracted from the user's speech and a command corresponding to that voice information is obtained, a search is performed in the whitelist or blacklist corresponding to that command to see if the current state exists in either list. Based on the search results, it is determined whether the command needs to be executed. This scheme determines whether the current state meets the requirements for command execution based on the specific state corresponding to the command, providing a more detailed division of command execution conditions and improving the accuracy of command execution. In practice, it can be executed based on the current state being recorded in a command's whitelist, or based on the current state not being recorded in the command's blacklist. Alternatively, it can be executed only if the current state of the electronic instrument is recorded in a command's whitelist and not in its blacklist.

[0095] Furthermore, the step of adjusting or maintaining the current state of the electronic musical instrument according to the target state corresponding to the instruction specifically includes:

[0096] Based on the executed instruction, determine the target state corresponding to the instruction;

[0097] Identify the current state of the electronic musical instrument, and maintain the current state when the current state includes the target state;

[0098] When the current state does not include the target state, the target state is added to the current state.

[0099] Furthermore, the voice information is a digitized voice waveform, and the step of searching for the instruction corresponding to the user's voice in the instruction set specifically includes:

[0100] Based on the digitized speech waveform extracted from the user's speech, the corresponding instruction is searched in the instruction set. This scheme improves the efficiency of instruction matching.

[0101] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This computer program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the methods described above. The aforementioned storage medium can be a non-volatile storage medium such as a magnetic disk, optical disk, or read-only memory (ROM), or random access memory (RAM).

[0102] It should be understood that although the steps in the flowcharts of the accompanying figures are shown sequentially as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the accompanying figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0103] Furthermore, as a response to the above Figure 1 The implementation of the method shown in this application provides an embodiment of a voice control device for electronic musical instruments, which is similar to... Figure 1 Corresponding to the method embodiments shown, this device can be specifically applied to various electronic devices.

[0104] A voice control device for an electronic musical instrument, comprising:

[0105] The instruction matching module is used to control the voice processing terminal to acquire the user's voice and search for the instruction corresponding to the user's voice in the instruction set. The instruction set stores the correspondence between the instructions for the functions performed by the electronic musical instrument and the voice information extracted from the user's voice.

[0106] A state specification module is used to establish a whitelist and / or blacklist between each instruction and the current state of the instrument's operation; wherein the instruction needs to be executed in the current state recorded in the whitelist, and the instruction will not be executed in the current state recorded in the blacklist.

[0107] The control module is configured to, upon receiving an instruction, acquire the current state of the electronic musical instrument and, based on the correspondence between the instructions and the current state in a whitelist and / or blacklist, determine whether the electronic musical instrument needs to execute the instruction in the current state; wherein the current state is one or more of the instrument's operating states;

[0108] An execution module is used to execute the instructions when they need to be executed.

[0109] To address the aforementioned technical problems, embodiments of this application also provide a computer device. Please refer to [link / reference needed]. Figure 2 , Figure 2 This is a basic structural block diagram of the computer device in this embodiment.

[0110] The computer device 6 includes a memory 61, a processor 62, and a network interface 63 that are interconnected via a system bus. It should be noted that only the computer device 6 with components 61-63 is shown in the figure; however, it should be understood that it is not required to implement all the shown components, and more or fewer components can be implemented alternatively. Those skilled in the art will understand that the computer device described here is a device capable of automatically performing numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes, but is not limited to, microprocessors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), embedded devices, etc.

[0111] The computer device can be a desktop computer, laptop, handheld computer, or cloud server, etc. The computer device can interact with the user via a keyboard, mouse, remote control, touchpad, or voice control.

[0112] The memory 61 includes at least one type of readable storage medium, including flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 61 may be an internal storage unit of the computer device 6, such as the hard disk or memory of the computer device 6. In other embodiments, the memory 61 may also be an external storage device of the computer device 6, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the computer device 6. Of course, the memory 61 may include both the internal storage unit and its external storage device of the computer device 6. In this embodiment, the memory 61 is typically used to store the operating system and various application software installed on the computer device 6, such as program code for a voice control method for an electronic musical instrument. In addition, the memory 61 can also be used to temporarily store various types of data that have been output or will be output.

[0113] In some embodiments, the processor 62 may be a central processing unit (CPU), controller, microcontroller, microprocessor, or other data processing chip. The processor 62 is typically used to control the overall operation of the computer device 6. In this embodiment, the processor 62 is used to run program code stored in the memory 61 or process data, for example, to run program code for a voice control method for an electronic musical instrument.

[0114] The network interface 63 may include a wireless network interface or a wired network interface, which is typically used to establish communication connections between the computer device 6 and other electronic devices.

[0115] This application also provides another embodiment, namely, a computer-readable storage medium storing a voice control program for an electronic musical instrument, which can be executed by at least one processor to perform the steps of the voice control method for an electronic musical instrument as described above.

[0116] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0117] Obviously, the embodiments described above are only some embodiments of this application, not all embodiments. The accompanying drawings show preferred embodiments of this application, but do not limit the patent scope of this application. This application can be implemented in many different forms; rather, the purpose of providing these embodiments is to provide a more thorough and comprehensive understanding of the disclosure of this application. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing specific embodiments, or make equivalent substitutions for some of the technical features. Any equivalent structures made using the content of this application's specification and drawings, directly or indirectly applied to other related technical fields, are similarly within the scope of patent protection of this application.

Claims

1. A voice control method for electronic musical instruments, characterized in that, The method includes: The voice processing terminal acquires the user's voice and searches for the corresponding instruction in the instruction set based on the user's voice. The instruction set stores the correspondence between the instructions for the functions performed by the electronic musical instrument and the voice information extracted from the user's voice. For each instruction, a whitelist and / or blacklist are established between the instruction and the current state of the instrument's operation; wherein the instruction needs to be executed in the current state recorded in the whitelist, and the instruction is not executed in the current state recorded in the blacklist; When a command is received, the current state of the electronic instrument is obtained, and based on the correspondence between the command and the current state in the whitelist and / or blacklist, it is determined whether the electronic instrument needs to execute the command in the current state. The current state of the electronic instrument is adjusted or maintained according to the target state corresponding to the instruction, wherein the target state is the state that the electronic instrument should be set after the corresponding instruction is executed; The states described are either mutually exclusive or mutually coexisting; When the current state of the electronic instrument changes, depending on the state added to the current state, the state that is mutually exclusive with the added state in the current state is turned off or deleted. The current state can be one or more of the instrument's operating states; Execute the instruction when it is required.

2. The voice control method for an electronic musical instrument according to claim 1, characterized in that: The instrument's operating states include a performance state group, a song playback state, and a rhythm playback state. The states included in the performance state group coexist with the rhythm playback state and the song playback state, while the song playback state and the rhythm playback state are mutually exclusive. The performance state group includes one or more of the following: timbre adjustment state, tonality adjustment state, keyboard split state, reverb state, dual-timbre state, EQ adjustment state, velocity adjustment state, and chord state. The instrument's operating state includes an additional state group, which includes one or more of the following: metronome adjustment state, preset control state, and recording state. The states in the additional state group coexist with the performance state group, the song playback state, and the rhythm playback state, respectively.

3. The voice control method for an electronic musical instrument according to claim 2, characterized in that: When the instrument is in the parent state, the parent state includes at least two mutually exclusive child states; when the current state of the electronic instrument includes child states, the current state also includes the parent state corresponding to the child state, and the child states and parent states that are mutually exclusive are mutually exclusive.

4. The voice control method for an electronic musical instrument according to claim 2, characterized in that: The rhythm playback states include mutually exclusive intro states, outro states, and interlude states; The preset control states include mutually exclusive setting saving sub-states and device adjustment sub-states.

5. The voice control method for an electronic musical instrument according to claim 1, characterized in that: The method for determining whether an electronic musical instrument needs to execute the instruction in its current state specifically includes: Based on the instruction to be judged, search for the current state corresponding to the execution of the instruction in the whitelist and / or blacklist; Based on the whitelist, which includes the current status, execute the instruction; Alternatively, the instruction may be executed if all states included in the blacklist are states other than the current state. Alternatively, the instruction can be executed based on the fact that the whitelist includes the current state and the blacklist includes states other than the current state.

6. The voice control method for an electronic musical instrument according to claim 1, characterized in that: The step of adjusting or maintaining the current state of the electronic musical instrument according to the target state corresponding to the instruction specifically includes: Based on the executed instruction, determine the target state corresponding to the instruction; Identify the current state of the electronic musical instrument, and maintain the current state when the current state includes the target state; When the current state does not include the target state, the target state is added to the current state.

7. The voice control method for an electronic musical instrument according to claim 1, characterized in that: The voice information is a digitized voice waveform. The step of searching for the instruction corresponding to the user's voice in the instruction set based on the user's voice specifically includes: Based on the digitized voice waveform extracted from the user's voice, search for the instruction corresponding to the digitized voice waveform in the instruction set.

8. A voice control device for an electronic musical instrument, characterized in that, include: The instruction matching module is used to control the voice processing terminal to acquire the user's voice and search for the instruction corresponding to the user's voice in the instruction set. The instruction set stores the correspondence between the instructions for the functions performed by the electronic musical instrument and the voice information extracted from the user's voice. The status specification module is used to establish a whitelist and / or blacklist between each instruction and the current state of the instrument's operation. The instructions mentioned above must be executed in the current state recorded in the whitelist, and will not be executed in the current state recorded in the blacklist; The control module is used to obtain the current state of the electronic musical instrument when a command is received, and determine whether the electronic musical instrument needs to execute the command in the current state according to the correspondence between the command and the current state in the whitelist and / or blacklist. The current state can be one or more of the instrument's operating states; It is also used to adjust or maintain the current state of the electronic musical instrument according to the target state corresponding to the instruction, wherein the target state is the state that the electronic musical instrument should be set after the corresponding instruction is executed; The states described are either mutually exclusive or mutually coexisting; When the current state of the electronic instrument changes, depending on the state added to the current state, the state that is mutually exclusive with the added state in the current state is turned off or deleted. An execution module is used to execute the instructions when they need to be executed.

Images