A command recognition method based on partial phonemes and a game cockpit

Abstract

The present invention discloses a method for command recognition based on partial phonemes, which includes a pre-set command list and a sound capture device, a sound processing engine, a sound recognition engine and a control module; the method for command recognition includes the following steps: 3.1) acquiring sound; 3.2) acquiring control sound; 3.3) sequentially composing the sound into the sequence of phonemes to be recognized; 3.4) comparing to obtain the corresponding command or comparison failure mark. The beneficial effects of the present invention: by converting speech into phonemes, command recognition can be performed directly through partial phonemes, thereby reducing the process of semantic recognition, which simplifies the complexity of the recognition engine and greatly improves the recognition speed; the present invention also provides a related game cockpit.

Description

Technical Field

[0001] The present invention relates to the field of intelligent vehicles, and in particular to a command recognition method based on partial phonemes and a game cockpit. Background Art

[0002] With the booming development of electric vehicles, it has become increasingly common to configure large display screens and high-performance host computers in small buses. However, the relevant peripheral software is still in its infancy. For example, there are very few games that are compatible with electric vehicle cockpits. Another important reason for this is that, due to the environment of the cockpit, input devices such as mice and handles are generally not configured, and the touch screen method also has high requirements for the user's position, and the gaming experience is not good. How to improve the convenience of human-computer interaction in the cockpit and improve the gaming experience is a technical problem that needs to be solved urgently. On the other hand, the method of realizing human-computer interaction and controlling smart devices through voice is already very mature, and there is also a trend of popularization in buses. For example, there are practical applications for waking up the in-vehicle navigation and even controlling smart devices such as smart air conditioners in the car through voice. At present, human-computer interaction through voice mostly uses voice recognition engines for semantic recognition, so as to accurately judge the operator's command intentions. The relevant voice recognition engine is also very mature, and the fastest one can even accurately recognize the operator's command within 0.7 seconds. However, for games, the response speed of 0.7 seconds is still insufficient, especially for action games. How to further speed up speech recognition and achieve rapid human-computer interaction is a technical problem that needs to be solved urgently. Summary of the invention

[0003] The object of the present invention is to provide a high-speed and efficient command recognition method based on partial phonemes and a game cockpit.

[0004] To achieve the above object, the present invention provides the following technical solutions:

[0005] A command recognition method based on partial phonemes, comprising a plurality of commands for human-computer interaction operations, and also comprising a pre-set command list, wherein the command list comprises all the commands and a command phoneme sequence corresponding to each command; and further comprising at least one sound capture device for collecting sound, a sound processing engine for processing the sound, a sound recognition engine for recognizing the processed sound, and a control module for comparing the recognized sound with the command list;

[0006] The command recognition method includes the following steps:

[0007] 3.1) Acquire the sound in the working environment through a sound capture device;

[0008] 3.2) The sound obtained in step 3.1) is obtained by the sound processing engine for processing, and background noise is removed therefrom to obtain the control sound therefrom;

[0009] 3.3) recognizing the control sound obtained in step 3.2) by the sound recognition engine, converting the control sound into phonemes, and sequentially composing the phoneme sequence to be recognized;

[0010] 3.4) comparing the to-be-recognized phoneme sequence with the instruction phoneme sequence in the command list through the control module to obtain the corresponding command or comparison failure flag; which includes the following steps:

[0011] 3.4.1) extracting a command from the command list and using the command phoneme sequence corresponding to the command as the command phoneme sequence to be compared;

[0012] 3.4.2) By comparing the phonemes in the to-be-recognized phoneme sequence with the phonemes in the to-be-compared instruction phoneme sequence one by one in order; if the comparison results are inconsistent, execute 3.4.3); if the comparison results are consistent, execute 3.4.4);

[0013] 3.4.3) taking out the next command in the command list, and taking its corresponding command phoneme sequence as the command phoneme sequence to be compared, and executing 3.4.2); if all the commands in the command list have been compared, outputting a recognition failure flag;

[0014] 3.4.4) The counter counts and compares the next phoneme until the number of consistent phonemes exceeds a preset threshold, then the command to be compared is output as the comparison result, and the counter is cleared; if any of the phoneme comparison results are inconsistent, the counter is cleared and 3.4.3) is executed.

[0015] Preferably, the method for presetting the command list comprises the following steps:

[0016] 1.1) Record the sound corresponding to the command;

[0017] 1.2) The sound recognition engine converts the sound corresponding to the command into a number of phonemes;

[0018] 1.3) Combining all or part of the above phonemes in order to obtain an instruction phoneme sequence;

[0019] 1.4) The commands and their corresponding instruction phoneme sequences are stored as the command list.

[0020] Preferably, it also includes the following steps:

[0021] 2.1) In a training environment, a control sound is simulated and acquired through a sound acquisition device, and then the sound processing engine is trained, wherein the training includes removing background noise from the sound acquired by the sound acquisition device and extracting the control sound therefrom; the control sound is composed of a number of words or characters or sounds;

[0022] 2.2) In a training environment, the sound recognition engine is trained, wherein the training content includes converting the control sound obtained by the sound processing engine into phonemes, and sequentially composing the phoneme sequence to be recognized; the phoneme sequence to be recognized is a phoneme sequence composed of a plurality of phonemes in sequence.

[0023] Preferably, the step 2.1) comprises the following steps:

[0024] 2.1.1) Denoising: simulating various types of background noise in a training environment and training the sound processing engine to remove the background noise.

[0025] Preferably, the step 3.2) comprises the following steps:

[0026] 3.2.1) Denoising, removing background noise in the working environment through the sound processing engine, and using the obtained sound as the control sound;

[0027] 3.2.2) If the control sound is a continuous sound, it is continuously transmitted to the sound recognition engine; otherwise, it is completely transmitted to the sound recognition engine;

[0028] 3.2.3) If the control sound is a continuous sound, the sound recognition engine will continuously send the input control sound to the control module, and the control module will execute steps 3.3) and 3.4) in sequence to perform command recognition; wherein, if the control module returns a recognition failure flag, it will be returned to the sound processing engine, and the sound processing engine will stop sending subsequent control sounds to the sound recognition engine until the control sound pauses and a new control sound appears.

[0029] Preferably, it further comprises a sound output device, and the background noise in the step 3.2.1) comprises the sound output by the sound output device.

[0030] Preferably, the threshold is 1-5.

[0031] The present invention also provides a gaming cockpit, which includes at least one seat, a sound output device, a display, at least one sound capture device, and a host for running a game. The host uses the partial phoneme-based command recognition method to convert the game player's voice into a command for controlling the game, and executes the game operation according to the command.

[0032] Preferably, the sounds made by the game player include sounds made by clapping, slapping body parts or knocking on bus parts, and sounds made by operating a sound-generating device.

[0033] The beneficial effects of the present invention are as follows: by converting speech into phonemes, command recognition can be performed directly through some phonemes, thereby reducing the process of semantic recognition, which not only simplifies the complexity of the recognition engine, but also greatly improves the recognition speed; the present invention also provides a related game cockpit. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 The schematic diagram is a principle diagram of an application example of the present invention.

[0035] Figure 2 The figure is a flow chart of an application example of the present invention. DETAILED DESCRIPTION

[0036] The technical solution of this patent is further described in detail below in conjunction with specific implementation methods.

[0037] In the description of the present invention, it should be noted that the terms "inside", "outside", "up", "down", "horizontal", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings. They are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, they cannot be understood as limitations on the present invention.

[0038] The command recognition method based on partial phonemes of the present invention includes a plurality of commands for human-computer interaction operations, and also includes a pre-set command list, which includes all commands and the instruction phoneme sequence corresponding to each command; and also includes at least one sound capture device for collecting sound, a sound processing engine for processing sound, a sound recognition engine for recognizing the processed sound, and a control module for comparing the recognized sound with the command list.

[0039] The command recognition method includes a pre-preparation step (which is similar to the work before leaving the factory) and an actual work step. The pre-preparation step includes:

[0040] To pre-set a command list:

[0041] 1.1) Record the sound corresponding to the command;

[0042] 1.2) The voice recognition engine converts the sound corresponding to the command into a number of phonemes;

[0043] 1.3) Combining all or part of the above phonemes in order to obtain an instruction phoneme sequence;

[0044] 1.4) The commands and their corresponding instruction phoneme sequences are stored as a command list.

[0045] It also includes steps to train the engine to improve recognition efficiency and accuracy:

[0046] 2.1) In a training environment, a control sound is simulated and acquired through a sound capture device, and then the sound processing engine is trained, wherein the training includes removing background noise from the sound acquired by the sound capture device and extracting the control sound therefrom; the control sound is composed of a number of words or characters or sounds; and the training includes the steps of:

[0047] 2.1.1) Denoising: simulate various types of background noise in the training environment and train the sound processing engine to remove background noise.

[0048] 2.2) In a training environment, the sound recognition engine is trained, wherein the training content includes converting the sound obtained by the sound processing engine into phonemes, and sequentially composing the phoneme sequences to be recognized; the phoneme sequence to be recognized is a phoneme sequence composed of several phonemes in sequence.

[0049] The actual working steps include:

[0050] 3.1) Acquire the sound in the working environment through a sound capture device;

[0051] 3.2) The sound obtained in step 3.1) is processed by a sound processing engine to remove background noise and obtain a control sound;

[0052] 3.3) Recognizing the control sound obtained in step 3.2) through a sound recognition engine, converting the control sound into phonemes, and sequentially composing the phoneme sequences to be recognized;

[0053] 3.4) The control module compares the to-be-recognized phoneme sequence with the instruction phoneme sequence in the command list to obtain the corresponding command or comparison failure flag; which includes the following steps:

[0054] 3.4.1) extracting a command from the command list and using the command phoneme sequence corresponding to the command as the command phoneme sequence to be compared;

[0055] 3.4.2) By comparing the phonemes in the to-be-recognized phoneme sequence with the phonemes in the to-be-compared instruction phoneme sequence one by one in order; if the comparison results are inconsistent, execute 3.4.3); if the comparison results are consistent, execute 3.4.4);

[0056] 3.4.3) Take out the next command in the command list, and use its corresponding command phoneme sequence as the command phoneme sequence to be compared, and execute 3.4.2); if all commands in the command list have been compared, output a recognition failure flag;

[0057] 3.4.4) The counter counts and compares the next phoneme until the number of consistent phonemes exceeds a preset threshold, then the command to be compared is output as the comparison result, and the counter is cleared; if any of the phoneme comparison results are inconsistent, the counter is cleared and 3.4.3) is executed; wherein the threshold is usually 1 to 5, which is set according to different commands, so that the corresponding command can be found without a complete comparison of the phoneme list.

[0058] in:

[0059] Step 3.2) includes the following steps:

[0060] 3.2.1) Denoising: removing background noise in the working environment through the sound processing engine, and using the obtained sound as the control sound;

[0061] 3.2.2) If the control sound is a continuous sound, it is continuously transmitted to the sound recognition engine; otherwise, it is completely transmitted to the sound recognition engine;

[0062] 3.2.3) If the control sound is a continuous sound, the sound recognition engine will continuously send the input control sound to the control module, and the control module will execute steps 3.3) and 3.4) in sequence to perform command recognition; wherein, if the control module returns a recognition failure flag, it will be returned to the sound processing engine, and the sound processing engine will stop sending subsequent control sounds to the sound recognition engine until the control sound pauses and then a new control sound appears. For example, if someone in the cockpit is saying non-control and continuous words, the sound recognition engine can know from the first few words that it is a non-control command, and the subsequent continuous sound will be discarded by the sound processing engine to save resources. If a pause occurs in the middle, it will return to the initial state and wait for sound input for recognition.

[0063] Furthermore, it also includes a sound output device, and the background noise in step 3.2.1) includes the sound output by the sound output device, which makes it possible to exclude the sound output by the game itself through the speakers as background noise.

[0064] The present invention also provides a game cockpit, which includes at least one seat, a sound output device, a display, at least one sound capture device and a host for running a game. The host uses a command recognition method based on partial phonemes to convert the voice of the game player into a command for controlling the game, and executes the game operation according to the command.

[0065] The sounds made by the game player include clapping, slapping body parts or knocking on bus parts, and operating a sound-generating device (such as a bell).

[0066] like Figure 1 As shown, taking the common game command stop as an example, the working principle and process of the present invention are as follows:

[0067] First, the sound of the user's stop is acquired by a sound capture device (such as a microphone), and then the sound recognition engine converts it into a phoneme list of / s, / t, / oh, and / p. The technology of converting sound into phonemes by the sound recognition engine is well known in the industry, and the relevant algorithm is very mature. Please refer to patent 201711082646.9. In the pre-set command list, there is a corresponding phoneme sequence. Through a simple comparison, the corresponding instruction stop can be found. In the game, the number of operation instructions is relatively small, so it is possible to obtain a unique operation instruction stop after comparing / s or / s, / t, so as to control the game and achieve the purpose of rapid recognition. The threshold is determined according to the different operation instructions. If 3 phonemes can uniquely determine different operation instructions, the threshold is set to 3, which can reduce the number of phoneme comparisons and avoid unnecessary redundant comparisons to further improve the speed.

[0068] like Figure 2 As shown, taking the common game commands left, right, stop, and start as examples, the working principle and process of the present invention are as follows: the sound recognition engine first converts the sound into a phoneme sequence / left, / right, / stop, / start; then through a simple screening, for example, after comparing / s, it further compares / t; if it still cannot obtain a unique command, it further compares / o or / a to obtain a unique command. For the above commands, the threshold can be set to 3 at this time, and a unique command can be obtained by comparing 3 phonemes. Similarly, only one phoneme is actually needed for comparing / left and / right, namely / l and / r. When the comparison reaches the threshold of 3 at most, the result can be returned, and the comparison of other commands is abandoned, thereby increasing the comparison speed.

[0069] The above descriptions are merely embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for command recognition based on partial phonemes, comprising a plurality of commands for human-computer interaction operations, characterized in that: It also includes a pre-set command list, which includes all the commands and the instruction phoneme sequence corresponding to each command; it also includes at least one sound capture device for collecting sound, a sound processing engine for processing the sound, a sound recognition engine for recognizing the processed sound, and a control module for comparing the recognized sound with the command list; The command recognition method includes the following steps: 2.1) In a training environment, a control sound is simulated and acquired through a sound acquisition device, and then the sound processing engine is trained, wherein the training includes removing background noise from the sound acquired by the sound acquisition device and extracting the control sound therefrom; the control sound is composed of a plurality of words or characters; 2.2) In a training environment, the sound recognition engine is trained, wherein the training includes converting the control sound obtained by the sound processing engine into phonemes, and sequentially composing the phoneme sequences to be recognized; the phoneme sequence to be recognized is a phoneme sequence composed of a plurality of phonemes in sequence; 3.1) Acquire the sounds in the working environment through a sound capture device; 3.2) The sound obtained in step 3.1) is obtained by the sound processing engine for processing, and background noise is removed therefrom to obtain the control sound therefrom; 3.3) recognizing the control sound obtained in step 3.2) by the sound recognition engine, converting the control sound into phonemes, and sequentially composing the phoneme sequence to be recognized; 3.4) The control module compares the to-be-recognized phoneme sequence with the instruction phoneme sequence in the command list to obtain the corresponding command or comparison failure flag; which includes the following steps: 3.4.1) extracting a command from the command list and using the command phoneme sequence corresponding to the command as the command phoneme sequence to be compared; 3.4.2) By comparing the phonemes in the to-be-recognized phoneme sequence with the phonemes in the to-be-compared instruction phoneme sequence one by one in order; if the comparison results are inconsistent, execute 3.4.3); if the comparison results are consistent, execute 3.4.4); 3.4.3) taking out the next command in the command list, and using its corresponding command phoneme sequence as the command phoneme sequence to be compared, and executing 3.4.2); if all the commands in the command list have been compared, outputting a recognition failure flag; 3.4.4) The counter counts and compares the next phoneme until the number of consistent phonemes exceeds a preset threshold. The threshold setting must be sufficient to uniquely identify different operation instructions. The command to be compared is then output as the comparison result, and the counter is cleared. If any of the phoneme comparison results are inconsistent, the counter is cleared and 3.4.3) is executed.

2. The method for command recognition based on partial phonemes according to claim 1, characterized in that: The method for presetting the command list comprises the following steps: 1.1) Record the sound corresponding to the command; 1.2) The sound recognition engine converts the sound corresponding to the command into a number of phonemes; 1.3) Combining all or part of the above phonemes in order to obtain an instruction phoneme sequence; 1.4) The commands and their corresponding instruction phoneme sequences are stored as the command list.

3. The method for command recognition based on partial phonemes according to claim 2, characterized in that: Step 2.1) The following steps are involved: 2.1.1) Denoising: simulating various types of background noise in a training environment and training the sound processing engine to remove the background noise.

4. The method for command recognition based on partial phonemes according to claim 1, characterized in that: The step 3.2) comprises the following steps: 3.2.1) Denoising, removing background noise in the working environment through the sound processing engine, and using the obtained sound as the control sound; 3.2.2) If the control sound is a continuous sound, it is continuously transmitted to the sound recognition engine; otherwise, it is completely transmitted to the sound recognition engine; 3.2.3) If the control sound is a continuous sound, the sound recognition engine continuously sends the input control sound to the control module, and the control module sequentially executes steps 3.3) and 3.4) to perform command recognition; wherein, if the control module returns a recognition failure flag, it returns it to the sound processing engine, and the sound processing engine stops sending subsequent control sounds to the sound recognition engine until the control sound pauses and then a new control sound appears.

5. The method for command recognition based on partial phonemes according to claim 4, characterized in that: It also includes a sound output device, and the background noise in step 3.2.1) includes the sound output by the sound output device.

6. The method for command recognition based on partial phonemes according to claim 1, characterized in that: The threshold value is 1-5.

7. A game cabin, comprising at least one seat, a sound output device, a display, at least one sound capture device and a host computer for running a game, characterized in that: The host uses the partial phoneme-based command recognition method of one of claims 1 to 6 to convert the game player's voice into a command for controlling the game, and executes the game operation according to the command.

8. The game cabin according to claim 7, characterized in that: The sounds made by the game player include clapping, slapping body parts or knocking on bus parts, and sounds made by operating a sound-generating device.

Images