Voice control system and method based on remote controller

Abstract

The invention discloses a voice control system and method based on a remote controller, and the system comprises a voice module which comprises a voice collection module and a voice command recognition module, the voice command recognition module is used for comparing the voice data in different environments with a plurality of pre-stored voice control commands and outputting a target voice control command; the physical control is used for generating a physical control instruction; and the controller is electrically connected with the voice module and the physical control, and is used for controlling the controlled equipment based on the target voice control instruction and / or the physical control instruction according to the current working state of the voice command recognition module. According to the scheme, voice control is changed into simultaneous control with the physical control through the auxiliary control, a user can use voice control anytime and anywhere, the defect that voice control recognition is inaccurate or not fast enough is overcome through the physical control, and the application range of voice control is greatly widened.

Description

Technical Field

[0001] The present invention relates to the field of voice control technology, and in particular to a voice control system and method based on a remote controller. Background Art

[0002] At present, remote controls are used in many fields, such as model aircraft, vehicle models, and robots. The control inputs of existing remote controls are becoming more and more diverse, and somatosensory control has been widely used. However, the voice control function common in daily life has not been widely used. The root cause is that problems such as voice recognition accuracy and latency are difficult to accept.

[0003] While user-defined voice announcements are a premium feature on many model aircraft remote controllers, these are typically achieved by replacing resource files. Remote controllers that allow for self-recorded voice resources are relatively rare. This is due to the low cost-effectiveness of voice capture equipment for a custom announcement. While local voice recognition is widely used, most implementations use hard-coded commands that cannot be modified, or only offer the ability to change the wake-up phrase. Summary of the Invention

[0004] Based on this, it is necessary to provide a voice control system, method, computer device and storage medium based on a remote control to address the above technical problems, so as to solve at least one of the above problems.

[0005] In a first aspect, the present application is implemented as follows: providing a voice control system based on a remote controller, comprising: Voice collection module, used to collect voice data; Physical controls, used to generate physical control instructions; A voice command recognition module is used to compare the voice data in different environments with a plurality of pre-stored voice control instructions, and obtain the target voice control instruction when the comparison is successful; The controller is electrically connected to the voice acquisition module, the voice command recognition module and the physical control module, respectively, and is used to control the controlled device based on the target voice control instruction and / or the physical control instruction according to the current working state of the voice command recognition module.

[0006] In one embodiment, The controller is further configured to store the voice data as a resource file; The system further includes: The voice broadcast module electrically connected to the controller is used to extract the voice data to be played from the resource file based on the target voice control instruction or the physical control instruction, and play the voice data.

[0007] In one embodiment, the controller is further configured to: Construct a recognition and comparison command library and a voiceprint library of the voice command recognition module. Each voice command in the recognition and comparison command library is a voice command collected by the user through the voice collection module and customized.

[0008] In one embodiment, the controller is further configured to: Establishing an associated control relationship between voice control instructions and control instructions, where a physical control is bound to multiple voice control instructions to form a multi-source control, and the multi-source control is used to jointly control a controlled object; Converting the voice control instruction into a first control device identification value, and converting the physical control instruction into a second control device identification value; When the voice command recognition module is in the awake state, corresponding operations are jointly controlled based on changes in the first control recognition value and the second control device recognition value.

[0009] In one embodiment of the present application, the controller is further configured to: Monitor all changes in the identification values ​​of the first control device and the values ​​of the second control device: When the value of the first control device changes, it immediately responds to the changed value. When the second control device recognizes that the value change exceeds a preset misoperation range, it immediately responds to the changed value.

[0010] In one embodiment, the controller is further configured to: When the voice command recognition module is in a closed or dormant state, the corresponding control operation is performed based on the recognition value of the second control device. At this time, the response is no longer monitored until the change exceeds the error operation area, but the change is responded immediately.

[0011] In one embodiment, the system further includes: The display screen electrically connected to the controller is used to display the instruction configuration interface to instruct the user to input corresponding instruction configuration parameters and display the instruction configuration results.

[0012] The display screen is further used to obtain an operation request sent by a user to add, modify or delete the instruction configuration result, and display the result after the operation in the instruction configuration interface; Set the voice command recognition matching accuracy and whether to match voiceprints in different environments.

[0013] In one embodiment, the voice control module is used to: Set the wake-up method to a specific wake-up word or physical control command; The current scene is obtained, and based on the current scene, the voice control function is turned on or off by using a wake-up word or controlling a predefined physical control.

[0014] In one embodiment, the controller is further configured to determine control channel information according to the target voice control instruction or the physical control instruction; The system further comprises: The first communication module electrically connected to the controller is used to send the corresponding control channel information to the second communication module of the controlled device, so that the controlled device performs the corresponding function control operation according to the control channel information.

[0015] In a second aspect, a voice control method based on a remote controller is provided, which is applied to the remote controller, and the method includes: The acquisition module collects voice data; Comparing the voice data in different environments with pre-stored voice commands, and obtaining target voice control instructions when the comparison is successful; Generate physical control instructions; The controlled device is controlled based on the target voice control instruction and / or the target control instruction.

[0016] In a third aspect, a computer device is provided, comprising a memory, a processor, and computer-readable instructions stored in the memory and executable on the processor, wherein the processor implements the above-mentioned remote control-based voice control method when executing the computer-readable instructions.

[0017] In a fourth aspect, one or more readable storage media storing computer-readable instructions are provided. When the computer-readable instructions are executed by one or more processors, the one or more processors execute a voice control method based on a remote controller as described above.

[0018] The above provides a voice control method, device, computer equipment and storage medium based on a remote control, and the system includes: a voice module, including a voice acquisition module and a voice command recognition module, the voice acquisition module is used to acquire voice data, the voice command recognition module is used to compare the voice data with a plurality of pre-stored voice control instructions, and output a target voice control instruction; a physical control is used to generate a physical control instruction; a controller is electrically connected to the voice module and the physical control, respectively, and is used to control the controlled device based on the target voice control instruction and / or the physical control instruction according to the current working state of the voice command recognition module. In an embodiment of the present application, a voice acquisition module and a physical control can be set in the remote control at the same time, and the voice control can be controlled simultaneously with the physical control through the auxiliary control, so that the user can use voice control anytime and anywhere. The shortcomings of inaccurate / slow recognition of the voice control are compensated by the physical control, which greatly expands the application scope of voice control. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments of the present invention. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0020] Figure 1 1 is a schematic diagram of an application environment of a voice control method based on a remote controller according to an embodiment of the present invention; Figure 2 1 is a flow chart of a voice control method based on a remote controller according to an embodiment of the present invention; Figure 3 1 is a schematic structural diagram of a voice control system based on a remote controller according to an embodiment of the present invention; Figure 4 FIG. 1 is a schematic diagram of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0021] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0022] The voice control method based on the remote controller provided in this embodiment can be applied to Figure 1In an application environment, a remote controller and a controlled device can communicate with each other. The controlled device includes but is not limited to various remote control cars, remote control airplanes, robots, and other devices.

[0023] The remote controller and the controlled device may be connected to each other via Bluetooth, radio frequency, infrared, wired connection, etc. Alternatively, the remote controller may be directly built into the controlled device, thereby directly receiving voice or physical control control through the controlled device.

[0024] In one embodiment, if Figure 2 As shown, a voice control method based on a remote controller is provided, which can be applied to the above remote controller and specifically includes the following steps: Collect voice data; In an embodiment of the present application, voice data can be collected through a voice collection module, and the voice collection module can be a microphone, which can be used to collect sound data entered by the user.

[0025] In the embodiment of the present application, the sensitivity of the voice collection module and / or the degree of detail of the extracted voice data can be adjusted according to the surrounding environment and the purpose of collecting voice to adapt to different voice collection environments, thereby achieving the best collection effect.

[0026] Comparing the voice data in different environments with pre-stored voice commands, and obtaining target voice control instructions when the comparison is successful; In an embodiment of the present application, voice data can be collected through a voice collection module, such as a microphone, and then input into a voice command recognition module. The voice command recognition module compares the voice data with pre-stored and defined voice commands and voiceprint data. When a voice command with a similarity greater than a preset similarity threshold is matched, the module outputs a successful comparison result to obtain the target voice control instruction. Otherwise, the comparison is continued, and the details of the comparison can be adjusted, for example, not comparing voiceprints, and comparing commands with high / low accuracy.

[0027] In an embodiment of the present application, the voice command recognition module can perform different functions when it is in different working modes. For example, when the voice command recognition module is in the voice command definition state, the voice acquisition module, such as a microphone, collects voice data and then inputs it into the voice command recognition module. After the voice recognition module compares it more than twice and the comparison is successful, it is stored as a voice command for subsequent comparison, and the sensitivity of the stored voice command is adjustable.

[0028] Among them, when the voice recognition module is in a dormant state, it can compare the collected voice data with the preset wake-up command or compare the control command input by the physical control with the preset wake-up command, and reply with a successful comparison instruction and switch the voice module state.

[0029] It should be noted that all voice commands on the remote control are user-defined. The fewer commands you define, the shorter the comparison time and the lower the recognition error rate. Users can define the commands they need based on their actual application, ensuring that no redundant commands affect actual use.

[0030] Furthermore, you can pre-define the wakeup method for the voice recognition module in the dormant state (voice, physical control, or both). If the wakeup method is voice, voice, or physical control, the dormant state uses the wakeup word to compare with the microphone input. If the comparison is successful, the module returns to the awakened state. If the wakeup method is physical control, the dormant state does not process the microphone input.

[0031] Among them, when the voice command recognition module is in the state of being awake / sleep closed, a wake-up command, sleep or shutdown command is issued, and the control system can define the lighting effects and sound prompts corresponding to the state changes, making it more convenient to use.

[0032] In the embodiments of the present application, users can use the language acquisition module to define voice commands in advance before using the remote control. By defining voice commands themselves, the user can eliminate the problem of inaccurate voice recognition caused by different languages, such as Mandarin, dialects, English, language habits, etc., and different acquisition devices. The flexibility and configurability of voice command definition also improves the accuracy of voice command recognition.

[0033] Among them, the voice command can be a comparable object defined by the voice recognition module. When waking up, the input voice is compared with all voice commands, and if successful, the corresponding voice command is responded to.

[0034] Generate physical control instructions; In an embodiment of the present application, the physical control may be a button, a joystick or a touch control of a display screen set on the remote control. The user may input a control instruction to the remote control through the physical control so that the remote control can control the controlled device according to the control instruction.

[0035] The controlled device is controlled based on the target voice control instruction and / or the physical control instruction.

[0036] In an embodiment of the present application, different functions can be controlled separately based on the target voice control instruction and the target control instruction. For example, the command to restore safety in the function control can be handed over to the voice command for execution. For example, the ignition of the remote control car can be controlled by voice command, while the triggering of dangerous scenes can be handed over to the physical control for execution, such as controlling the throttle to start the throttle joystick, thereby expanding the scope of voice control. Alternatively, the voice command can be associated with the control command, and the same function can be controlled by the voice command and the control command together. For example, in some scenarios, such as when the surrounding environment is relatively noisy and it is impossible to parse the collected voice data into an accurate voice instruction, the physical control can be used instead of the voice instruction to execute the corresponding control, or the voice control instruction can be used together with the physical control instruction to execute the control.

[0037] In an embodiment of the present application, each voice command and control command and function control can be configured in advance in the system of the remote control, that is, different voice commands can control different functions, and different control commands can also correspond to different functions, and a control instruction table can be formed. When the target voice command or control instruction is obtained, it can be matched with the control instruction table respectively. When the match is consistent, the corresponding function control can be obtained, thereby controlling the corresponding function of the controlled device.

[0038] It can be understood that local voice recognition can be performed directly through the chip set in the remote control. The voice recognition algorithm is simple and fast. If there are fewer pre-configured voice command items and the voice commands can be customized by users, the fewer defined voice commands that can be understood, the faster the comparison speed and the lower the control delay.

[0039] The controlled device may be a remote-controlled car, a remote-controlled airplane, a remote-controlled robot, etc.

[0040] A physical control (which can output multiple control values) and multiple voice commands are defined in the remote control system, and each voice command is defined to correspond to a control value.

[0041] Among them, the control instruction can represent the control values ​​corresponding to the target voice control instruction and the physical control instruction respectively. Different control values ​​mean different control commands. The controlled device can respond to this control value to execute functions corresponding to different values.

[0042] In an embodiment of the present application, a controller may be provided in the remote control, through which control commands to the control components can be output based on the target voice control instructions and physical control instruction input information combined with function presets, thereby controlling the controlled device.

[0043] In one embodiment of the present application, the controller can perform different operations when the voice command recognition module is in different modes. For example, in the voice resource file definition mode: the controller can store the voice data as a resource file. In the voice command definition mode: the controller can convert the physical control value into a control command that controls the voice command definition, and define a voice command list for the voice recognition module. When the voice command recognition module is in the awake state, it accepts voice commands and defined physical controls to control functions at the same time, for example, whoever changes will be followed (the physical control determines the change error). When the voice command recognition module is not awake, it monitors the changes in the physical control values ​​in real time to respond to changes in control commands.

[0044] In an embodiment of the present application, a voice control method based on a remote controller is provided, including: collecting voice data through a voice acquisition module, parsing the voice data to obtain target voice control instructions; collecting physical control instructions through the physical control; and controlling the controlled device based on the target voice control instructions or the target control instructions. In an embodiment of the present application, a voice acquisition module and a physical control can be set in the remote controller at the same time, and a voice resource file definition function is integrated. The sound recording is stored as a sound file using a microphone, a remote control screen, etc., which can be selected as a broadcast sound. The auxiliary control allows the voice control to be controlled simultaneously with the physical control, allowing the user to use voice control anytime and anywhere. The use of physical controls to compensate for the shortcomings of inaccurate / slow recognition of voice controls greatly expands the application scope of voice control.

[0045] In one embodiment of the present application, controlling the controlled device based on the target voice control instruction or the target control instruction includes: Establishing an associated control relationship between voice control instructions and control instructions, where a physical control is bound to multiple voice control instructions to form a multi-source control, and the multi-source control is used to jointly control a controlled object; Converting the target voice control instruction into a first control device identification value, and converting the physical control instruction into a second control device identification value; When the voice command recognition module is in the awake state, corresponding operations are jointly controlled based on changes in the first control recognition value and the second control device recognition value.

[0046] Specifically, voice commands can be bound to control commands of physical controls to jointly control the same function. For example, two voice commands and one physical control can be defined to control the whistle function. The second control identification value of the physical control SWA can be defined in the range of (0, 1), and the voice command "whistle" corresponds to a first control identification value of 1, and the voice command "stop whistle" corresponds to a first control identification value of 0. Furthermore, when the device is turned on, the initial second control identification value of the physical control SWA is identified and sent to the controlled device. After the target voice command and target control command are subsequently obtained, the function control is executed according to the latest control identification value.

[0047] Furthermore, this ensures that voice recognition commands can be widely used. Any predefined voice command in this solution can be paired with a physical control for auxiliary control. In other words, under normal circumstances, functions requiring high control accuracy can be defined to have controls derived from both the first control device recognition value (voice command) and the second control device recognition value (physical control).

[0048] The voice control instructions corresponding to the voice data can be defined in various ways, for example: 1. as a wake-up word; 2. as a remote control system control signal; 3. as a broadcast command; 4. as a model control channel signal trigger. The above are just some of the examples and can be customized according to various needs.

[0049] There are multiple ways to quickly respond to sleep / wake-up mode operations, such as: 1. Use physical controls to wake up / sleep; 2. Use voice commands to wake up / sleep; 3. Use voice commands and physical controls to wake up / sleep; 4. If there is no operation after waking up for a set time, it will enter automatic sleep; 5. Command prompts can be broadcast when waking up to remind users of the functions they can execute.

[0050] In one embodiment of the present application, jointly controlling corresponding operations based on changes in the first control identification value and the second control device identification value includes: Monitor all changes in the identification values ​​of the first control device and the values ​​of the second control device: When the value of the first control device changes, it immediately responds to the changed value. When the second control device recognizes that the value change exceeds a preset misoperation range, it immediately responds to the changed value.

[0051] Specifically, if the value of the first control device changes, the changed value will be responded to immediately. If the change in the value of the second control device exceeds the preset misoperation area, the changed value will be responded to immediately. It should be noted that physical controls, especially the main operating components of high-precision remote controls such as joysticks, are prone to misoperation. If a voice command is defined to control a function together with it, it is necessary to avoid the misoperation area. Therefore, a relatively large area is usually set to swing without action / trigger to a specific position and then continue to trigger until a certain value stops, and then respond to the stop time value. This can greatly eliminate the impact of misoperation. However, this loses the timeliness of control.

[0052] In one embodiment of the present application, the controller is further configured to: When the voice command recognition module is in a closed or dormant state, the corresponding control operation is performed based on the recognition value of the second control device. At this time, the response is no longer monitored until the change exceeds the error operation area, but the change is responded immediately.

[0053] It is understandable that if the voice command recognition module is in a closed or dormant state, it can respond immediately even if it is monitored that the recognition value of the second control device does not exceed the misoperation area.

[0054] In one embodiment of the present application, the controller is further configured to: A recognition and comparison command library of the voice command recognition module is constructed, wherein each voice command in the recognition and comparison command library is a voice command collected by the user through the voice collection module and customized.

[0055] Specifically, the recognition and comparison command library can be defined by users. The fewer the number, the shorter the comparison time and the higher the recognition accuracy. On the contrary, the more the number, the more functions that can be voice-controlled, and the corresponding recognition time and accuracy will decrease slightly. Users can flexibly set it according to their needs.

[0056] Furthermore, each command in this command library is collected by the user using the device's voice acquisition module, eliminating the need for fault-tolerant design for different timbres or even different pronunciations. This allows each voice comparison model to correspond to a control command. Traditional local voice control systems often require multiple comparison phrases for a single command. For example, a command to increase the volume requires entering "increase volume," "increase volume," and other phrases, including English. Users can simply define a single, characteristic phrase. A voiceprint library can also be created. Once voiceprint information is collected, voiceprint recognition can be enabled and compared with the voiceprints in the library to filter out non-personal pronunciations when necessary, ensuring that only one's own voice is recognized.

[0057] In one embodiment of the present application, after the voice data is collected by the voice collection module, the following steps are included: Storing the voice data as a resource file; Based on the target voice control instruction or the physical control instruction, the voice data to be played is extracted from the resource file and played.

[0058] Specifically, the voice command recognition module can also collect voice data, and the voice command definition of the voice data can be performed through the computing chip, that is, multiple voice commands can be configured, and the voice data collected by the voice recognition module can be stored as a resource file. When voice broadcast is required based on the target voice control instruction or the physical control instruction, for example, "honk the whistle", the corresponding voice about "honk the whistle" can be extracted from the resource file and broadcast, which can realize the voice broadcast function of the remote control, and the output voice can be the user's own, which can improve the user experience.

[0059] Among them, the computing chip can be a control chip such as a single-chip microcomputer, MCU, etc., which can include a storage function for storing the user-configured voice commands, control commands and the resource file for subsequent use.

[0060] Among them, the playing of voice commands and physical control commands may be simultaneous / different, and voice playback can more intuitively inform the control response status.

[0061] In one embodiment of the present application, controlling the controlled device based on the target voice control instruction or the target control instruction includes: Set the wake-up method to a specific wake-up word or physical control command; The current scene is obtained, and based on the current scene, the voice control function is turned on or off by using a wake-up word or controlling a predefined physical control.

[0062] Specifically, the physical control can be used to control the voice control command to be turned on and off according to different usage scenarios. For example, when in a more serious occasion such as a competition or a meeting, or in an environment with relatively noisy sounds, it is not suitable to use voice control commands. At this time, the control function of the voice control command can be turned off through the physical control, and the controlled device can be controlled through the physical control.

[0063] In one embodiment of the present application, the remote controller further includes a display screen, and the method further includes: The command configuration interface is displayed to instruct the user to enter the corresponding command configuration parameters and display the command configuration results.

[0064] The display screen is further used to obtain an operation request sent by a user to add, modify or delete the instruction configuration result, and display the result after the operation in the instruction configuration interface; and Set the voice command recognition matching accuracy and whether to match voiceprints in different environments.

[0065] Specifically, the remote control is also provided with a display screen, through which the command configuration interface can be displayed. Users can customize the voice commands and control commands according to the instructions of the configuration interface, and can display the results of the completed configuration. At the same time, after the configuration is completed, the user can add, modify and delete voice commands and control commands in the interface, thereby realizing the segmented definition, that is, defining each command separately.

[0066] It should be noted that you can also set the voice command recognition matching level and add voiceprint matching. For example, in a noisy environment, to ensure recognition accuracy, you can set the comparison accuracy higher. In a quiet environment, to ensure that even quiet voices can be recognized, you can set the comparison accuracy lower.

[0067] In one embodiment of the present application, controlling the controlled device based on the target voice control instruction or the target control instruction includes: Determining control channel information according to the target voice control instruction or the physical control instruction; The corresponding control channel information is sent to the controlled device, so that the controlled device performs a corresponding function control operation according to the control channel information.

[0068] Specifically, the control allocation layer queries the mapping table between the pre-configured instructions and control channels for the control channels corresponding to both voice control and physical control through the target voice control instructions and the target space control instructions, thereby determining the corresponding control channel information, and sending the control channel information to the second communication module of the controlled device through the first communication module set on the remote control device, so that the controlled device performs the corresponding function control operation according to the control channel information.

[0069] The first communication module may be a radio frequency transmitter, and the second communication module may be a radio frequency receiver.

[0070] In an embodiment of the present application, a voice acquisition module and physical controls can be set in the remote control at the same time, and a voice resource file definition function is integrated. The sound recording is stored as a sound file using a microphone, remote control screen, etc., which can be selected as a broadcast sound. In addition, the voice control can be controlled simultaneously with the physical controls through auxiliary controls, allowing users to use voice control anytime and anywhere. The shortcomings of inaccurate / slow recognition of voice controls are compensated by physical controls, which greatly expands the application scope of voice control.

[0071] The remote control screen can be used to display relevant setting information or operation status, assist in completing the definition and setting of the voice model, and display the voice data collected by the voice control system and its command correspondence for each voice model, making it convenient for users to view and adjust settings.

[0072] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0073] In one embodiment, a voice control system based on a remote controller is provided, and the voice control system based on a remote controller corresponds one-to-one with the voice control method based on a remote controller in the above embodiment. Figure 3 As shown, the remote control-based voice control system includes a voice acquisition module 10, a physical control 20, a voice command recognition module 30, and a controller 40. The functional modules are described in detail as follows: The voice module includes a voice acquisition module 10 and a voice command recognition module 30. The voice acquisition module 10 is used to collect voice data, and the voice command recognition module 30 is used to compare the voice data in different environments with multiple pre-stored voice control commands and output a target voice control command; Physical control 20, used to generate physical control instructions; The controller 40 is electrically connected to the voice module and the physical control, respectively, and is used to control the controlled device based on the target voice control instruction and / or the physical control instruction according to the current working state of the voice command recognition module.

[0074] Specifically, the voice acquisition module can be a microphone that can be used to collect voice data input by the user. After the voice data is collected, the voice data can be parsed to extract voice commands from the voice data, and the voice commands can be defined and stored as resource files.

[0075] Before using the remote control, users can use the language acquisition module to define voice commands in advance. This eliminates issues with inaccurate voice recognition caused by different timbres and acquisition devices. The flexibility and configurability of voice command definition also improves voice command recognition accuracy.

[0076] Furthermore, the sensitivity of the voice collection module and / or the level of detail of the extracted voice data can be adjusted according to the surrounding environment to adapt to different voice collection environments, thereby achieving the best collection effect.

[0077] Among them, the physical control can be a button, joystick or touch control of the display screen set on the remote control, and a control instruction can be input to the remote control through the physical control, so that the remote control can control the controlled device according to the control instruction.

[0078] In the embodiment of the present application, the sensitivity of the voice collection module can be adjusted according to the surrounding environment to adapt to different voice collection environments, thereby achieving the best collection effect.

[0079] In an embodiment of the present application, voice data can be collected through a voice collection module, such as a microphone, and then input into a voice command recognition module. The voice command recognition module compares the voice data with pre-stored and defined voice commands and voiceprint data. When a voice command with a similarity greater than a preset similarity threshold is matched, the module outputs a successful comparison result to obtain the target voice control instruction. Otherwise, the comparison is continued, and the details of the comparison can be adjusted, for example, not comparing voiceprints, and comparing commands with high / low accuracy.

[0080] In an embodiment of the present application, the voice command recognition module can perform different functions when it is in different working modes. For example, when the voice command recognition module is in the voice command definition state, the voice acquisition module, such as a microphone, collects voice data and then inputs it into the voice command recognition module. If the voice recognition module can successfully match it after more than two comparisons, it is stored as a voice command for subsequent comparison, and the sensitivity of the stored voice command is adjustable.

[0081] Among them, when the voice recognition module is in a dormant state, it can compare the collected voice data with the preset wake-up command or compare the control command input by the physical control with the preset wake-up command, reply with a successful comparison instruction and switch the voice module state.

[0082] It should be noted that all voice commands on the remote control are user-defined. The fewer commands you define, the shorter the comparison time and the lower the recognition error rate. Users can define the commands they need based on their actual application, ensuring that no redundant commands affect actual use.

[0083] Furthermore, you can pre-define the sleep mode wakeup method (voice, physical control, or both). If voice, voice, or physical control is used, the sleep state uses the wakeup word to compare with the microphone input. If the comparison is successful, the device returns to the wakeup state. If physical control is used, the sleep state does not process the microphone input.

[0084] When the voice command recognition module is in the voice command modification mode, features of the voice data are extracted and stored.

[0085] Among them, when the voice command recognition module is in the state of being awake / sleep closed, a wake-up command and a sleep / shutdown command are issued, and the control system can define the lighting effects and sound prompts corresponding to the state changes, making it more convenient to use.

[0086] In one embodiment of the present application, different functions can be controlled separately based on the target voice control command and the target control command. For example, the command to restore safety in the function control can be handed over to the voice command for execution. For example, the remote control car can be turned off by voice command, while the triggering of dangerous scenes can be handed over to the physical control for execution, such as controlling the throttle to start the throttle joystick, thereby expanding the scope of voice control. Alternatively, the voice command can be associated with the control command, and the same function can be controlled by the voice command and the control command together. For example, in some scenarios, such as when the surrounding environment is relatively noisy and it is impossible to parse the collected voice data into an accurate voice command, the corresponding control can be executed by the physical control instead of the voice command.

[0087] Among them, the corresponding configuration of each voice command and control command and function control can be made in advance in the system of the remote control, that is, different voice commands can control different functions, and different control commands can also correspond to different functions, and a control instruction table can be formed. When the target voice command or control instruction is obtained, it can be matched with the control instruction table respectively. When the match is consistent, the corresponding function control can be obtained, thereby controlling the corresponding function of the controlled device.

[0088] It can be understood that local voice recognition can be performed directly through the chip set in the remote control. The semantic recognition algorithm is simple and fast. If there are fewer pre-configured voice command items and they can be customized by the user, the fewer voice commands are defined, the faster the comparison speed and the lower the control delay.

[0089] The controlled device may be a remote-controlled car, a remote-controlled airplane, a remote-controlled robot, etc.

[0090] A physical control (which can output multiple control values) and multiple voice commands are defined in the remote control system, and each voice command is defined to correspond to a control value.

[0091] Among them, the control instruction can represent the control values ​​corresponding to the target voice control instruction and the physical control instruction respectively. Different control values ​​mean different control commands. The controlled device can respond to this control value to execute functions corresponding to different values.

[0092] In an embodiment of the present application, the remote controller may be provided with a controller, through which the target voice control instruction and physical control instruction input information can be combined with the function preset output to control the control command of the control component, thereby controlling the controlled device.

[0093] In one embodiment of the present application, the controller can perform different operations in different modes. For example, in the voice resource file definition mode: the controller can store the voice data as a resource file. In the voice command definition mode: the controller can convert the physical control value into a control command defined by the control voice command, and define a voice command list for the voice recognition module. When the voice command recognition module is in the awake state, it accepts voice commands and defined physical controls to control the functions at the same time, and the one that changes is followed (the physical control determines the change error). When the voice command recognition module is not awake, it monitors the changes in the physical control values ​​in real time to respond to changes in the control commands.

[0094] In one embodiment of the present application, the controller 40 is further configured to: Storing the voice data as a resource file; The system further comprises: The voice broadcast module 50 electrically connected to the controller is used to extract the voice data to be played from the resource file based on the target voice control instruction or the physical control instruction, and play the voice data.

[0095] Specifically, the voice recognition module can collect voice data, and the voice command definition of the voice data can be performed through the computing chip, that is, multiple voice commands can be configured, and the voice data collected by the voice recognition module can be stored as a resource file. When voice broadcast is required based on the target voice control instruction or the physical control instruction, for example, "honk the whistle", the corresponding voice about "honk the whistle" can be extracted from the resource file and broadcast, which can realize the voice broadcast function of the remote control, and the output voice can be the user's own, which can improve the user experience.

[0096] In order to ensure the accuracy of the collected voice data, three recordings can be performed to extract common waveforms as the basic comparison model to eliminate the influence of noise and other factors during the voice data transformation process. The corresponding voice collection equipment can be set up relatively independently and made movable, so that voice definition can be performed in the corresponding application scenario, making recognition more accurate.

[0097] Among them, the controller can be a computing chip, such as a single-chip microcomputer, MCU and other control chips, which can include a storage function for storing user-configured voice commands, control commands and the resource file for subsequent use.

[0098] Among them, the playing of voice commands and physical control commands may be simultaneous / different, and voice playback can more intuitively inform the control response status.

[0099] In one embodiment of the present application, the controller 40 is further configured to: A recognition and comparison command library of the voice command recognition module is constructed, wherein each voice command in the recognition and comparison command library is a voice command collected by the user through the voice collection module and customized.

[0100] Specifically, the recognition and comparison command library can be defined by users. The fewer the number, the shorter the comparison time and the higher the recognition accuracy. On the contrary, the more the number, the more functions that can be voice-controlled, and the corresponding recognition time and accuracy will decrease slightly. Users can flexibly set it according to their needs.

[0101] Furthermore, each command in this command library is collected by the user using the device's voice acquisition module, eliminating the need for fault-tolerant design for different timbres or even different pronunciations. This allows each voice comparison model to correspond to a control command. Traditional local voice control systems often require multiple comparison phrases for a single command. For example, a command to increase the volume requires entering "increase volume," "increase volume," and other phrases, including English. Users can simply define a single, characteristic phrase. A voiceprint library can also be created. Once voiceprint information is collected, voiceprint recognition can be enabled and compared with the voiceprints in the library to filter out non-personal pronunciations when necessary, ensuring that only one's own voice is recognized.

[0102] In one embodiment of the present application, the controller 40 is further configured to: Establishing an associated control relationship between voice control instructions and control instructions, where a physical control is bound to multiple voice control instructions to form a multi-source control, and the multi-source control is used to jointly control a controlled object; Converting the target voice control instruction into a first control device identification value, and converting the physical control instruction into a second control device identification value; When the voice command recognition module is in the awake state, corresponding operations are jointly controlled based on changes in the first control recognition value and the second control device recognition value.

[0103] Specifically, the voice command can be bound to the control command of the physical control to jointly control the same function. For example, two voice commands and one physical control can be defined to control the whistle function. The second control identification value of the physical control SWA can be defined as (0, 1), and the voice command "whistle" corresponds to the first control identification value of 1, and the voice command "stop whistle" corresponds to the first control identification value of 0. Furthermore, when the power is turned on, the initial second control identification value of the physical control SWA is identified and sent to the controlled device. After the target voice command and target control command are subsequently obtained, the function control is executed according to the latest control identification value.

[0104] Furthermore, this ensures that voice recognition commands can be widely used. Any predefined voice command in this solution can be paired with a physical control for auxiliary control. In other words, under normal circumstances, functions requiring high control accuracy can be defined to have controls derived from both the first control device recognition value (voice command) and the second control device recognition value (physical control).

[0105] The voice control instructions corresponding to the voice data can be defined in various ways, for example: 1. as a wake-up word; 2. as a remote control system control signal; 3. as a broadcast command; 4. as a model control channel signal trigger. The above are just some of the examples and can be customized according to various needs.

[0106] There are multiple ways to quickly respond to sleep / wake-up mode operations, such as: 1. Use physical controls to wake up / sleep; 2. Use voice commands to wake up / sleep; 3. Use voice commands and physical controls to wake up / sleep; 4. If there is no operation after waking up for a set time, it will enter automatic sleep; 5. Command prompts can be broadcast when waking up to remind users of the functions they can execute.

[0107] Furthermore, when the device is powered on, the initial second control identification value of the physical control SWA is identified and sent to the controlled device. After the target voice command and target control command are subsequently obtained, the function control is executed according to the latest control identification value.

[0108] In one embodiment of the present application, the controller 40 is further configured to: Monitor all changes in the identification values ​​of the first control device and the values ​​of the second control device: When the value of the first control device changes, it immediately responds to the changed value. When the second control device recognizes that the value change exceeds a preset misoperation range, it immediately responds to the changed value.

[0109] Specifically, if the value of the first control device changes, the changed value will be responded to immediately. If the change in the value of the second control device exceeds the preset misoperation area, the changed value will be responded to immediately. It should be noted that physical controls, especially the main operating components of high-precision remote controls such as joysticks, are prone to misoperation. If a voice command is defined to control a function together with it, it is necessary to avoid the misoperation area. Therefore, a relatively large area is usually set to swing without action / trigger to a specific position and then continue to trigger until a certain value stops, and then respond to the stop time value. This can greatly eliminate the impact of misoperation. However, this loses the timeliness of control.

[0110] In one embodiment of the present application, the controller 40 is further configured to: When the voice command recognition module is in a closed or dormant state, the corresponding control operation is performed based on the recognition value of the second control device. At this time, the response is no longer monitored until the change exceeds the error operation area, but the change is responded immediately.

[0111] It is understandable that if the voice command recognition module is in a closed or dormant state, it can respond immediately even if it is monitored that the recognition value of the second control device does not exceed the misoperation area.

[0112] In one embodiment of the present application, the system further includes: The display screen 60 electrically connected to the controller is used to display an instruction configuration interface to instruct the user to input corresponding instruction configuration parameters and display the instruction configuration results.

[0113] The display screen 60 is further configured to obtain an operation request sent by a user to add, modify or delete the instruction configuration result, and display the result of the operation in the instruction configuration interface; and Set the voice command recognition matching accuracy and whether to match voiceprints in different environments.

[0114] Specifically, the remote control is also provided with a display screen, through which the command configuration interface can be displayed. Users can customize the voice commands and control commands according to the instructions of the configuration interface, and can display the results of the completed configuration. At the same time, after the configuration is completed, the user can add, modify and delete voice commands and control commands in the interface, thereby realizing the segmented definition, that is, defining each command separately.

[0115] It should be noted that you can also set the voice command recognition matching level. For example, in a noisy environment, to ensure recognition accuracy, you can set the comparison accuracy higher and increase voiceprint matching. In a quiet environment, to ensure that even quiet voices can be recognized, you can set the comparison accuracy lower.

[0116] In one embodiment of the present application, the controller 40 is further configured to: Set the wake-up method to a specific wake-up word or physical control command; The current scene is obtained, and based on the current scene, the voice control function is turned on or off by using a wake-up word or controlling a predefined physical control.

[0117] Specifically, the physical control can be used to control the voice control command to be turned on and off according to different usage scenarios. For example, when in a more serious occasion such as a competition or a meeting, or in an environment with relatively noisy sounds, it is not suitable to use voice control commands. At this time, the control function of the voice control command can be turned off through the physical control, and the controlled device can be controlled through the physical control.

[0118] In one embodiment of the present application, the controller 40 is further configured to determine control channel information according to the target voice control instruction or the physical control instruction; The system further comprises: The first communication module 70 electrically connected to the controller is used to send the corresponding control channel information to the second communication module 80 of the controlled device, so that the controlled device performs the corresponding function control operation according to the control channel information.

[0119] Specifically, the control allocation layer queries the mapping table between the pre-configured instructions and control channels for the control channels corresponding to both voice control and physical control through the target voice control instructions and the target space control instructions, thereby determining the corresponding control channel information, and sending the control channel information to the second communication module 80 of the controlled device 90 through the first communication module 70, so that the controlled device performs the corresponding function control operation according to the control channel information.

[0120] The first communication module may be a radio frequency transmitter, and the second communication module may be a radio frequency receiver.

[0121] The remote control screen can be used to display relevant setting information or operation status, assist in completing the definition and setting of the voice model, and display the voice data collected by the voice control system and its command correspondence for each voice model, making it convenient for users to view and adjust settings.

[0122] In an embodiment of the present application, a voice acquisition module and physical controls can be set in the remote control at the same time, and a voice resource file definition function is integrated. The microphone, remote control screen, etc. are used to record and store sound as a sound file, which can be selected as a broadcast sound. In addition, the voice control can be controlled simultaneously with the physical controls through auxiliary controls, allowing users to use voice control anytime and anywhere. The shortcomings of inaccurate / slow recognition of voice controls are compensated by physical controls, which greatly expands the application scope of voice control.

[0123] For the specific limitations of the remote control-based voice control system, please refer to the limitations of the remote control-based voice control method above and will not be repeated here. Each module in the above-mentioned remote control-based voice control system can be implemented in whole or in part through software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the computer device in hardware form, or can be stored in the memory of the computer device in software form, so that the processor can call and execute the corresponding operations of each of the above modules.

[0124] In one embodiment, a computer device is provided. The computer device may be a terminal device, and its internal structure diagram may be as follows: Figure 4 As shown. The computer device includes a processor, a memory, and a network interface connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a readable storage medium. The readable storage medium stores computer-readable instructions. The network interface of the computer device is used to communicate with an external terminal via a network connection. When the computer-readable instructions are executed by the processor, a voice control method based on a remote control is implemented. The readable storage medium provided in this embodiment includes a non-volatile readable storage medium and a volatile readable storage medium.

[0125] In an embodiment of the present application, a computer device is provided, comprising a memory, a processor, and computer-readable instructions stored in the memory and executable on the processor. When the processor executes the computer-readable instructions, the steps of the remote control-based voice control method as described above are implemented.

[0126] In an embodiment of the application, a readable storage medium is provided, which stores computer-readable instructions. When the computer-readable instructions are executed by a processor, the steps of the voice control method based on the remote control as described above are implemented.

[0127] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through computer-readable instructions. The computer-readable instructions can be stored in a non-volatile readable storage medium or a volatile readable storage medium. When the computer-readable instructions are executed, they can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0128] Those skilled in the art will clearly understand that for the sake of convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0129] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention, and should all be included in the scope of protection of the present invention.

Claims

1. A voice control system based on a remote controller, characterized in that: Applied to a remote controller, the system comprises: The voice module includes a voice acquisition module and a voice command recognition module, wherein the voice acquisition module is used to acquire voice data, and the voice command recognition module is used to compare the voice data in different environments with a plurality of pre-stored voice control instructions and output a target voice control instruction; Physical controls, used to generate physical control instructions; The controller is electrically connected to the voice module and the physical control, respectively, and is used to control the controlled device based on the target voice control instruction and / or the physical control instruction according to the current working state of the voice command recognition module.

2. The voice control system based on the remote controller as claimed in claim 1, characterized in that: The controller is also used to store the voice data as a resource file; The system further comprises: The voice broadcast module electrically connected to the controller is used to extract the voice data to be played from the resource file based on the target voice control instruction or the physical control instruction, and play the voice data.

3. The voice control system based on the remote controller as claimed in claim 1, characterized in that: The controller is also used for: Construct a recognition and comparison command library and a voiceprint library of the voice command recognition module. Each voice command in the recognition and comparison command library is a voice command collected by the user through the voice collection module and customized. The voiceprint library is an item that can be customized by the user.

4. The voice control system based on the remote controller as claimed in claim 1, characterized in that: The controller is further used for: Establishing an associated control relationship between voice control instructions and control instructions, where a physical control is bound to multiple voice control instructions as a multi-source control, and the multi-source control is used to jointly control a controlled object; Converting the target voice control instruction into a first control device identification value, and converting the physical control instruction into a second control device identification value; When the voice command recognition module is in the awake state, the corresponding operation is jointly controlled based on the changes of the first control recognition value and the second control device recognition value.

5. The voice control system based on the remote controller as claimed in claim 4, characterized in that: The controller is further used for: Monitor all changes in the first control device identification value and the second control device value: When the value of the first control device changes, it immediately responds to the changed value. When the second control device recognizes that the value change exceeds a preset misoperation region, it immediately responds to the changed value.

6. The voice control system based on the remote controller as claimed in claim 4, characterized in that: The controller is further used for: When the voice command recognition module is in a closed or dormant state, a corresponding control operation is performed based on the recognition value of the second control device. At this time, the module no longer monitors changes beyond the error operation area before responding, but responds to changes immediately.

7. The voice control system based on the remote controller as claimed in claim 1, characterized in that: The system further comprises: A display screen electrically connected to the controller, used to display a command configuration interface to instruct a user to input corresponding command configuration parameters and display the command configuration results; The display screen is also used to obtain an operation request sent by a user to add, modify or delete the command configuration result, and display the result after the operation in the command configuration interface; Set the voice command recognition matching accuracy and whether to match the voiceprint in different environments.

8. The voice control system based on the remote controller as claimed in claim 1, characterized in that: The controller is used to: Set the wake-up method to a specific wake-up word or physical control command; The current scene is obtained, and based on the current scene, the voice control function is turned on or off through a wake-up word or by controlling a predefined physical control.

9. The voice control system based on the remote controller as claimed in claim 1, characterized in that: The controller is further used to determine control channel information according to the target voice control instruction or the physical control instruction; The system further comprises: The first communication module electrically connected to the controller is used to send the corresponding control channel information to the second communication module of the controlled device, so that the controlled device performs the corresponding function control operation according to the control channel information.

10. A voice control method based on a remote controller, characterized in that: Applied to a remote controller, the method comprises: Collect voice data; Comparing the voice data in different environments with pre-stored voice commands, and when the comparison is successful, obtaining the target voice control instruction; Generate physical control instructions; The controlled device is controlled based on the target voice control instruction and / or the target control instruction.

Images