Man-machine interaction type handheld intelligent controller based on offline voice recognition module
By integrating offline voice recognition module on the gamepad, real-time settings of voice commands for peripheral devices are achieved, which solves the problem of limited number of real-time settings functions of existing gamepads, and significantly improves the user experience.
Patent Information
- Application Number
- CN202420600109.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-26
- Publication Date
- 2025-03-07
- Estimated Expiration
- 2034-03-26
AI Technical Summary
The number of real-time settings functions during the game process is limited, which affects the user experience.
Using a human-computer interactive handheld intelligent controller based on offline voice recognition module, peripheral devices are set up through voice commands to achieve real-time adjustments.
It achieves a real-time setting of far exceeding the existing button switches, improving the user experience, and users can seamlessly make a variety of settings during the game.
Smart Images

Figure CN222566777U_ABST
Abstract
Description
Technical Field
[0001] The utility model belongs to the technical field of rocker controllers, in particular to a human-computer interactive handheld intelligent controller based on an off-line voice recognition module. Background Art
[0002] Various handheld smart controllers, also known as game handles, are usually equipped with a computer software or mobile phone software to set the lighting, vibration intensity, switch connection modes, switch joystick sensitivity, somatosensory auxiliary function switches, switch game consoles, etc., to achieve the best adaptation to the user's personality or game scene. However, the software settings can only be performed after the game is over. Some adjustments during the game, such as when connecting to a game console via Bluetooth for entertainment activities, require vibration intensity adjustment or use of the somatosensory (gyroscope) switch. Using software settings will greatly affect the user's gaming experience.
[0003] The existing technology is mainly carried out through key switches, such as adding a somatosensory switch, or using a combination of keys for operation. The existing game controller has its real-time setting part integrated on the handle shell, which is controlled by touching the button or using a dial switch. Due to space limitations, too many buttons cannot be set, usually no more than 3, resulting in a limited number of controllable functions. There is also a way to use a combination of keys for setting, but if the number of buttons is too large, it will cause confusion in operation and affect the user experience. Therefore, it is necessary to make changes. Utility Model Content
[0004] In view of the technical problem that the number of functions that can be set in real time on the above-mentioned game controller is too small, the purpose of the utility model is to provide a handheld intelligent controller with human-computer interaction based on an offline voice recognition module, which can realize real-time settings far exceeding the number of existing button switches.
[0005] The utility model is a handheld intelligent controller based on human-computer interaction of an offline speech recognition module, comprising:
[0006] Controller master;
[0007] A peripheral device, the peripheral device is connected to the controller master for communication;
[0008] An offline voice recognition module capable of configuring the peripheral device, the offline voice recognition module being in communication connection with the controller master;
[0009] A recording device is integrated in the offline speech recognition module.
[0010] Preferably, the controller main control of the handheld intelligent controller is connected to the game terminal for data communication.
[0011] Preferably, the gaming terminal includes a PC gaming terminal and / or a console gaming terminal.
[0012] Preferably, the controller main control is connected to the configuration software end in data communication.
[0013] Preferably, the mode for data communication between the controller main control and the game terminal is selected from one or more of USB, 2.4G receiver, classic Bluetooth and low-power Bluetooth.
[0014] Preferably, the mode of data communication between the controller main control and the configuration software end is selected from USB and 2.4G receiver.
[0015] Preferably, the recording device is selected from one or more of a microphone and a speaker.
[0016] Preferably, the peripheral device is selected from one or more of: a gyroscope, a joystick, a trigger and buttons, and the buttons include ABXY buttons, a cross button, a back button and a shoulder button.
[0017] Preferably, the handheld intelligent controller further comprises a vibration motor and / or an indicator light, wherein the vibration motor is connected to the controller main control PWM control, and the indicator light is connected to the controller main control single IO communication.
[0018] Preferably, the offline speech recognition module includes a processor chip and an offline command vocabulary.
[0019] The positive and progressive effects of the utility model are:
[0020] 1) The handheld intelligent controller of the utility model adds an offline voice recognition module, which can collect voice commands to set peripheral devices. Compared with the existing controllers that are directly set by configuring software, the handheld intelligent controller can achieve real-time settings, that is, users can set while playing games without other additional operations.
[0021] 2) Compared with the existing real-time setting methods such as touch buttons or dip switches, the offline voice recognition module of the handheld intelligent controller of the utility model can achieve a number limit far exceeding the existing real-time setting method of button switches, that is, more and more diverse settings can be made without being limited by the space size on the handheld intelligent controller, and it is not easy to cause operational confusion, which greatly improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 It is a functional block diagram of the utility model;
[0023] Figure 2 It is a functional block diagram of an offline speech recognition module;
[0024] Figure 3 It is a functional block diagram of the prior art. DETAILED DESCRIPTION
[0025] The following is an explanation of the implementation of the present invention through specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific implementations, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention.
[0026] like Figure 1 As shown in the functional block diagram, the handheld intelligent controller based on offline voice recognition module human-computer interaction of the utility model includes a controller main control 11, a peripheral device 12, an offline voice recognition module 13 and a recording device 14. Among them, the controller main control 11 is the core part of the handheld intelligent controller, which can execute various operation commands to realize the control of the game. The controller main control 11 is an existing main control chip, for example, a controller main control of model TLSR9517 from Tailing Microelectronics (Shanghai) Co., Ltd. The peripheral device 12 is communicatively connected with the controller main control 11, and is used to send operation instructions to the controller main control 11, thereby realizing the operation control of the game. Furthermore, the peripheral device 12 is selected from one or more of a gyroscope, a joystick, a trigger and a button, wherein the button also includes an ABXY button, a cross button, a back button and a shoulder button. The offline voice recognition module 13 is connected to the controller main control 11 for communication. The offline voice recognition module 13 is used to recognize voice signals and output the signals to the controller main control 11, so as to set the peripheral device 12, and then realize the effect of voice control and executing operation instructions, such as setting the joystick dead zone size, gyroscope switch, indicator light on and off, switch somatosensory function, vibration intensity, joystick sensitivity, etc., especially in real-time adjustment of switch somatosensory function, vibration intensity, joystick sensitivity human-computer interaction means. The manufacturer of the offline voice recognition module 13 is Guangzhou WeiChuang Electronics Co., Ltd., the offline voice recognition module model is WTK6900FC. Figure 2 As shown, the offline speech recognition module 13 includes a processor chip 131 and an offline command vocabulary 132. The offline command vocabulary 132 is shown in Table 1, for example.
[0027] Table 1 Offline command word library 132 of the offline speech recognition module 13
[0028]
[0029]
[0030]
[0031]
[0032]
[0033] In this example, the recording device 14, such as one or more of a microphone and a handset, has a conventional ordinary interface and is integrated in the offline voice recognition module 13. It can collect the user's voice commands in real time and transmit the voice commands to the offline voice recognition module 13. The offline voice recognition module 13 recognizes the collected voice signals and transmits them to the controller main control 11, and then sets the peripheral device 12 to realize the voice setting of the handheld intelligent controller.
[0034] In this example, continue as Figure 1 As shown, the controller main control 11 of the handheld intelligent controller is connected to the game terminal for data communication. Furthermore, the game terminal includes a PC game terminal 151 and / or a host game terminal 152, which is used to receive and display the operation commands of the controller main control 11, and is a platform for users to conduct entertainment activities, thereby realizing the function of human-computer interaction. The mode of data communication between the controller main control 11 and the game terminal is selected from one or more of USB, 2.4G receiver, classic Bluetooth and low-power Bluetooth, and the data communication connection mode between the controller main control 11 and the game terminal can be controlled and switched by the offline voice recognition module 13, so as to realize efficient human-computer interaction function and enhance user experience.
[0035] In a further example, the controller main control 11 of the handheld intelligent controller can also be connected to the configuration software end 16 for data communication. For example, the configuration software is installed on a computer or a mobile phone, and the mode of data communication between the controller main control 11 and the configuration software end 16 is selected from one or more of USB and 2.4G receivers. The configuration software end 16 can also set the peripheral device 12, such as setting the size of the joystick dead zone, the switch of the gyroscope, the on and off of the indicator light, the switch somatosensory function, the vibration intensity, the sensitivity of the joystick, etc., but in terms of real-time adjustment, the user experience is far inferior to the offline voice recognition module 13. In addition, the configuration software end 16 can also set the controller main control 11 so that it can receive or not receive the setting content from the offline voice recognition module 13, that is, the configuration software end 16 can configure the function of turning on and off the offline voice recognition module 13 as a whole, to prevent similar or identical semantics from causing recognition errors under special circumstances, which greatly improves the user experience. That is, if the configuration software end 16 turns off the offline voice recognition module 13 as a whole, the configuration software end 16 can set the peripheral device 12 or directly set the peripheral device 12 by manual button mode, thereby realizing operation control of the controller main control 11 and making corresponding operation commands; if the configuration software end 16 turns on the offline voice recognition module 13 as a whole, the offline voice recognition module 13 can set the peripheral device 12, thereby realizing real-time setting of the controller main control 11.
[0036] Continue as Figure 1 As shown, the handheld intelligent controller also includes a vibration motor 17 and / or an indicator light 18, wherein the vibration motor 17 is connected to the controller main control 11 via PWM control, and the indicator light 18 is connected to the controller main control 11 via a single IO communication, and is used to provide feedback after the voice signal is recognized and executed, that is, to indicate whether the voice is set successfully through the vibration of the vibration motor 17 and the flashing of the indicator light 18.
[0037] Compared with the handheld intelligent controller of the utility model, Figure 3The existing controller shown has the following advantages: First, the handheld intelligent controller can set the peripheral device 12 through the offline voice recognition module 13, and then execute various operation instructions. Compared with the existing controller that only sets the peripheral device 12 through the configuration software 16, the handheld intelligent controller can set the peripheral device 12 in real time during the user's game activities, and set it while the game is in progress without stopping the game or performing additional operations after the game is over. Second, compared with the existing real-time setting method such as touching buttons or dial switches, the handheld intelligent controller can set the peripheral device 12 through the offline voice recognition module 13, which can achieve a number limit far exceeding the existing real-time setting method of key switches, that is, it can perform more and more diverse settings. For example, the number of setting items for the peripheral device 12 of the offline voice recognition module 13 can be from 100+ to infinity, without being limited by the space size on the handheld intelligent controller, and it is not easy to cause operation confusion, which greatly improves the user experience.
[0038] The utility model is described in detail above in conjunction with the embodiments of the drawings. A person skilled in the art can make various variations of the utility model according to the above description. Therefore, some details in the embodiments should not constitute a limitation of the utility model, and the utility model shall be protected within the scope defined by the attached claims.
Claims
1. A handheld intelligent controller based on human-computer interaction with an offline speech recognition module, characterized in that: The handheld intelligent controller comprises: Controller master; A peripheral device, the peripheral device is connected to the controller master for communication; An offline voice recognition module capable of configuring the peripheral device, the offline voice recognition module being in communication connection with the controller master; A recording device is integrated in the offline speech recognition module.
2. The handheld intelligent controller based on human-computer interaction of offline speech recognition module as claimed in claim 1, characterized in that: The controller master of the handheld intelligent controller is connected with the game terminal for data communication.
3. The handheld intelligent controller based on human-computer interaction of offline speech recognition module as claimed in claim 2, characterized in that: The game terminal includes a PC game terminal and / or a host game terminal.
4. The handheld intelligent controller based on human-computer interaction of offline speech recognition module as claimed in claim 1, characterized in that: The controller main control is connected with the configuration software end in data communication.
5. The handheld intelligent controller based on human-computer interaction of offline speech recognition module as claimed in claim 2, characterized in that: The method for data communication between the controller main control and the game terminal is selected from one or more of USB, 2.4G receiver, classic Bluetooth and low-power Bluetooth.
6. The handheld intelligent controller based on human-computer interaction of offline speech recognition module as claimed in claim 4, characterized in that: The mode of data communication between the controller main control and the configuration software end is selected from USB and 2.4G receiver.
7. The handheld intelligent controller based on human-computer interaction of offline speech recognition module as claimed in claim 1, characterized in that: The recording device is selected from one or more of a microphone and a handset.
8. The handheld intelligent controller based on human-computer interaction of offline speech recognition module as claimed in claim 1, characterized in that: The peripheral device is selected from: one or more of a gyroscope, a joystick, a trigger and buttons, and the buttons include ABXY buttons, a cross button, a back button and a shoulder button.
9. The handheld intelligent controller based on human-computer interaction of offline speech recognition module as claimed in claim 1, characterized in that: The handheld intelligent controller also includes a vibration motor and / or an indicator light. The vibration motor is connected to the controller main control PWM control, and the indicator light is connected to the controller main control single IO communication.
10. The handheld intelligent controller based on human-computer interaction of offline speech recognition module as claimed in claim 1, characterized in that: The offline speech recognition module includes a processor chip and an offline command vocabulary.