Intelligent handle and interaction method thereof

Abstract

The intelligent gamepad and the interaction method thereof are applied to the intelligent gamepad, the voice data of the target user are received, intention analysis is carried out, the control instruction is obtained, and control operation can be carried out on the current game process or external equipment. And through the screen module and / or the sound interaction module arranged on the gamepad, the target user can obtain the state of the operation completed by the control instruction. The use scene of the gamepad is further broadened, the user experience of players in the game process is improved, the players can achieve part of auxiliary operation in the gamepad by making voice, the players can be helped to play games better, and the entry threshold is lowered; and feedback can be sent out through operation of the player, so that the accompanying feeling to the player in the playing process is enhanced.

Description

Technical Field

[0001] The present application relates to the field of smart handles, and in particular to a smart handle and an interaction method thereof. Background Art

[0002] Game controllers are a common component of electronic game consoles, mainly used to control electronic games. There are many types of game controllers, such as wired and wireless controllers according to the connection method, and game console controllers, PC game controllers, and mobile game controllers according to the applicable platform. Their main function is to provide players with convenient and accurate game operation methods, enhancing the fun and immersion of games.

[0003] Traditional game controllers are used to play games through buttons on the controllers, and some game controllers have restrictions on the number of buttons. For games that require input of text commands or execution of specific combination operations, the operations players need to perform using the controller are relatively cumbersome and time-consuming. This has a high operating threshold for players who are not familiar with device operation and has a great impact on the player's gaming experience. Summary of the invention

[0004] In view of this, the present invention proposes a smart handle and an interaction method thereof, and the specific scheme is as follows:

[0005] In a first aspect, an interaction method of a smart handle is proposed, which is applied to a game handle, wherein a screen module and a sound interaction module are provided on the game handle, and the game handle is communicatively connected with one or more external devices; the method comprises:

[0006] The voice interaction module receives the voice data of the target user;

[0007] Analyze the intention of voice data and obtain control instructions;

[0008] When the control instruction is related to the current game process, a handle operation corresponding to the control instruction is determined, and the determined handle operation is performed on the game handle based on the control instruction;

[0009] When the control instruction is not related to the current game process, the external device and the control operation corresponding to the control instruction are determined, and the control operation is performed on the determined external device based on the control instruction;

[0010] The screen module and / or the sound interaction module provide feedback to the target user on the completed operation status based on the control instruction.

[0011] In some specific embodiments, the handle operation includes game content operation and game companion operation;

[0012] The game content operation includes: communicating with the server and / or game device of the current game process, and automatically executing the game operation corresponding to the control instruction for the current game process according to the game rules of the current game process;

[0013] Game accompaniment operations include: continuously obtaining the game operations completed by the target user on the game controller, and providing feedback on the game operations completed by the target user through the screen module and / or the sound interaction module; and / or analyzing the current game process to obtain game operation instructions, and presenting the game operation instructions to the target user through the screen module and / or the sound interaction module.

[0014] In actual applications, the game companion operation can be, for example, obtaining a game operation completed by the user on the handle and then giving feedback to the target user on the game operation. Such feedback can be encouragement or evaluation of the target user through the sound interaction module, or through displaying animations or subtitles in the screen module. Furthermore, the game companion operation can also be presented in the form of a game strategy, by analyzing the current game process to obtain game operation instructions, which can be by displaying a graphic prompt screen on the screen module or by indicating the target user's next operation through the sound interaction module to help the target user play the game, such as prompting the target user to click somewhere in the game map or prompting the user to complete the game task by launching a certain skill at a certain time.

[0015] In some specific embodiments, the handle operation includes a game device operation, and the game device operation includes:

[0016] Query the device configuration data of the game controller, and adjust the device configuration data of the game device accordingly according to the control instructions;

[0017] The device configuration data of the game controller includes: controller operation mode configuration, and / or controller button configuration, and / or controller volume configuration, and / or controller screen brightness configuration, and / or controller vibration configuration.

[0018] In some specific embodiments, determining an external device and a control operation corresponding to the control instruction, and performing the control operation on the determined external device based on the control instruction includes:

[0019] Get a list of all external devices that are within the communication connection range of the game controller and are connected to the game controller;

[0020] Determine the external device corresponding to the control instruction in the list according to the subject of the control instruction, and communicate with the determined external device;

[0021] Executes control operations on the specified external device.

[0022] In actual applications, users usually use game controllers to play games indoors. In addition to the game controllers, multiple external devices that can communicate with the game controllers can also be set up indoors. In a specific embodiment, the external devices include smart home facilities, such as air conditioners, fans, televisions, lamps, curtains, sweeping robots, etc. By communicating with the game controllers, users can adjust and control the smart home facilities by speaking to the game controllers while using the game controllers.

[0023] In some specific embodiments, the control operation includes adjusting device configuration data of the external device accordingly according to the control instruction and the adjustment rule of the external device;

[0024] The device configuration data of the external device includes: device operation mode configuration, and / or device volume configuration, and / or device screen configuration, and / or device brightness configuration, and / or device temperature configuration, and / or device movement configuration.

[0025] In some specific embodiments, the method further includes: analyzing the intention of the voice data to obtain a query instruction;

[0026] Search the topic of the inquiry instruction in the preset corpus database;

[0027] When there is corpus corresponding to the topic, generate answers based on the corpus, and present the answers through a screen module and / or a voice interaction module;

[0028] When there is no corpus corresponding to the topic, the pre-trained neural network model is used to understand the semantics of the topic of the query instruction and generate an answer; or external resources are retrieved for the topic of the query instruction to generate an answer;

[0029] The responses are presented via a screen module and / or a voice interaction module.

[0030] In actual applications, when the intention of the voice data is analyzed and it is found that the intention of the voice data is to inquire about a certain issue, and this inquiry is unrelated to the current game process and the control adjustment of external devices, then it can be determined as an inquiry instruction. For this inquiry instruction, the answer can be retrieved through a preset corpus database, or it can be generated based on the analysis of a neural network model or the retrieval of external resources.

[0031] Therefore, when the voice data is analyzed and an unexecutable instruction is obtained, it is converted into an inquiry instruction, and the pre-trained neural network model is used to understand the subject of the inquiry instruction semantically and generate an answer; or the subject of the inquiry instruction is retrieved from external resources to generate an answer. For example, through the retrieval of external resources and the pre-trained neural network model, the reason why the instruction to adjust the temperature of the TV cannot be implemented can be further obtained, and the target user can be explained, and then the target user can be guided to re-input the voice data.

[0032] In some specific embodiments, it also includes:

[0033] The corresponding interactive image is presented on the screen module according to the selection of the target user; the interactive image is used to feedback the completed operation status based on the control instruction to the target user through the screen module and / or the sound interaction module;

[0034] The interactive image includes a preset image selected from a preset image library and / or a custom image set according to the needs of the target user;

[0035] Each preset image corresponds to a preset image system; each custom image corresponds to a custom image system obtained based on the target user's settings;

[0036] The image system includes an appearance database, and / or a voice database, and / or a personality database.

[0037] In actual applications, the game controller can display multiple different interactive images on the screen module for the target user to choose and present. Among them, the interactive image can be a two-dimensional animated image or a three-dimensional animated image with animation and action. These interactive images can be pre-set or set by the target user in the image system according to his or her own preferences.

[0038] In some specific embodiments, it also includes:

[0039] The voice data, control instructions, handle operations and feedback to the target user obtained by the game controller within a preset time period are stored to obtain historical interaction data;

[0040] Regularly analyze one or more segments of historical interaction data to obtain user preferences, and update the user preferences to the user profile corresponding to the target user;

[0041] The image system of the interactive image is adjusted according to the latest user portrait to change the picture style fed back to the target user through the screen module; and / or change the sound style fed back to the target user by the sound interaction module.

[0042] Analyzing one or more segments of historical interaction data can be to analyze the categories and contents of control commands frequently raised by target users, the games frequently played by target users, the game character configurations commonly used by target users, the game buttons commonly used on the game controller, etc., to obtain user preferences. By adjusting the image system of the interactive image according to the updated user portrait, the familiarity of the same interactive image to the target user can be continuously increased as the length of time spent with the target user increases. The same voice data issued by the same target user when using the game controller for different lengths of time may have different feedback, which can enrich the interactive image's interaction with the target user and give the target user a stronger sense of companionship and growth.

[0043] In some specific embodiments, before receiving the voice data of the target user, the method further includes:

[0044] Provide registration for the user, receive the user's voice data for the first time through the voice interaction module, obtain voiceprint features based on the voice data, and authenticate the user as the target user based on the voiceprint features;

[0045] The voice interaction module receives the target user's voice data and also includes:

[0046] Receive the user's voice data through the voice interaction module, pre-process the voice data, extract the voiceprint features in the voice data, and match the voiceprint features with the authenticated target user;

[0047] If they match, proceed to the next step; if they do not match, the user is prompted to re-enter the voice data, or prompted to register until the user's voiceprint features match the authenticated target user.

[0048] By providing user registration and matching the target user with the voiceprint feature one by one, a unique interaction method can be established between the target user and the game controller. In an actual application process, the target user can set the interactive image that corresponds to him / her uniquely on the screen module, and can also set that other users cannot evoke this interactive image except the target user. This can ensure that the historical interaction data generated between the target user and the interactive image is for the unique target user with this voiceprint feature, ensuring the one-to-one correspondence between the user portrait and the target user, and the analysis of the user portrait is more accurate. At the same time, it can also effectively improve the data security of the game controller, so that the user preferences and other personal data of the target user will not be easily leaked.

[0049] In actual use, one interactive image may correspond to multiple target users. For example, in a family unit, different family members can be different target users. Each target user has a corresponding user portrait, and the interactive information can distinguish and identify them. Each family member can interact with the interactive image after being authenticated by his or her voiceprint features, and the interactive image can give different feedback to the voices made by different family members through the difference in voiceprint features.

[0050] In a second aspect, a smart handle is proposed, which is applicable to an interaction method of any smart handle in the aforementioned technical solution, including:

[0051] A screen module is used to provide feedback to the target user on the completed operation status based on the control instruction through screen output or text output;

[0052] The voice interaction module includes a speaker and a microphone; the microphone is used to receive the voice data of the target user, and the speaker is used to feedback the completed operation status based on the control instruction to the target user through voice output;

[0053] A main control module, which is communicatively connected to the screen module and the sound interaction module, and is used to analyze the intent of the voice data and obtain control instructions; when the control instruction is related to the current game process, the main control module is used to determine the handle operation corresponding to the control instruction, and execute the determined handle operation on the game handle based on the control instruction; when the control instruction is not related to the current game process, the main control module is used to determine the external device and control operation corresponding to the control instruction, and execute the control operation on the determined external device based on the control instruction.

[0054] Beneficial effects: This application proposes a smart controller and its interaction method, which can receive the target user's voice data and perform intent analysis to obtain control instructions, thereby realizing control operations on the current game process or external devices, and the target user can obtain the status of the operation completed by the control instruction through the screen module and / or sound interaction module of the game controller. It further broadens the use scenarios of the game controller and improves the user experience of players during the game. Players can implement some auxiliary operations in the game controller by emitting voice, which can help players play the game better. It can also provide feedback on the player's operation to enhance the player's sense of companionship and fun during the game. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0056] Figure 1 Schematic diagram of the steps of the method of the present invention;

[0057] Figure 2 It is a schematic diagram of some steps of the method of the present invention;

[0058] Figure 3 Another partial step schematic diagram of the method of the present invention;

[0059] Figure 4 Another schematic diagram of the steps of the method of the present invention;

[0060] Figure 5 Another schematic diagram of the steps of the method of the present invention;

[0061] Figure 6 The figure is a schematic diagram of the connection relationship of the modules of the game controller in the present invention.

[0062] Figure numerals: 1-main control module; 2-screen module; 3-sound interaction module; 31-speaker; 32-microphone. DETAILED DESCRIPTION

[0063] In the following, various embodiments of the present disclosure will be described more fully. The present disclosure may have various embodiments, and adjustments and changes may be made therein. However, it should be understood that there is no intention to limit the various embodiments of the present disclosure to the specific embodiments disclosed herein, but rather the present disclosure should be understood to cover all adjustments, equivalents and / or alternatives that fall within the spirit and scope of the various embodiments of the present disclosure.

[0064] The terms used in the various embodiments disclosed in the present invention are only used for the purpose of describing specific embodiments and are not intended to limit the various embodiments disclosed in the present invention. As used herein, the singular form is intended to also include the plural form, unless the context clearly indicates otherwise. Unless otherwise specified, all terms used herein (including technical terms and scientific terms) have the same meaning as the meanings commonly understood by those of ordinary skill in the art to which the various embodiments disclosed in the present invention belong. Terms (such as terms defined in generally used dictionaries) will be interpreted as having the same meaning as the contextual meaning in the relevant technical field and will not be interpreted as having an idealized meaning or an overly formal meaning, unless clearly defined in the various embodiments disclosed in the present invention.

[0065] Example 1

[0066] This embodiment proposes an interaction method of a smart handle, which is applied to a game handle, as follows:

[0067] The game controller is provided with a screen module 2 and a sound interaction module 3, and the game controller is connected to one or more external devices for communication; Figure 1 As shown, the method includes:

[0068] S100, the voice interaction module 3 receives the voice data of the target user;

[0069] S200, analyzing the intention of the voice data to obtain a control instruction;

[0070] S210: When the control instruction is related to the current game process, determining a handle operation corresponding to the control instruction, and performing the determined handle operation on the game controller based on the control instruction;

[0071] S220: When the control instruction is not related to the current game process, determining an external device and a control operation corresponding to the control instruction, and performing the control operation on the determined external device based on the control instruction;

[0072] S230, feeding back the completed operation status based on the control instruction to the target user through the screen module 2 and / or the sound interaction module 3.

[0073] In actual applications, the screen module 2 can provide feedback to the target user on the completion status of the control command through animation, and / or virtual animated images, and / or subtitles; the sound interaction module 3 can provide feedback to the target user by emitting prompt sounds, and / or prompt music, and / or the voice of a virtual animated image, and can also provide tactile feedback to the target user through the vibration of the game controller.

[0074] In some specific embodiments, the handle operation in step S210 includes game content operation and game companion operation;

[0075] The game content operation includes: communicating with the server and / or game device of the current game process, and automatically executing the game operation corresponding to the control instruction for the current game process according to the game rules of the current game process;

[0076] The game accompaniment operation includes: continuously obtaining the game operations completed by the target user on the game controller, and providing feedback on the game operations completed by the target user through the screen module 2 and / or the sound interaction module 3; and / or analyzing the current game process to obtain game operation instructions, and presenting the game operation instructions to the target user through the screen module 2 and / or the sound interaction module 3.

[0077] In actual applications, game content operations can be an auxiliary game operation within the game rules. For example, if the target user's voice data intends to release a skill in the current game process, the operation of helping the target user release the skill can be achieved by communicating with the server and / or game device of the current game process. Auxiliary game operations can also be operations such as calling game auxiliary props such as calculators, timers, and magnifying glasses for the target user in decryption games. By assisting the target user in performing game content operations, effective assistance can be provided to the target user when the game controller does not have enough keys and the target user does not have enough time to operate.

[0078] The game accompaniment operation can be, for example, obtaining a game operation completed by the user on the handle and then giving feedback to the game operation of the target user. The feedback can be encouragement or evaluation to the target user through the sound interaction module 3, or through displaying animation or subtitles in the screen module 2.

[0079] Furthermore, the game accompaniment operation can also be presented in the form of a game guide. By analyzing the current game process, the game operation guidance can be obtained. It can be by displaying a graphic prompt screen on the screen module 2 or instructing the target user's next operation through the sound interaction module 3 to help the target user play the game, such as prompting the target user to click somewhere in the game map or prompting the user to complete the game task by activating a certain skill at a certain time.

[0080] In some specific embodiments, the handle operation in step S210 also includes a game device operation, and the game device operation includes:

[0081] Query the device configuration data of the game controller, and adjust the device configuration data of the game device accordingly according to the control instructions;

[0082] The device configuration data of the game controller includes: controller operation mode configuration, and / or controller button configuration, and / or controller volume configuration, and / or controller screen brightness configuration, and / or controller vibration configuration.

[0083] In this way, the target user can adjust the device configuration of the game controller through voice. For example, in an actual application process, the target user utters a voice message "increase the brightness of the controller screen". After the intention of this voice data is recognized, a control instruction is obtained that is intended to adjust the brightness parameters in the device configuration data of the game controller. The game controller can adjust the brightness of the screen module 2 by executing this control instruction, which can further improve the target user's gaming experience using the game controller.

[0084] In some specific embodiments, Figure 2 As shown, in step S220, determining the external device and the control operation corresponding to the control instruction, and performing the control operation on the determined external device based on the control instruction includes:

[0085] S221, obtaining a list of all external devices that are within the communication connection range of the game controller and are in communication connection with the game controller;

[0086] S222, determining an external device corresponding to the control instruction in the list according to the subject of the control instruction, and communicating with the determined external device;

[0087] S223: Execute a control operation on the determined external device.

[0088] In actual applications, users usually use game controllers to play games indoors. In addition to the game controllers, multiple external devices that can communicate with the game controllers can also be set up indoors. In a specific embodiment, the external devices include smart home facilities, such as air conditioners, fans, televisions, lamps, curtains, sweeping robots, etc. By communicating with the game controllers, users can adjust and control the smart home facilities by speaking to the game controllers while using the game controllers.

[0089] In a specific embodiment, the intent of the voice data is analyzed, and when it is found that it includes the intention to control external devices such as home facilities, it can be confirmed as a control instruction, and this control instruction is irrelevant to the current game process. Furthermore, communication is established with the corresponding external device based on the content of this control instruction, and the external device is adjusted accordingly.

[0090] It should be noted that the process of analyzing the intention of voice data also includes the analysis of its executableness. Only when this intention is actually executable can it be confirmed as a control instruction. For example, in an actual application process, the user utters a voice "lower the temperature of the TV". After analyzing and retrieving the intention of this voice, it can be found that the TV does not have a corresponding temperature option to adjust. Therefore, the instruction issued by the user is not executable and cannot be converted into a corresponding control instruction. Therefore, when the voice data is analyzed and an unexecutable instruction is obtained, the game controller can send feedback to the target user through the screen module 2 and / or the sound interaction module 3 to prompt the target user to re-input the voice data.

[0091] In some specific embodiments, the control operation includes adjusting device configuration data of the external device accordingly according to the control instruction and the adjustment rule of the external device;

[0092] The device configuration data of the external device includes: device operation mode configuration, and / or device volume configuration, and / or device screen configuration, and / or device brightness configuration, and / or device temperature configuration, and / or device movement configuration.

[0093] In some specific embodiments, Figure 3 As shown, it also includes:

[0094] S300, analyzing the intention of the voice data to obtain an inquiry instruction;

[0095] S310, searching the subject of the inquiry instruction in a preset corpus database;

[0096] S320, when there is corpus corresponding to the topic, generate an answer based on the corpus, and present the answer through the screen module 2 and / or the sound interaction module 3;

[0097] S330, when there is no corpus corresponding to the subject, using a pre-trained neural network model to semantically understand the subject of the inquiry instruction and generate an answer; or searching external resources for the subject of the inquiry instruction and generating an answer;

[0098] S340, presenting the answer through the screen module 2 and / or the sound interaction module 3.

[0099] In actual applications, when the intent of the voice data is analyzed and it is found that the intent of the voice data is directed to an inquiry about a certain issue, and this inquiry is not related to the current game process, nor to the control adjustment of external devices, it can be determined as an inquiry instruction. For this inquiry instruction, the answer can be retrieved through a preset corpus database, or it can be generated based on the analysis of a neural network model or the retrieval of external resources. For example, when the target user asks "What new games have been released recently", this is a question about current affairs. At this time, the answer to the target user's inquiry can be generated by retrieving, aggregating, analyzing and summarizing external network resources.

[0100] Furthermore, in an actual application process, the user utters a voice command "lower the temperature of the TV". After analyzing and retrieving the intention of this voice, it can be found that the TV does not have a corresponding temperature option to adjust. Therefore, the command issued by the user is not executable and cannot be converted into a corresponding control command. Therefore, it can be converted into an inquiry command, and the answer can be obtained through the processing flow of the inquiry command to provide feedback to the target user.

[0101] Therefore, when the voice data is analyzed and an unexecutable instruction is obtained, it is converted into an inquiry instruction, and the pre-trained neural network model is used to understand the subject of the inquiry instruction semantically and generate an answer; or the subject of the inquiry instruction is retrieved from external resources to generate an answer. For example, through the retrieval of external resources and the pre-trained neural network model, the reason why the instruction to adjust the temperature of the TV cannot be implemented can be further obtained, and the target user can be explained, and then the target user can be guided to re-input the voice data.

[0102] In some specific embodiments, it also includes:

[0103] The corresponding interactive image is presented on the screen module 2 according to the selection of the target user; the interactive image is used to feedback the completed operation status based on the control instruction to the target user through the screen module 2 and / or the sound interaction module 3;

[0104] Among them, the interactive image includes a preset image selected from a preset image library and / or a custom image set according to the needs of the target user; each preset image corresponds to a preset image system; each custom image corresponds to a custom image system obtained based on the target user's settings; the image system includes an appearance database, and / or a voice database, and / or a personality database.

[0105] In actual applications, the game controller can display multiple different interactive images on the screen module 2 for the target user to choose and present, where the interactive image can be a two-dimensional or three-dimensional virtual animation image with actions and expressions. These interactive images can be pre-set or set by the target user in the image system according to his or her own preferences.

[0106] In some specific embodiments, Figure 4 As shown, it also includes:

[0107] S400, storing the voice data, control instructions, handle operations and feedback to the target user obtained by the game handle within a preset time period to obtain historical interaction data;

[0108] S410, regularly analyzing one or more segments of historical interaction data to obtain user preferences, and updating the user preferences to the user profile corresponding to the target user;

[0109] S420, adjusting the image system of the interactive image according to the latest user portrait to change the picture style fed back to the target user through the screen module 2; and / or changing the sound style fed back to the target user by the sound interaction module 3.

[0110] Analyzing one or more segments of historical interaction data can be to analyze the categories and contents of control commands frequently raised by target users, games frequently played by target users, game character configurations commonly used by target users, and game buttons commonly used on game controllers, etc., to obtain user preferences. By adjusting the image system of the interactive image according to the updated user portrait, the familiarity of the same interactive image to the target user can be continuously increased as the length of time spent with the target user increases. The same voice data issued by the same target user when using the game controller for different lengths of time may have different feedback, which can enrich the interactive image's interaction with the target user, enable the target user to feel the changes in the interactive image's personality, and give the target user a stronger sense of companionship and growth, making it more interesting and entertaining.

[0111] In some specific embodiments, Figure 5 As shown, before receiving the voice data of the target user in step 100, the method further includes:

[0112] S000, providing registration for the user, receiving the user's voice data for the first time through the voice interaction module 3, obtaining voiceprint features according to the voice data, and authenticating the user as a target user according to the voiceprint features;

[0113] The voice interaction module 3 receives the voice data of the target user and further includes:

[0114] S101, receiving the user's voice data through the voice interaction module 3, preprocessing the voice data, extracting the voiceprint features in the voice data, and matching the voiceprint features with the authenticated target user;

[0115] S102, if it matches, proceed to the next step; if it does not match, prompt the user to re-enter the voice data, or prompt the user to register until the user's voiceprint feature matches the authenticated target user.

[0116] By providing user registration and matching the target user with the voiceprint feature one by one, a unique interaction method can be established between the target user and the game controller. In an actual application process, the target user can set the interactive image that corresponds to it uniquely on the screen module 2, and can also set that other users cannot evoke this interactive image except the target user. This can ensure that the historical interaction data generated between the target user and the interactive image is for the unique target user with this voiceprint feature, ensuring the one-to-one correspondence between the user portrait and the target user, and the analysis of the user portrait is more accurate. It can also effectively improve the data security of the game controller, so that the user preferences and other personal data of the target user will not be easily leaked; further, it can also prevent others from erroneously evoked the game controller.

[0117] In actual use, one interactive image may correspond to multiple target users. For example, in a family unit, different family members can be different target users. Each target user has a corresponding user portrait, and the interactive information can distinguish and identify them. Each family member can interact with the interactive image after being authenticated by his or her voiceprint features, and the interactive image can give different feedback to the voices made by different family members through the difference in voiceprint features.

[0118] This embodiment proposes an interactive method for a smart controller, which receives the target user's voice data and performs intent analysis to obtain control instructions, thereby realizing control operations on the current game process or external devices, and the target user can obtain the status of the operation completed by the control instructions through the screen module 2 and / or the sound interaction module 3 of the game controller. The use scenarios of the game controller are further broadened, and the user experience of the player during the game is improved. The player can implement some auxiliary operations in the game controller by emitting voice, which can help the player to play the game better. Further, by using interactive images to give feedback on the player's operation, the player's sense of companionship and growth during the game can be enhanced, which can effectively meet the various needs of the player in using the game controller.

[0119] Example 2

[0120] This embodiment discloses a smart handle, which can be used to implement any of the smart handle interaction methods in the above technical solutions. The specific module connection diagram is as follows: Figure 6 As shown, including:

[0121] Screen module 2, used for feeding back the completed operation status based on the control instruction to the target user through screen output or text output;

[0122] The voice interaction module 3 includes a speaker 31 and a microphone 32; wherein the microphone 32 is used to receive the voice data of the target user, and the speaker 32 is used to feedback the completed operation status based on the control instruction to the target user through voice output;

[0123] A main control module 1, which is communicatively connected to the screen module 2 and the sound interaction module 3, is used to analyze the intention of the voice data and obtain control instructions; when the control instruction is related to the current game process, the main control module 1 is used to determine the handle operation corresponding to the control instruction, and execute the determined handle operation on the game handle based on the control instruction; when the control instruction is not related to the current game process, the main control module 1 is used to determine the external device and control operation corresponding to the control instruction, and execute the control operation on the determined external device based on the control instruction.

[0124] This embodiment provides a game controller, which can receive the voice data of the target user, analyze the intention, and obtain the control instruction by setting the voice interaction module and the screen module connected with the main control module, so as to realize the control operation of the current game process or the external device, and the target user can obtain the status of the operation completed by the control instruction through the screen module and / or the voice interaction module of the game controller. Players can realize some auxiliary operations in the game controller by making voice, which can help players to play the game better. Further, by using interactive images to give feedback to the player's operation, the sense of companionship and growth of the player in the process of playing can be enhanced, which further broadens the use scenarios of the game controller and improves the user experience of the player in the game process.

[0125] Those skilled in the art will appreciate that the accompanying drawings are only schematic diagrams of a preferred implementation scenario, and the modules or processes in the accompanying drawings are not necessarily necessary for the implementation of the present invention. Those skilled in the art will appreciate that the modules in the devices in the implementation scenario can be distributed in the devices of the implementation scenario according to the description of the implementation scenario, or can be changed accordingly and located in one or more devices different from the present implementation scenario. The modules of the above-mentioned implementation scenarios can be combined into one module, or can be further divided into multiple sub-modules. The above-mentioned serial numbers of the present invention are only for description and do not represent the advantages and disadvantages of the implementation scenarios. Disclosed above are only a few specific implementation scenarios of the present invention, but the present invention is not limited thereto, and any changes that can be thought of by those skilled in the art should fall within the scope of protection of the present invention.

Claims

1. An interactive method of a smart handle, characterized in that: Applied to a game controller, the game controller is provided with a screen module and a sound interaction module, and the game controller is communicatively connected with one or more external devices; the method comprises: The voice interaction module receives voice data of the target user; Analyzing the intention of the voice data to obtain a control instruction; When the control instruction is related to the current game process, a handle operation corresponding to the control instruction is determined, and the determined handle operation is performed on the game controller based on the control instruction; When the control instruction is not relevant to the current game process, determining the external device and the control operation corresponding to the control instruction, and performing the control operation on the determined external device based on the control instruction; The operation status completed based on the control instruction is fed back to the target user through the screen module and / or the sound interaction module.

2. The interactive method of a smart handle according to claim 1, characterized in that: The handle operation includes game content operation and game companion operation; The game content operation includes: communicating with a server and / or a game device of the current game process, and automatically executing the game operation corresponding to the control instruction on the current game process according to the game rules of the current game process; The game accompaniment operation includes: continuously obtaining the game operations completed by the target user on the game controller, and providing feedback on the game operations completed by the target user through the screen module and / or the sound interaction module; and / or analyzing the current game process to obtain game operation instructions, and presenting the game operation instructions to the target user through the screen module and / or the sound interaction module.

3. The interactive method of a smart handle according to claim 1, characterized in that: The handle operation includes a game device operation, and the game device operation includes: Querying the device configuration data of the game controller, and adjusting the device configuration data of the game device accordingly according to the control instruction; The device configuration data of the game controller includes: controller operation mode configuration, and / or controller button configuration, and / or controller volume configuration, and / or controller screen brightness configuration, and / or controller vibration configuration.

4. The interactive method of a smart handle according to claim 1, characterized in that: The determining of the external device and the control operation corresponding to the control instruction, and performing the control operation on the determined external device based on the control instruction includes: Acquire a list of all the external devices that are within the communication connection range of the game controller and are in communication connection with the game controller; Determining the external device corresponding to the control instruction in the list according to the subject of the control instruction, and communicating with the determined external device; The control operation is performed on the determined external device.

5. The interactive method of a smart handle according to claim 4, characterized in that: The control operation includes adjusting the device configuration data of the external device accordingly according to the control instruction and the adjustment rule of the external device; The device configuration data of the external device includes: device operation mode configuration, and / or device volume configuration, and / or device screen configuration, and / or device brightness configuration, and / or device temperature configuration, and / or device movement configuration.

6. The interactive method of a smart handle according to claim 1, characterized in that: Also includes: Analyze the intention of the voice data to obtain an inquiry instruction; Retrieving the subject of the query instruction in a preset corpus database; When there is corpus corresponding to the topic, generating an answer based on the corpus, and presenting the answer through the screen module and / or the sound interaction module; When there is no corpus corresponding to the subject, a pre-trained neural network model is used to semantically understand the subject of the query instruction and generate an answer; or an external resource is retrieved for the subject of the query instruction to generate the answer; The answer is presented through the screen module and / or the sound interaction module.

7. The interaction method of a smart handle according to claim 1, characterized in that: Also includes: Presenting a corresponding interactive image on the screen module according to the selection of the target user; The interactive image is used to feedback the operation status completed based on the control instruction to the target user through the screen module and / or the sound interaction module; The interactive image includes a preset image selected from a preset image library and / or a custom image set according to the needs of the target user; Each of the preset images corresponds to a preset image system; each of the custom images corresponds to a custom image system obtained based on the target user's settings; The image system includes an appearance database, and / or a voice database, and / or a personality database.

8. The interaction method of a smart handle according to claim 7, characterized in that: Also includes: The voice data, the control instructions, the handle operation and the feedback to the target user obtained by the game handle within a preset time period are stored to obtain historical interaction data; Regularly analyzing one or more segments of the historical interaction data to obtain user preferences, and updating the user preferences to the user profile corresponding to the target user; Adjusting the image system of the interactive image according to the latest user portrait to change the image style fed back to the target user through the screen module; And / or change the voice style of the voice interaction module's feedback to the target user.

9. The interaction method of a smart handle according to claim 1, characterized in that: Before receiving the voice data of the target user, the method further includes: Providing registration for the user, receiving the user's voice data for the first time through the voice interaction module, obtaining voiceprint features according to the voice data, and authenticating the user as the target user according to the voiceprint features; The voice interaction module receiving the voice data of the target user also includes: Receiving the voice data of the user through the voice interaction module, preprocessing the voice data, extracting the voiceprint features in the voice data, and matching the voiceprint features with the authenticated target user; If they match, proceed to the next step; if they do not match, prompt the user to re-enter the voice data, or prompt the user to register until the user's voiceprint feature matches the authenticated target user.

10. A smart handle, characterized in that: An interactive method for a smart handle according to any one of claims 1 to 9, comprising: A screen module, used for feeding back the completed operation status based on the control instruction to the target user through screen output or text output; A voice interaction module, the voice interaction module comprising a speaker and a microphone; the microphone is used to receive the voice data of the target user, and is used to provide feedback to the target user through voice output on the operation status completed based on the control instruction; A main control module, the main control module is communicatively connected to the screen module and the sound interaction module, and is used to analyze the intention of the voice data to obtain the control instruction; when the control instruction is related to the current game process, the main control module is used to determine the handle operation corresponding to the control instruction, and execute the determined handle operation on the game handle based on the control instruction; when the control instruction is not related to the current game process, the main control module is used to determine the external device and control operation corresponding to the control instruction, and execute the control operation on the determined external device based on the control instruction.

Images