A game instruction recognition method and an electronic terminal

Abstract

This invention relates to a game command recognition method applied to an electronic terminal. The method includes: a user using their thumbs and little fingers to support and hold the electronic terminal; and using the tips of the index, middle, and ring fingers of both hands, located on the back of the electronic terminal, to freely tap the back of the terminal. The tapping motion of the index, middle, and ring fingers, or any combination of two or more tapping motions, corresponds to and is linked to game commands. During the game, the user maintains the aforementioned horizontal grip on the electronic terminal and taps the back of the terminal with their custom fingertips. The game terminal identifies the type of tapping motion based on voiceprint signals, retrieves the corresponding game command based on the type of tapping motion, and executes the corresponding function. This invention utilizes different finger tapping methods to achieve interaction with the electronic terminal, enabling rapid operation of game commands, enriching the input of game commands, and improving the game's responsiveness.

Description

Technical Field

[0001] This invention relates to the field of interactive technology for electronic terminals, specifically to a game command recognition method and an electronic terminal. Background Technology

[0002] With the continuous development of science and technology, electronic technology has also developed rapidly, and the variety of electronic products has increased dramatically. People have enjoyed the various conveniences brought about by technological advancements. Now, people can enjoy a comfortable life anytime, anywhere through various types of electronic terminals.

[0003] Currently, gaming functionality, especially on electronic devices, is a crucial aspect. Furthermore, with the improvement of operating systems and the continuous advancement of hardware configurations, the games available on these devices are no longer simple, small, flat games. However, a significant factor hindering the development of large-scale games on electronic devices is the limited human-computer interaction space and weak operability. Large-scale games are typically characterized by complex gameplay, providing users with a rich experience through extensive interaction and operation. Currently, however, conventional interaction between electronic devices and users primarily relies on touchscreens, with a very limited number of physical buttons.

[0004] For games that require diverse input commands, floating buttons are used on the touchscreen. Users tap these buttons in-game to issue the corresponding commands. Each floating button typically corresponds to one game command. When there are many game commands, multiple floating buttons will appear on the touchscreen, which obviously affects the user's gaming experience. Therefore, during gameplay, most floating buttons that trigger game commands are hidden, only revealed when needed, allowing users to select the appropriate button to execute the command.

[0005] It is evident that current electronic terminals rely on floating buttons to trigger game commands during gameplay, resulting in slow command operation speeds and negatively impacting the gaming experience. Summary of the Invention

[0006] In view of the problems existing in the prior art, the purpose of this invention is to provide a game command recognition method and an electronic terminal, which uses different fingers to tap the electronic terminal to realize interaction with the electronic terminal, realize the rapid operation of game commands, and improve the game operation experience.

[0007] To achieve the above objectives, the technical solution adopted by the present invention is as follows:

[0008] A game command recognition method is applied to an electronic terminal, suitable for scenarios where the user holds the electronic terminal horizontally in a game. The user's thumbs and little fingers support the grip of the electronic terminal, while the tips of the index, middle, and ring fingers of both hands, located on the back of the electronic terminal, are used to freely tap the back of the electronic terminal. The tapping action of the index, middle, and ring fingers individually, or any combination of two or more tapping actions, corresponds to and is associated with game commands. The recognition method includes the following steps:

[0009] Step 1: The user initiates a tapping action on the back of the electronic terminal using the tips of their index, middle, and ring fingers, which is then linked to designated game commands.

[0010] The user maintains the same grip posture on the electronic terminal in the game. According to the game instructions prompted by the game terminal, the user taps the back of the electronic terminal with a custom fingertip. The game terminal collects the voiceprint signal corresponding to the tapping action and binds the custom fingertip tapping action on the back of the electronic terminal to the game instruction.

[0011] Step 2: In the game, the user maintains the above-mentioned horizontal grip posture of the electronic terminal and taps the back of the electronic terminal with a custom fingertip. The game terminal recognizes the type of tapping action based on the voiceprint signal, retrieves the corresponding game command based on the type of tapping action, and executes the corresponding function.

[0012] The back of the electronic terminal has six tapping areas, namely three tapping areas on the left and three tapping areas on the right; the three tapping areas on the left correspond to the index, middle and ring fingers of the user's left hand, and the three tapping areas on the right correspond to the index, middle and ring fingers of the user's right hand.

[0013] In the game, when a user taps the back of an electronic terminal with a custom fingertip, the game client collects the soundprint signal and tapping area information generated by the tapping action.

[0014] The game client identifies the type of tapping action based on the collected voiceprint signal and retrieves the corresponding game command. The game client also determines whether there is a correspondence between the retrieved game command and the tapping area. If there is a correspondence, the game command's corresponding function is executed; if there is no correspondence, no operation is performed.

[0015] When the custom fingertip tapping action on the back of the electronic terminal is bound to the game command, the game terminal collects the voiceprint differences when each custom fingertip taps the back of the electronic terminal multiple times under different tapping forces and angles, and sets a fault tolerance rate.

[0016] An electronic terminal, comprising

[0017] The posture judgment unit is used to determine whether the electronic terminal is being held horizontally when the game client of the electronic terminal is started. When the electronic terminal is being held horizontally, the instruction binding unit and the analysis unit are started.

[0018] The microphone unit is used to collect the voiceprint signal generated when a user taps an electronic terminal with their finger.

[0019] The instruction binding unit is used to bind game instructions to the tapping actions of the fingertips of the index, middle, and ring fingers of the user's two hands, or any combination of two or more tapping actions.

[0020] The analysis unit is used to analyze the collected voiceprint information, identify the type of tapping action based on the voiceprint signal, and retrieve the corresponding game command based on the type of tapping action.

[0021] The execution unit is used to execute the game instructions obtained by the analysis unit.

[0022] The electronic terminal also includes

[0023] The sensor unit is used to collect vibration signals generated by six tapping areas on the back of the electronic terminal when the user taps the back of the electronic terminal with a custom fingertip during the game.

[0024] The judgment unit is used to compare the intensity of the vibration signals generated by the six tapping areas and determine that the tapping area with the strongest vibration signal is the tapping area of ​​the user this time; the judgment unit is also used to determine whether there is a correspondence between the game command obtained by the analysis unit and the determined tapping area. If there is a correspondence, the execution unit is triggered to execute the corresponding function of the game command; if there is no correspondence, no operation is performed.

[0025] A computer-readable storage medium storing instructions that, when executed on a terminal device, cause the terminal device to perform the game instruction recognition method described above.

[0026] By adopting the above solution, the present invention utilizes different fingers to tap the electronic terminal to achieve interaction with the electronic terminal, realizes rapid operation of game commands, enriches the input operation of game commands, and improves the game operation experience. Attached Figure Description

[0027] Figure 1 A diagram illustrating finger tapping techniques for users with short nails;

[0028] Figure 2 This is a diagram illustrating finger tapping techniques for users with long nails. Detailed Implementation

[0029] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be more thorough and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art.

[0030] Furthermore, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Numerous specific details are provided in the following description to give a thorough understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced without one or more of the specific details, or other methods, components, apparatuses, steps, etc., can be employed. In other instances, well-known methods, apparatuses, implementations, or operations are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0031] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0032] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0033] This invention discloses a game command recognition method, which is applied to electronic terminals and is suitable for scenarios where users hold the electronic terminal horizontally in games. The method specifically includes the following steps:

[0034] Step 10: The user uses their thumbs and little fingers to support and hold the electronic terminal, and the tips of the index, middle, and ring fingers of both hands, located on the back of the electronic terminal, are used to freely tap the back of the electronic terminal; the tapping action of the index, middle, and ring fingers individually or any combination of two or more tapping actions corresponds to the instructions in the game.

[0035] Specifically, the user initiates a tapping motion on the back of the electronic device using the tips of their index, middle, and ring fingers on the game interface, which is then linked to a designated game command. Maintaining the same grip on the electronic device as during the game, the user taps the back of the device with their custom fingertips according to the game commands displayed on the interface. The game interface then collects the corresponding voiceprint signal and links the custom fingertip tapping motion to the game command.

[0036] When binding tapping actions, or any combination of two or more tapping actions, to game commands, it is necessary to record custom fingertip tapping voiceprint information on the electronic terminal. During voiceprint information recording, players follow the on-screen prompts on the electronic terminal, tapping the back of the phone with their left index, middle, and ring fingers (left and right index, middle, and ring fingers respectively) according to different skills, thus mapping the tapping actions of the six fingers to six different skills (this is just an example; in actual application, the tapping actions of the six fingers can be combined to bind more than six game commands). The electronic terminal then automatically records the tapping voiceprint information of different fingers (because the strength, fingertip shape, and nail length of each finger are different, the vibration characteristics of each finger tapping the back of the phone are different; this difference can be used to determine which finger the tapping sound comes from).

[0037] Because everyone's fingernails differ in length, hardness, shape, and the characteristics of the fingertips, and based on the principle that sound is produced by vibration, it can be determined that each finger striking the back of a phone at a fixed angle will produce a different sound. However, the same finger repeatedly striking the same spot on the back of an electronic device will produce very similar sounds.

[0038] The reason why the sound produced by striking the same spot with the same finger is so consistent is because the contact sequence of the fingertip and nail is very fixed. Assuming the user's nails are short, the contact sequence of the finger with the striking surface in the same direction is very regular. Differences in the speed of a single strike manifest as differences in sound frequency. When the nails are short, the contact sequence of the fingertip and nail in that direction is fixed. However, due to the presence of the phalanges, even when the nail is not in contact with the surface, the phalanges will still impact the surface through the skin of the fingertip. Therefore, there will be three significantly different vibrations: the fingertip flesh, the phalanges, and the nail.

[0039] like Figure 1 As shown, assuming the user's nails are very short, the sound produced will also differ due to the varying thickness of the flesh at the fingertips, caused by differences in the impact vibration between the fingertips and finger bones. Figure 2 As shown, assuming the user's nails are long, different vibration effects will be produced due to differences in nail length, hardness, and contact angle, resulting in different sound frequencies.

[0040] In summary, it can be concluded that when a user holds an electronic device with both hands, the sound produced by each finger tapping the back of the device will be different. Therefore, the sound information can be received by the phone's built-in microphone and the frequency characteristics of each finger's tapping can be analyzed. Based on this information, the source of subsequent tapping can be determined.

[0041] In addition, during voiceprint registration, each finger needs to tap the back of the phone multiple times to collect voiceprint differences under different tapping forces and angles, and a certain margin of error is set to ensure the success rate of tapping operations. After voiceprint registration is completed, game skills can be released by tapping the back of the electronic terminal in subsequent games.

[0042] Step 20: In the game, the user maintains the above-mentioned horizontal grip posture of the electronic terminal and taps the back of the electronic terminal with a custom fingertip. The game terminal recognizes the type of tapping action based on the voiceprint signal, retrieves the corresponding game command based on the type of tapping action, and executes the corresponding function.

[0043] To ensure accurate reception of game commands, the back of the electronic terminal has six tapping areas: three on the left and three on the right. The three tapping areas on the left correspond to the index, middle, and ring fingers of the left hand when the user holds the electronic terminal horizontally, while the three tapping areas on the right correspond to the index, middle, and ring fingers of the right hand when the user holds the electronic terminal horizontally.

[0044] In the game, when a user taps the back of an electronic terminal with a custom fingertip, the game client collects the soundprint signal and tapping area information generated by the tapping action.

[0045] The game client identifies the type of tapping action based on the collected voiceprint signal and retrieves the corresponding game command. The game client also determines whether there is a correspondence between the retrieved game command and the tapping area. If there is a correspondence, the game command's corresponding function is executed; if there is no correspondence, no operation is performed.

[0046] The tapping area information is obtained in the following way: when the finger taps the back of the electronic terminal, the vibration signal of each tapping area is collected, and then the vibration signals of each tapping area are compared. The tapping area with the strongest vibration signal is determined as the tapping area of ​​the finger.

[0047] Based on the same inventive concept, this invention also discloses an electronic terminal, which includes...

[0048] The posture judgment unit is used to determine whether the electronic terminal is being held horizontally when the game client of the electronic terminal is started. When the electronic terminal is being held horizontally, the instruction binding unit and the analysis unit are started.

[0049] The microphone unit is used to collect the voiceprint signal generated when a user taps an electronic terminal with their finger.

[0050] The instruction binding unit is used to bind game instructions to the tapping actions of the fingertips of the index, middle, and ring fingers of the user's two hands, or any combination of two or more tapping actions.

[0051] The analysis unit is used to analyze the collected voiceprint information, identify the type of tapping action based on the voiceprint signal, and retrieve the corresponding game command based on the type of tapping action.

[0052] The execution unit is used to execute the game instructions obtained by the analysis unit.

[0053] When playing games on an electronic device held horizontally, the thumbs and little fingers of both hands support the device, while the index, middle, and ring fingers of both hands are free to move. When the user taps the device with their index, middle, or ring finger, the corresponding voiceprint signal is collected. This collected voiceprint information is then analyzed to obtain the corresponding game command, and the function corresponding to the game command is executed.

[0054] The electronic terminal also includes a sensor unit for collecting vibration signals generated by six tapping areas on the back of the electronic terminal when the user taps the back of the electronic terminal with a custom fingertip during the game.

[0055] The judgment unit is used to compare the intensity of the vibration signals generated by the six tapping areas and determine that the tapping area with the strongest vibration signal is the tapping area of ​​the user this time; the judgment unit is also used to determine whether there is a correspondence between the game command obtained by the analysis unit and the determined tapping area. If there is a correspondence, the execution unit is triggered to execute the corresponding function of the game command; if there is no correspondence, no operation is performed.

[0056] By combining voiceprint information and tapping area information, the system determines whether game commands are executed, thus preventing accidental touches.

[0057] In summary, this invention utilizes different finger tapping techniques on an electronic terminal to achieve interaction with the terminal, enabling rapid operation of game commands, enriching the input of game commands, and enhancing the gaming experience.

[0058] The present invention also provides a computer-readable medium, which may be included in the electronic device described in the above embodiments; or it may exist alone and not assembled into the electronic device.

[0059] The aforementioned computer-readable medium carries one or more programs, which, when executed by an electronic device, cause the electronic device to perform the methods described in the above embodiments.

[0060] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0061] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, touch terminal, or network device, etc.) to execute the method according to the embodiments of this disclosure.

[0062] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein.

[0063] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A game command recognition method, the method being applied to an electronic terminal, suitable for scenarios where the user holds the electronic terminal horizontally during a game, characterized in that, The user's thumbs and little fingers are used to support the grip of the electronic terminal, while the tips of the index, middle, and ring fingers of both hands, located on the back of the electronic terminal, are used to freely tap the back of the electronic terminal. The tapping action of the index, middle, and ring fingers individually, or any combination of two or more tapping actions, corresponds to game commands. The recognition method includes the following steps: Step 1: The user initiates a tapping action on the back of the electronic terminal using the tips of their index, middle, and ring fingers, which is then linked to designated game commands. The user maintains the same grip posture on the electronic terminal in the game. According to the game instructions prompted by the game terminal, the user taps the back of the electronic terminal with a custom fingertip. The game terminal collects the voiceprint signal corresponding to the tapping action. Different fingers produce different voiceprint signals. The voiceprint signal generated by the custom fingertip tapping the back of the electronic terminal is bound to the game instruction. Step 2: In the game, the user maintains the above-mentioned horizontal grip posture of the electronic terminal and taps the back of the electronic terminal with a custom fingertip. The game terminal recognizes the type of tapping action based on the voiceprint signal, retrieves the corresponding game command based on the type of tapping action, and executes the corresponding function. The back of the electronic terminal has six tapping areas, namely three tapping areas on the left and three tapping areas on the right; the three tapping areas on the left correspond to the index, middle and ring fingers of the user's left hand, and the three tapping areas on the right correspond to the index, middle and ring fingers of the user's right hand. In the game, when a user taps the back of an electronic terminal with a custom fingertip, the game terminal collects the soundprint signal generated by the tapping action through the microphone unit. The game terminal then identifies the game command associated with the collected soundprint signal and retrieves the game command. While collecting voiceprint signals, the game client also collects vibration signals generated by six tapping areas through a sensor unit. By comparing the strength of the vibration signals, the game client determines the tapping area with the strongest vibration signal as the tapping area for this time. The game client determines whether there is a correspondence between the retrieved game command and the tapped area. If there is a correspondence, the corresponding function of the game command is executed; if there is no correspondence, no operation is performed. When the custom fingertip tapping action on the back of the electronic terminal is bound to the game command, the game terminal collects the voiceprint differences when each custom fingertip taps the back of the electronic terminal multiple times under different tapping forces and angles, and sets a fault tolerance rate.

2. An electronic terminal, characterized in that: include The posture judgment unit is used to determine whether the electronic terminal is being held horizontally when the game client of the electronic terminal is started. When the electronic terminal is being held horizontally, the instruction binding unit and the analysis unit are started. The microphone unit is used to collect the voiceprint signal generated when a user taps an electronic terminal with their finger. The instruction binding unit is used to bind game instructions to the tapping actions of the fingertips of the index, middle, and ring fingers of the user's hands, or any combination of two or more tapping actions. Specifically, the instruction binding unit collects the voiceprint signals generated by the user's custom fingertips tapping the back of the electronic terminal. Different fingers produce different voiceprint signals, and the voiceprint signals generated by the custom fingertips tapping the back of the electronic terminal are bound to the game instructions. The analysis unit is used to analyze the collected voiceprint information, identify the game command bound to the voiceprint signal based on the voiceprint signal, and retrieve the game command. The execution unit is used to execute the game instructions obtained by the analysis unit; The sensor unit is used to collect vibration signals generated by six tapping areas on the back of the electronic terminal when the user taps the back of the electronic terminal with a custom fingertip during the game. The judgment unit is used to compare the intensity of the vibration signals generated by the six tapping areas and determine the tapping area with the strongest vibration signal as the user's tapping area. The judgment unit is also used to determine whether there is a correspondence between the game command obtained by the analysis unit and the determined tapping area. If there is a correspondence, the execution unit is triggered to execute the corresponding function of the game command; if there is no correspondence, no operation is performed.

3. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions that, when executed on a terminal device, cause the terminal device to perform the game instruction recognition method as described in claim 1.

Images