Hand-interactive few-key-position control system and method

Abstract

The invention provides a hand-interactive few-key-position control system and method, and belongs to the technical field of intelligent control. The system comprises a hand interaction device and a hand interaction control system. The hand interaction device is worn on a finger of a human body, and at least two pressure-sensitive sensors and an inertial measurement unit sensor are mounted on the hand interaction device; the hand interaction control system is electrically connected with the hand interaction device and comprises a signal receiving unit, a working mode switching unit, a character input unit, a control instruction input unit, a 3D mouse control unit and a communication unit. And the control module is used for controlling the display device to display and input the target vocabularies, and / or generating a control operation corresponding to the function control instruction, and / or generating a control operation corresponding to the posture control instruction. Based on the hand-interactive few-key-position control system, the convenience of character input and control input interaction of the head-mounted display device can be effectively improved.

Description

Technical Field

[0001] The present invention relates to the field of intelligent control technology, and in particular to a hand-interactive, low-key control system and method. Background Art

[0002] With the development of microelectronics and information technology, various smart glasses and head-mounted display devices (such as virtual reality glasses VR glasses, augmented reality glasses AR glasses and mixed reality glasses MR glasses) are being used in large quantities. When using these devices, two basic operations are usually required, namely control command input and text input. Keyboard button input, air gesture input and voice input are currently commonly used interactive input methods. However, keyboard input usually requires carrying an additional keyboard, which is not very convenient; air gesture input is easily disturbed by outdoor light; in noisy environments or public places, voice input is not suitable and will leak privacy. The input method based on eye tracking technology is affected by ambient light and has difficulty in achieving a high typing speed. For this reason, it is necessary to develop a system that helps smart glasses and head-mounted display devices to conveniently control and input text, which will improve their efficiency and convenience in mobile scenarios.

[0003] The above problems need to be solved. Summary of the invention

[0004] The present invention aims to overcome at least one of the above-mentioned disadvantages of the prior art. On the one hand, a hand-interactive low-key control system is provided, the system comprising: a hand interaction device and a hand interaction control system; the hand interaction device is worn on a human finger, and at least two pressure-sensitive sensors and an inertial measurement unit sensor are installed on the hand interaction device, the pressure-sensitive sensor is used to obtain the pressure value applied to the pressure-sensitive sensor, and the inertial measurement unit sensor is used to obtain the multi-axis posture angle and acceleration of the finger; the hand interaction control system is electrically connected to the hand interaction device, including a signal receiving unit, a working mode switching unit, a text input unit, a control instruction input unit, a 3D mouse control unit and a communication unit; the input end of the signal receiving unit is electrically connected to the output end of the hand interaction device, and is used to obtain the pressure value applied to the pressure-sensitive sensor, the multi-axis posture angle and acceleration of the finger, and the start-up signal of the hand interaction device; the input end of the working mode switching unit is electrically connected to the output end of the signal receiving unit, and is used to select the working mode based on the start-up signal of the hand interaction device; the input end of the text input unit is electrically connected to the output end of the signal receiving unit and the output end of the working mode switching unit, respectively. The control instruction input unit is electrically connected to the output ends of the signal receiving unit and the working mode switching unit respectively, and is used to generate a corresponding function control instruction based on the pressure value applied to the pressure sensitive sensor when the working mode is the control instruction input mode; the input end of the 3D mouse control unit is electrically connected to the output end of the signal receiving unit and the working mode switching unit respectively, and is used to generate a corresponding function control instruction based on the pressure value applied to the pressure sensitive sensor when the working mode is the control instruction input mode; the input end of the 3D mouse control unit is electrically connected to the output end of the signal receiving unit and the working mode switching unit respectively, and is used to generate a corresponding function control instruction and a corresponding space posture control instruction based on the multi-axis posture angle and acceleration of the finger when the working mode is the 3D mouse control mode; the input end of the communication unit is connected to the output ends of the text input unit, the control instruction input unit and the 3D mouse control unit respectively, and the output end of the communication module is externally connected to a display device, and is used to control the display device to display the target vocabulary, and / or control the display device to generate a control operation corresponding to the function control instruction, and / or control the display device to generate a control operation corresponding to the posture control instruction.

[0005] Furthermore, the working modes include text input mode, control instruction input mode and 3D mouse control mode; the output end of the working mode switching unit is also connected to the input end of the communication module, so that when the hand interaction device is in the on state, the working mode switching unit obtains the control signal sent by the signal receiving unit, sends the control signal to the display device through the communication module, controls the display device to display different working modes, and selects different working modes based on the hand interaction device to switch to the corresponding working mode.

[0006] Furthermore, the working mode switching unit is also used to activate the working mode switching function based on the pressure signals of at least two pressure-sensitive sensors sent by the signal receiving unit during the operation of the hand-interactive few-key control system, so that the system switches between different working modes during the operation process.

[0007] Furthermore, the text input unit includes a comparison unit, a character string generation unit and a target vocabulary generation unit; the comparison unit is used to compare the pressure value received from the pressure-sensitive sensor with a preset first pressure threshold; the character string generation unit is used to generate a character string based on the comparison result; the target vocabulary generation unit is used to generate a corresponding target vocabulary based on the character string using a Huffman-coded few-key fuzzy input algorithm.

[0008] Furthermore, the comparison unit is also used to output 1 when the pressure value transmitted by the pressure-sensitive sensor is greater than a preset first pressure threshold, and otherwise output 0; the character string generation unit is used to generate a character string containing only 0 and 1 based on the comparison result; the target vocabulary generation unit is used to generate a T9 code corresponding to the character string based on the character string and Huffman coding; generate a corresponding candidate word list based on the T9 code and the dictionary tree; and select a target vocabulary based on the candidate word list.

[0009] Furthermore, the target vocabulary generation unit is also used to: convert the characters in the dictionary into corresponding T9 codes based on the T9 input method; store the corresponding characters and the frequency of occurrence of the characters in the corpus in the dictionary tree according to the T9 codes; and perform Huffman encoding on each key position of T9 according to the frequency of occurrence of letters in each key position in the corpus according to the number of keys used.

[0010] Furthermore, the control instruction input unit is also used to: when the working mode is the control instruction input mode, when the pressure value on the pressure sensitive sensor is greater than a preset second pressure threshold, generate a corresponding first function control instruction; when the pressure value on the pressure sensitive sensor is less than or equal to the preset second pressure threshold, generate a corresponding second function control instruction.

[0011] Furthermore, when the working mode is the 3D mouse control mode, the two pressure-sensitive sensors implement single-click, double-click, long-press drag or selection operation instructions by simulating the left and right buttons of the mouse. According to the combined value of the pressure-sensitive sensor and the inertial measurement unit sensor, the corresponding 3D space posture control instructions are identified, including enlarging the object displayed on the display interface, reducing the object displayed on the display interface, translating the object displayed on the display interface and / or rotating the object displayed on the display interface;

[0012] Furthermore, the hand interaction control system is connected to the display device through wireless communication or wired communication, including one or a combination of WiFi, Bluetooth, wireless local area network WLAN, wireless personal area network WPAN, mobile communication technology, LTE-Cat1, NB-IoT, LoRa, infrared technology and NFC technology.

[0013] In a second aspect, the present invention provides a hand-interactive few-key control method, which is applied to the above-mentioned hand-interactive few-key control system, and the method includes: obtaining the pressure value applied on the pressure-sensitive sensor, the multi-axis posture angle and acceleration of the finger, and the start signal of the hand interaction device; selecting a working mode based on the start signal of the hand interaction device; when the working mode is a text input mode, generating a corresponding target vocabulary based on the pressure value applied on the pressure-sensitive sensor using a Huffman-coded few-key fuzzy input algorithm; when the working mode is a control instruction input mode, generating a corresponding function control instruction based on the pressure value applied on the pressure-sensitive sensor; when the working mode is a 3D mouse control mode, generating a corresponding function control instruction based on the pressure value applied on the pressure-sensitive sensor and a corresponding posture control instruction based on the multi-axis posture angle and acceleration of the finger; controlling the display device to display the target vocabulary, and / or controlling the display device to generate a control operation corresponding to the function control instruction, and / or controlling the display device to generate a control operation corresponding to the posture control instruction.

[0014] On the other hand, the present invention provides a computer-readable storage medium, wherein one or more instructions are stored in the computer-readable storage medium, and the computer instructions are used to enable the computer to execute the above-mentioned hand-interactive low-key control method.

[0015] On the other hand, the present invention provides an electronic device, comprising: a memory and a processor; the memory stores at least one program instruction; the processor implements the above-mentioned hand-interactive low-key control method by loading and executing the at least one program instruction.

[0016] The beneficial effects of the present invention are as follows: the present invention provides a hand-interactive, low-key control system and method. By electrically connecting a hand interaction device, a hand interaction control system and an external display device, text input, control command input and 3D mouse control functions of the display device can be completed through the pressure-sensitive sensor and inertial measurement unit sensor configured on the hand interaction device. Since the hand interaction device is small in size and easy to carry, the hand-interactive, low-key control system can effectively improve the convenience of text input and control input of head-mounted display devices (such as VR glasses, AR glasses, MR glasses and other smart glasses), especially in mobile scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0018] Figure 1 This is a schematic diagram of the structure of a hand-interactive, low-key control system provided in Example 1 of the present invention.

[0019] Figure 2 It is a schematic diagram of a use scenario of a hand-interactive, low-key control system provided in Example 1 of the present invention.

[0020] Figure 3 It is a structural schematic diagram of a text input unit provided in Example 1 of the present invention.

[0021] Figure 4 This is a flow chart of a hand-interactive, low-key control method provided in Example 1 of the present invention.

[0022] Figure 5 It is a partial block diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0023] It should be mentioned before discussing the exemplary embodiments in more detail that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe the operations as sequential processes, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but can also have additional steps not included in the accompanying drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0024] It should be understood that, although the terms "first", "second", etc. may be used herein to describe various units, these units should not be limited by these terms. These terms are used only to distinguish one unit from another unit. For example, without departing from the scope of the exemplary embodiments, the first unit may be referred to as the second unit, and similarly the second unit may be referred to as the first unit. The term "and / or" used herein includes any and all combinations of one or more of the listed associated items.

[0025] Example 1

[0026] refer to Figure 1-2 , showing a schematic diagram of the structure of a hand-interactive few-key control system.

[0027] As an example, the system includes: a hand interaction device 1 and a hand interaction control system 2; the hand interaction device 1 is worn on a human finger, and at least two pressure-sensitive sensors are installed on the hand interaction device 1. Here, the system is described by taking two pressure-sensitive sensors as an example, including a first pressure-sensitive sensor 110, a second pressure-sensitive sensor 120 and an inertial measurement unit sensor 130, the pressure-sensitive sensor is used to obtain the pressure value applied to the pressure-sensitive sensor, and the inertial measurement unit sensor 130 is used to obtain the multi-axis posture angle and acceleration of the finger; the hand interaction control system 2 is electrically connected to the hand interaction device 1, and includes a signal receiving unit 210, a working mode switch Unit 220, text input unit 230, control command input unit 240, 3D mouse control unit 250 and communication unit 260; the input end of the signal receiving unit 210 is electrically connected to the output end of the hand interaction device 1, and is used to obtain the pressure value applied to the pressure-sensitive sensor, the multi-axis posture angle and acceleration of the finger and the start signal of the hand interaction device; the input end of the working mode switching unit 220 is electrically connected to the output end of the signal receiving unit 210, and is used to select the working mode based on the start signal of the hand interaction device 1; the input end of the text input unit 230 is respectively connected to the signal receiving unit 210 and the working mode switching unit The output end of the control instruction input unit 240 is electrically connected to the output end of the signal receiving unit 210 and the working mode switching unit 220, and is used to generate a corresponding target vocabulary based on the pressure value applied to the pressure sensitive sensor using a Huffman-coded low-key fuzzy input algorithm when the working mode is a text input mode; the input end of the control instruction input unit 240 is electrically connected to the output end of the signal receiving unit 210 and the working mode switching unit 220, and is used to generate a corresponding function control instruction based on the pressure value applied to the pressure sensitive sensor when the working mode is a control instruction input mode; the input end of the 3D mouse control unit 250 is electrically connected to the output end of the signal receiving unit 210 and the working mode switching unit 220, When the working mode is the 3D mouse control mode, the pressure value applied on the pressure-sensitive sensor generates a corresponding function control instruction and the multi-axis posture angle and acceleration of the finger generate a corresponding 3D space posture control instruction; the input end of the communication unit 260 is respectively connected to the output end of the text input unit 230, the control instruction input unit 240 and the 3D mouse control unit 250, and the output end of the communication module 260 is externally connected to the display device 3, which is used to control the display device 3 to display the target vocabulary, and / or control the display device 3 to generate a control operation corresponding to the function control instruction, and / or control the display device 3 to generate a control operation corresponding to the posture control instruction.

[0028] Preferably, the hand interaction device 1 may include at least one hand interaction device, such as two hand interaction devices 1 placed on two hands, which may support single-handed or two-handed operation, that is, the user may use it on one hand or on both hands and use them in coordination with each other.

[0029] Preferably, the working modes include a text input mode, a control command input mode, and a 3D mouse control mode; the output end of the working mode switching unit 220 is also connected to the input end of the communication module 260, so that when the hand interaction device 1 is in the on state, the working mode switching unit obtains the control signal sent by the signal receiving unit, sends the control signal to the display device 3 through the communication module 260, controls the display device 3 to display different working modes, and selects different working modes based on the hand interaction device to switch to the corresponding working mode. Specifically, when the hand interaction device 1 is turned on, a control signal is sent to the hand interaction control system 2, and then different working modes are displayed on the display device 3, including a text input mode, a control command input mode, and a 3D mouse control mode. At this time, the user can control the working mode to be selected by clicking the pressure-sensitive sensor on the hand interaction device 1, such as jumping to different working modes by long pressing the pressure-sensitive sensor, and then selecting the working mode by clicking the pressure-sensitive sensor.

[0030] Preferably, the working mode switching unit 220 is also used to enable the working mode switching function based on the pressure signals of at least two pressure-sensitive sensors sent by the signal receiving unit during the operation of the hand-interactive few-key control system, so that the system switches different working modes during the operation. Specifically, different working modes can also be switched in real time during the operation. For example, in order to switch between these functions, the working mode switching function can be enabled by long pressing two pressure-sensitive sensors at the same time, such as jumping to different working modes by long pressing the pressure-sensitive sensors, and then selecting the working mode by clicking the pressure-sensitive sensors.

[0031] Preferably, Figure 3As shown, the text input unit 230 includes a comparison unit 2301, a character string generation unit 2302 and a target vocabulary generation unit 2303; the comparison unit 2301 is used to compare the pressure value of the pressure-sensitive sensor received with the preset first pressure threshold; the character string generation unit 2302 is used to generate a character string based on the comparison result; the target vocabulary generation unit 2303 is used to generate a corresponding target vocabulary based on the character string using a few-key fuzzy input algorithm using Huffman coding. Specifically, the comparison unit 2301 is also used to output 1 when the pressure value transmitted by the pressure-sensitive sensor obtained is greater than the preset first pressure threshold, and otherwise output 0; the character string generation unit 2302 is used to generate a character string containing only 0 and 1 based on the comparison result; the target vocabulary generation unit 2303 is used to generate a T9 code corresponding to the character string based on the character string and Huffman coding; generate a corresponding candidate word list based on the T9 code and the dictionary tree; and select a target vocabulary based on the candidate word list. The target vocabulary generation unit 2303 is also used to: convert the characters in the dictionary into corresponding T9 codes based on the T9 input method; store the corresponding characters and the frequency of occurrence of the characters in the corpus in the dictionary tree according to the T9 codes; and perform Huffman encoding on each key position of T9 according to the frequency of occurrence of the letters in each key position in the corpus according to the number of keys used.

[0032] Specifically, as shown in Table 1 below, the characters include 26 English letters az, and their frequencies of occurrence in the dictionary are:

[0033] Table 1:

[0034]

[0035] Among them, the frequencies of 26 characters in the Jiugongge input method are shown in Table 2:

[0036] Table 2:

[0037] T9 Code 2 3 4 5 6 7 8 9 character ABC DEF GHI JKL MNO PQRS TUV WXYZ frequency 12.5 19.5 15.1 4.92 16.6 14.295 11.88 4.624

[0038] Among them, the T9 input method includes 26 English letters assigned to the 8 numeric keys from 2 to 9. In the past, when you want to input English words, you always need to press a certain key multiple times in succession to get the target letter. For example, if you want to input "helo", you need to press 4 twice, 3 twice, 5 three times, 5 three times, and 6 three times. The T9 input method solves this problem very well. Users can use 9 numeric keys to input very complex English words without having to press a certain character repeatedly. The system will find the most likely word based on the existing vocabulary. For example, if the target word is "hello", you only need to enter 4.3, 5.5.6, and the system will automatically filter out illegal words such as "gdjjm". Excluding illegal words and only considering legal words greatly speeds up the input speed. Provide the most likely (most commonly used) English words according to the possibility. For example, the system knows two words: "idea" and "hello". Idea is the most commonly used (highest probability). Then when 4.3.5.5.6 are entered in sequence, the candidate words given by the system for each key press are i(4), id(3), hel(5), hell(5), and hello(6). Since the T9 input method is already very mature in the prior art, it will not be described in detail here.

[0039] Specifically, the method of encoding the keys of the nine-square grid layout using the frequency of occurrence of letters in the dictionary as weights to generate a dictionary tree includes: encoding the keys of the nine-square grid layout based on the Huffman algorithm using the frequency of occurrence of letters in the dictionary as weights to generate a dictionary tree. Calculating the sum of the weight values ​​of the letters corresponding to different keys of the nine-square grid layout; and deploying them from the root to the branch of the dictionary tree from high to low based on the sum of the weight values. Specifically, using two buttons for explanation, based on Table 2, we can see that the letter combination with the highest frequency is def, with a corresponding frequency of 19.5 and a corresponding T9 code of 3, so it is placed on the node with the code "00" on the second layer closer to the root of the dictionary tree; the letter combination with the second frequency is mno, with a corresponding frequency of 16.6 and a corresponding T9 code of 6, so it is placed on the node with the code "111" on the third layer of the dictionary tree; the letter combination with the third frequency is ghi, with a corresponding frequency of 15.1 and a corresponding T9 code of 4, so it is placed on the node with the code "110" on the third layer of the dictionary tree; the letter combination with the fourth frequency is pqrs, with a corresponding frequency of 14.295 and a corresponding T9 code of 7, so it is placed on the third layer of the dictionary tree. The fifth most frequent combination of letters is abc, with a frequency of 12.5 and a T9 code of 2, so it is placed on the third layer of the dictionary tree with a code of "100"; the sixth most frequent combination of letters is tuv, with a frequency of 11.88 and a T9 code of 8, so it is placed on the third layer of the dictionary tree with a code of "011"; the seventh most frequent combination of letters is jkl, with a frequency of 4.92 and a T9 code of 5, so it is placed on the fourth layer of the dictionary tree with a code of "0101"; the eighth most frequent combination of letters is wxyz, with a frequency of 4.624 and a T9 code of 9, so it is placed on the third layer of the dictionary tree with a code of "0100". It can be seen that the more times (probabilities) a combination of letters appears, the higher it will be, and the shorter the code will be. Taking two key positions as an example, if the user inputs "001000100", the user input will be converted into the T9 code "329" according to the dictionary tree. The generation of the corresponding T9 code based on the character string includes: when the character string input by the user is located in a non-leaf node in the dictionary tree, generating a corresponding T9 code based on the sub-leaf node of the non-leaf node; generating a corresponding candidate word list based on the T9 code. Specifically, when the user input is located at a non-leaf node, candidate words will be given based on the sub-leaf nodes of the node, allowing the user to select in advance. For example, when the user inputs 001, a candidate word list corresponding to T9 codes 32, 34, 36, and 37 will be given. When the user input is 0011, a candidate word list corresponding to T9 codes 34 and 36 will be given. This increases the ambiguity, thereby increasing the input speed.

[0040] Preferably, the control instruction input unit 240 is also used for: when the working mode is the control instruction input mode, when the pressure value on the pressure-sensitive sensor is greater than the preset second pressure threshold, generating a corresponding first function control instruction; when the pressure value on the pressure-sensitive sensor is less than or equal to the preset second pressure threshold, generating a corresponding second function control instruction. Specifically, the first function control instruction may be to increase the volume, and the second function control instruction may be to decrease the volume. The first function control instruction and the second function control instruction are not limited here, that is, the first function control instruction and the second function control instruction may include increasing or decreasing the volume, answering a call, etc.

[0041] Preferably, the 3D space gesture control instruction includes enlarging the object displayed on the display interface, reducing the object displayed on the display interface, translating the object displayed on the display interface and / or rotating the object displayed on the display interface; when the working mode is the 3D mouse control mode, the two pressure-sensitive sensors realize single-click, double-click, long-press drag or selection operation instructions by simulating the left and right buttons of the mouse. That is, when the 3D mouse control mode is started, the two pressure-sensitive sensors placed on the hand interaction device can be pressed, and the pressure value obtained can be compared with the preset pressure threshold, and the corresponding function control instruction can be generated based on the comparison result, such as, when the pressure value of pressing the first pressure-sensitive sensor is greater than the preset pressure threshold, a "single click" control instruction is generated, and the operation of simulating a single click of the mouse is realized at this time; when the pressure value of pressing the second pressure-sensitive sensor is greater than the preset pressure threshold, a "double-click" control instruction is generated, and the operation of simulating a double-click of the mouse is realized at this time. It should be noted that only one embodiment is described here, that is, different operations can be achieved by setting different pressure thresholds for the pressure-sensitive sensor and corresponding control instructions, so that a series of operations of simulating a mouse can be perfectly achieved through the pressure-sensitive sensor and the inertial measurement unit sensor. Specifically, posture control can be achieved through an inertial measurement unit sensor (Inertial measurement unit, referred to as IMU). Since the inertial measurement unit sensor technology is very mature, it will not be repeated here.

[0042] Preferably, the hand interaction control system is connected to the display device through wireless communication or wired communication, including one or a combination of WiFi, Bluetooth, wireless local area network WLAN, wireless personal area network WPAN, mobile communication technology, LTE-Cat1, NB-IoT, LoRa, infrared technology and NFC technology.

[0043] Preferably, the hand interaction control system further includes a charging unit for providing working power for the hand interaction device.

[0044] In the above embodiment, by electrically connecting the hand interaction device, the hand interaction control system and the external display device, the text input, control command input and 3D mouse control functions of the display device can be completed through the pressure-sensitive sensor and the inertial measurement unit sensor configured on the hand interaction device. Since the hand interaction device is small in size and easy to carry, the hand-interactive few-key control system can effectively improve the convenience of text input and control input of head-mounted display devices (such as VR glasses, AR glasses, MR glasses and other smart glasses), especially in mobile scenarios.

[0045] Example 2

[0046] like Figure 4 As shown, a flow chart of a hand-interactive few-key control method is shown.

[0047] As an example, the method includes:

[0048] S410: Acquire the pressure value applied to the pressure-sensitive sensor, the multi-axis posture angle and acceleration of the finger, and the start signal of the hand interaction device.

[0049] S420: Selecting a working mode based on the start-up signal of the hand interaction device.

[0050] S430: When the working mode is the text input mode, a Huffman-coded few-key fuzzy input algorithm is used to generate a corresponding target vocabulary based on the pressure value applied to the pressure-sensitive sensor.

[0051] S440: When the working mode is the control instruction input mode, a corresponding function control instruction is generated based on the pressure value applied to the pressure-sensitive sensor.

[0052] S450: When the working mode is the 3D mouse control mode, a corresponding function control instruction is generated based on the pressure value applied to the pressure-sensitive sensor and a corresponding 3D space posture control instruction is generated based on the multi-axis posture angle and acceleration of the finger.

[0053] S460: Control the display device to display the target vocabulary, and / or control the display device to generate a control operation corresponding to the function control instruction, and / or control the display device to generate a control operation corresponding to the gesture control instruction.

[0054] It is not difficult to find that this embodiment is a system embodiment corresponding to the first embodiment, and this embodiment can be implemented in conjunction with the first embodiment. The relevant technical details mentioned in the first embodiment are still valid in this embodiment, and in order to reduce repetition, they are not repeated here. Accordingly, the relevant technical details mentioned in this embodiment can also be applied in the first embodiment.

[0055] Example 3

[0056] The embodiment of the present invention further provides a storage medium, on which a hand-interactive few-key control method is stored, and when the hand-interactive few-key control program is executed by a processor, the steps of the hand-interactive few-key control method described above are implemented. Since the storage medium adopts all the technical solutions of all the above embodiments, it has at least all the beneficial effects brought by the technical solutions of the above embodiments, which will not be repeated here one by one.

[0057] Example 4

[0058] See also Figure 5 An embodiment of the present invention further provides an electronic device, comprising: a memory and a processor; the memory stores at least one program instruction; the processor implements the hand-interactive few-key control method provided in Example 2 by loading and executing the at least one program instruction.

[0059] The memory 502 and the processor 501 are connected in a bus manner, and the bus may include any number of interconnected buses and bridges, and the bus connects various circuits of one or more processors 501 and the memory 502 together. The bus can also connect various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface between the bus and the transceiver. The transceiver can be one element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on a transmission medium. The data processed by the processor 501 is transmitted on a wireless medium via an antenna, and further, the antenna also receives data and transmits the data to the processor 501.

[0060] The processor 501 is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management and other control functions. The memory 502 can be used to store data used by the processor 501 when performing operations.

[0061] The above is only an embodiment of the present invention. The common sense such as the known specific structure and characteristics in the scheme is not described in detail here. The ordinary technicians in the relevant field know all the common technical knowledge in the technical field of the invention before the application date or priority date, can obtain all the existing technologies in the field, and have the ability to apply the conventional experimental means before that date. The ordinary technicians in the relevant field can improve and implement this scheme in combination with their own abilities under the enlightenment given by this application. Some typical known structures or known methods should not become obstacles for ordinary technicians in the relevant field to implement this application. It should be pointed out that for those skilled in the art, without departing from the structure of the present invention, several deformations and improvements can be made, which should also be regarded as the protection scope of the present invention, which will not affect the effect of the implementation of the present invention and the practicality of the patent. The protection scope required by this application shall be based on the content of its claims, and the specific implementation methods and other records in the specification can be used to interpret the content of the claims.

Claims

1. A hand-interactive, low-key control system, characterized in that: The system comprises: a hand interaction device and a hand interaction control system; The hand interaction device is worn on a human finger, and is equipped with at least two pressure-sensitive sensors and an inertial measurement unit sensor, the pressure-sensitive sensor is used to obtain the pressure value applied to the pressure-sensitive sensor, and the inertial measurement unit sensor is used to obtain the multi-axis attitude angle and acceleration of the finger; The hand interaction control system is electrically connected to the hand interaction device, and includes a signal receiving unit, a working mode switching unit, a text input unit, a control instruction input unit, a 3D mouse control unit and a communication unit; The input end of the signal receiving unit is electrically connected to the output end of the hand interaction device, and is used to obtain the pressure value applied to the pressure-sensitive sensor, the multi-axis posture angle and acceleration of the finger, and the start signal of the hand interaction device; The input end of the working mode switching unit is electrically connected to the output end of the signal receiving unit, and is used to select a working mode based on the start-up signal of the hand interaction device; The input end of the text input unit is electrically connected to the output ends of the signal receiving unit and the working mode switching unit respectively, and is used to generate a corresponding target word based on the pressure value applied to the pressure-sensitive sensor using a Huffman-coded few-key fuzzy input algorithm when the working mode is a text input mode; The input end of the control instruction input unit is electrically connected to the output ends of the signal receiving unit and the working mode switching unit respectively, and is used to generate a corresponding function control instruction based on the pressure value applied to the pressure-sensitive sensor when the working mode is the control instruction input mode; The input end of the 3D mouse control unit is electrically connected to the output ends of the signal receiving unit and the working mode switching unit respectively, and is used to generate a corresponding function control instruction based on the pressure value applied to the pressure-sensitive sensor and a corresponding posture control instruction based on the multi-axis posture angle and acceleration of the finger when the working mode is the 3D mouse control mode; The input end of the communication unit is respectively connected to the output ends of the text input unit, the control instruction input unit and the 3D mouse control unit, and the output end of the communication module is externally connected to a display device, which is used to control the display device to display the target vocabulary, and / or control the display device to generate a control operation corresponding to the function control instruction, and / or control the display device to generate a control operation corresponding to the posture control instruction.

2. The hand-interactive few-key control system according to claim 1, characterized in that: The working modes include text input mode, control command input mode and 3D mouse control mode; The output end of the working mode switching unit is also connected to the input end of the communication module, and is used for when the hand interaction device is in the on state, the working mode switching unit obtains the control signal sent by the signal receiving unit, sends the control signal to the display device through the communication module, controls the display device to display different working modes, and selects different working modes based on the hand interaction device to switch to the corresponding working mode.

3. The hand-interactive few-key control system according to claim 2, characterized in that: The working mode switching unit is also used to activate the working mode switching function during the operation of the hand-interactive few-key control system based on the pressure signals of at least two pressure-sensitive sensors sent by the signal receiving unit, so that the system switches between different working modes during the operation process.

4. The hand-interactive few-key control system according to claim 1, characterized in that: The text input unit includes a comparison unit, a character string generation unit and a target vocabulary generation unit; The comparison unit is used to compare the received pressure value of the pressure-sensitive sensor with a preset first pressure threshold; The character string generating unit is used to generate a character string based on the comparison result; The target vocabulary generating unit is used to generate a corresponding target vocabulary based on the character string by adopting a few-key fuzzy input algorithm of Huffman coding.

5. The hand-interactive few-key control system according to claim 4, characterized in that: The comparison unit is further configured to output 1 when the pressure value transmitted by the pressure-sensitive sensor is greater than a preset first pressure threshold, and output 0 otherwise; The character string generating unit is used to generate a character string containing only 0 and 1 based on the comparison result; The target vocabulary generation unit is used to generate a T9 code corresponding to the character string based on the character string and Huffman coding; Generate a corresponding candidate word list based on the T9 code and the dictionary tree; A target vocabulary is selected based on the candidate word list.

6. The hand-interactive few-key control system according to claim 5, characterized in that: The target vocabulary generation unit is also used for: Convert the characters in the dictionary into corresponding T9 codes based on the T9 input method; According to the T9 code, the corresponding characters and the frequency of occurrence of the characters in the corpus are stored in the dictionary tree; According to the number of keys used, Huffman encoding is performed on each key position of T9 according to the frequency of occurrence of letters in each key position in the corpus.

7. The hand-interactive few-key control system according to claim 1, characterized in that: The control instruction input unit is also used for: When the working mode is the control instruction input mode, when the pressure value on the pressure-sensitive sensor is greater than a preset second pressure threshold, a first function control instruction corresponding thereto is generated; When the pressure value on the pressure-sensitive sensor is less than or equal to a preset second pressure threshold, a corresponding second function control instruction is generated.

8. The hand-interactive few-key control system according to claim 1, characterized in that: When the working mode is the 3D mouse control mode, the two pressure-sensitive sensors implement single-click, double-click, long-press drag or selection and other operation instructions by simulating the left and right buttons of the mouse. Based on the integrated value of the pressure-sensitive sensor and the inertial measurement unit sensor, corresponding 3D space posture control instructions are identified, including enlarging the object displayed on the display interface, reducing the object displayed on the display interface, translating the object displayed on the display interface and / or rotating the object displayed on the display interface.

9. The hand-interactive few-key control system according to claim 1, characterized in that: The hand interaction control system is connected to the display device through wireless communication or wired communication, including one or a combination of WiFi, Bluetooth, wireless local area network WLAN, wireless personal area network WPAN, mobile communication technology, LTE-Cat1, NB-IoT, LoRa, infrared technology and NFC technology.

10. A hand-interactive few-key control method, characterized in that: The method is applied to the hand-interactive few-key control system according to any one of claims 1 to 9, and the method comprises: Acquire the pressure value applied to the pressure-sensitive sensor, the multi-axis posture angle and acceleration of the finger, and the start signal of the hand interaction device; Selecting a working mode based on a start-up signal of the hand interaction device; When the working mode is the text input mode, a Huffman-coded few-key fuzzy input algorithm is used to generate a corresponding target word based on the pressure value applied to the pressure-sensitive sensor; When the working mode is the control instruction input mode, a corresponding function control instruction is generated based on the pressure value applied to the pressure-sensitive sensor; When the working mode is the 3D mouse control mode, a corresponding function control instruction is generated based on the pressure value applied to the pressure-sensitive sensor and a corresponding posture control instruction is generated based on the multi-axis posture angle and acceleration of the finger; The display device is controlled to display the target vocabulary, and / or the display device is controlled to generate a control operation corresponding to the function control instruction, and / or the display device is controlled to generate a control operation corresponding to the posture control instruction.

Images