A gesture input device based on a smart ring and its system and method
Through the intelligent ring gesture input method, the input is determined using the relative position and posture between the rings, the problems of low input efficiency, poor accuracy and arm fatigue of existing equipment are solved, and efficient and comfortable input experience and device practicality are achieved.
Patent Information
- Application Number
- CN202111081453.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-15
- Publication Date
- 2024-11-05
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The input of gesture input devices on existing smart AR, VR glasses, smart wearable devices and IoT devices is inefficient and poorly accurate, resulting in arm fatigue and discomfort, and the angle is unadjustable, reducing the practicality of the device.
Using a gesture input method based on smart rings, by wearing the main ring and the secondary ring on the thumb and other fingers, using voice prompts to record the relative position and posture between the rings, determine the corresponding buttons, and use gesture analysis module and data connection module. Implement inputs to allow the device to work at different angles and positions.
Improves the accuracy and efficiency of gesture input, relieves arm soreness, enhances the practicality of the device, and allows users to enter information in any posture.
Smart Images

Figure CN113741699B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of gesture input, and in particular relates to a gesture input device based on a smart ring and a system and method thereof. Background Art
[0002] Input devices are devices that input data and information into computers. They are bridges for communication between computers and users or other devices. Input devices are one of the main means of exchanging information between users and computer systems. At this stage, input devices are developing rapidly, and gesture input devices are one of them. Gesture input devices are now widely used in smart glasses, wearables, and Internet of Things devices.
[0003] Existing gesture input devices have the following technical defects:
[0004] 1. The input devices on existing smart AR, VR glasses, smart wearable devices, and smart IoT devices are mostly somatosensory handles for input, which have limited input information and low sensitivity, making it easy to make input errors, reducing the accuracy of input;
[0005] 2. During gesture input, the hands are left hanging for a long time, which will cause arm pain, making it difficult to input for a long time, and reducing the comfort of gesture input.
[0006] 3. The angle of existing gesture input devices cannot be adjusted and needs to be maintained at a certain angle for input, which reduces the practicality of the device. Summary of the invention
[0007] The purpose of the present invention is to provide a gesture input device based on a smart ring and a method of using the same, so as to solve the existing problems: low input efficiency, poor accuracy, and easy arm fatigue.
[0008] In order to solve the above technical problems, the present invention is achieved through the following technical solutions:
[0009] A gesture input method based on a smart ring, the method comprising the following steps:
[0010] Wear the main ring on the thumb and the secondary ring on any other finger;
[0011] According to the voice prompt, press the thumb on the specific part of other fingers, record the relative position and posture of the two rings at this time, and correspond the relative position and posture to a certain button;
[0012] Repeat the above steps to determine the relative position and relative posture between the two rings corresponding to all buttons;
[0013] When gesture input is enabled, the corresponding button is determined based on the relative position and relative posture of the two rings when the button is clicked.
[0014] Further preferably, the following steps are also included:
[0015] When "according to the voice prompt, press the thumb on the specific part of other fingers and record the relative position and posture between the two rings at this time", determine the center value and preset the error tolerance range;
[0016] When gesture input is started, the coordinates of each click within the tolerance range are recorded. When the coordinates of multiple clicks are all on one side of the center value, the center value is re-determined.
[0017] Further preferably, the re-determining the central value mainly includes:
[0018] A threshold of the number of offsets is set. When the relative position coordinates and relative posture coordinates of multiple clicks are continuously on one side of the center value, the number of times exceeds the threshold, and the corresponding center value is re-determined based on the relative position coordinates and relative posture coordinates of the multiple clicks.
[0019] Further preferably, the method for determining the central value is:
[0020] Assume that the relative position coordinates or relative posture coordinates between the main ring and the secondary ring are: (X1, Y1, Z1), (X2, Y2, Z2), (X3, Y3, Z3), ..., (Xn, Yn, Zn), then the center value is
[0021] A gesture input system based on a smart ring, characterized in that the gesture input system comprises:
[0022] A gesture input device, the gesture input device comprising a primary ring and a secondary ring;
[0023] A processing module, the processing module includes a standard button preset module, a gesture analysis module, and a data connection module;
[0024] The standard button preset module is used to preset the relative position coordinates and relative posture coordinates between the main ring and the secondary ring corresponding to each button;
[0025] The gesture analysis module is used to determine the clicked button when the relative position and relative posture between the main ring and the secondary ring are obtained;
[0026] The data connection module is used to establish data connection between the main ring and the secondary ring.
[0027] Further preferably, the processing module also includes a data correction module, and the data correction module is used to correct the relative position coordinates and relative posture coordinates between the main ring and the secondary ring corresponding to each button.
[0028] Further preferably, the data connection module is at least one of the following: a 4G module, a 5G module, a Bluetooth module, and a WiFi module.
[0029] A gesture input device, comprising a main ring and a secondary ring, wherein the main ring is worn on the thumb and the secondary ring is worn on other fingers;
[0030] The main ring and the secondary ring both include an inner ring, an outer ring, a chip module, and a power supply module;
[0031] The chip module includes a signal receiving module, a gyroscope sensor, and a wireless transmission module;
[0032] The chip module located on the secondary ring also includes a vibration sensor.
[0033] Further preferably, the power supply module is encapsulated between the inner ring and the outer ring, and is charged by wireless charging.
[0034] Further preferably, the signal receiving module includes at least one of the following: a laser receiving module, an infrared light receiving module, and a visible light receiving module.
[0035] The present invention has the following beneficial effects:
[0036] When the present invention is used, by presetting letters on the fingers of both hands or one hand, and using the gesture analysis module to determine the letters represented by the click action, and using the data transmission module to transmit the letters to the smart device, it is conducive to realizing gesture input, improving the accuracy of input, and improving the efficiency of input;
[0037] The device of the present invention is in the shape of a ring and is easy to wear. After the device is worn on the hand, the relative position and relative posture between the two rings are used to determine the input gesture. When using the device, the user can input text information in any posture, which alleviates the soreness caused by the palm being suspended in the air for a long time when using the previous input device, and is conducive to improving the comfort of gesture input;
[0038] The present invention is provided with two parts, the main device is worn on the thumb, and the auxiliary device can be worn on any other thumb, thereby realizing free position adjustment of the input device body, being conducive to adjusting the device position according to the situation, and improving the practicability of the device. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1It is a schematic diagram of the use of the gesture input device of the present invention.
[0040] Figure 2 It is a structural expansion diagram of the gesture input device of the present invention.
[0041] Figure 3 This is a first schematic diagram of the standard key preset of the present invention.
[0042] Figure 4 A second schematic diagram of the standard key preset of the present invention.
[0043] Figure 5 Schematic diagram of the system of the present invention.
[0044] Reference numerals:
[0045] 1. Main ring; 2. Secondary ring; 3. Inner ring; 4. Outer ring; 5. Chip module; 6. Power supply module. DETAILED DESCRIPTION
[0046] The technical solutions in the embodiments of the present invention are described clearly and completely below. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0047] Embodiment 1:
[0048] See also Figure 1 , the gesture input device of the present invention comprises a main ring 1 and a secondary ring 2 worn on the thumb;
[0049] It should be understood that the main ring 1 and the secondary ring 2 of the present invention are used in conjunction with existing mature smart devices, such as smart AR, VR glasses, smart wearable devices, and smart Internet of Things devices, among which VR glasses are the most representative. The handles of existing VR glasses are gesture input devices, and have the technical problems pointed out in the above background technology.
[0050] The main ring 1 is used to be worn on the thumb, and the secondary ring 2 is used to be worn on other fingers;
[0051] See also Figure 2 The main ring 1 and the secondary ring 2 are both composed of an inner ring 3, an outer ring 4, a chip module 5, and a power supply module 6;
[0052] In one embodiment, the power supply module 6 is encapsulated between the inner ring 3 and the outer ring 4, and is charged by wireless charging;
[0053] In addition, the chip module 5 includes:
[0054] The signal receiving module should include at least one of the following: a laser receiving module, an infrared light receiving module, and a visible light receiving module.
[0055] The positioning technologies used by existing smart devices include laser positioning technology, infrared optical positioning technology, visible light positioning technology, etc.
[0056] Among them, the basic principle of laser positioning technology is to install several devices that can emit lasers in the space, and emit lasers that scan the space in both horizontal and vertical directions. Multiple laser sensing receivers are placed on the positioned object, and the three-dimensional coordinates of the object are obtained by calculating the angle difference between the two beams of light reaching the positioned object. When the object moves, the three-dimensional coordinates will also change, so the action information is obtained and the action is captured. Among them, the representative product of this type of positioning technology is the Lighthouse of HTC Vive, which installs two "lighthouses" about 2 meters high on the diagonal of the space. The lighthouse can emit 6 laser beams per second. There are two scanning modules inside, which take turns to emit lasers in the horizontal and vertical directions to scan the space for positioning. Up to 70 photosensitive sensors (that is, the laser receiving modules of the present invention) are installed on the head display and two handles of HTC Vive. The accurate position of the sensor position relative to the laser transmitter is obtained by calculating the time of receiving the laser, and the position and direction of the head display and the handle are obtained by using multiple photosensitive sensors at different positions on the head display and the handle;
[0057] Among them, the basic principle of infrared optical positioning technology is to install multiple infrared emitting cameras in the space to cover the entire space. Infrared reflective points are installed on the surface of the object to be located. The infrared light emitted by the camera is reflected by the reflective points, and the camera captures the reflected infrared light. Then, the spatial coordinates of the located object can be obtained through subsequent calculations. The most representative products of this type of positioning technology are OptiTrack's cameras and OptiTrackflex13 motion capture systems.
[0058] Among them, the principle of visible light positioning technology is similar to that of infrared optical positioning technology. It also uses a camera to capture the location information of the tracked object, but it no longer uses infrared light, but directly uses visible light. By installing lights that can emit different colors on different tracked objects, the camera captures these color light spots to distinguish different tracked objects and location information. The most representative product of this type of positioning technology is Sony's PSVR. We can intuitively see the sky blue and pink lights emitted by the two somatosensory handles. Many people think that the blue light emitted by the PSVR headset is just for decoration, but in fact it is also used to be obtained by the camera to calculate the location information.
[0059] Therefore, the signal receiving module of the present invention realizes the spatial positioning of the ring 1 and the secondary ring 2 by receiving the laser, infrared light or visible light from the smart device;
[0060] In addition, it should be noted that the smart devices connected to the main ring 1 and the secondary ring 2 of the present invention can meet most types. Therefore, the signal receiving modules of the main ring 1 and the secondary ring 2 can choose to install one of the laser receiving module, infrared light receiving module, and visible light receiving module for targeted adaptation, or can choose to install multiple for wide adaptation.
[0061] In addition, the signal receiving module of the present invention is used for spatial positioning, and is used to indicate the spatial positions of the main ring 1 and the secondary ring 2 of the present invention.
[0062] In another embodiment, in order to further determine the spatial postures of the main ring 1 and the secondary ring 2, the chip module 5 also includes a gyroscope sensor.
[0063] The chip module 5 on the secondary ring 2 also includes a vibration sensor for detecting when the thumb clicks on the secondary ring 2 .
[0064] Of course, the main ring 1 and the secondary ring 2 are also provided with a wireless transmission module for data transmission. The wireless transmission module can be a 4G, 5G module, a Bluetooth module, a Wi-Fi module, or any combination of the above.
[0065] Embodiment 2:
[0066] The present invention is also used to disclose a gesture input method based on a smart ring:
[0067] The following steps are involved:
[0068] S1. Standard key preset.
[0069] First of all, it should be made clear that, whether it is an adult or a minor, the size of their palm will not change suddenly, that is, the distance between the thumb and other fingers will not change suddenly.
[0070] First, put the main ring 1 on your thumb, and then put the secondary ring 2 on any other finger.
[0071] When using it, we can press our thumb on specific parts of other fingers according to the voice prompts and record the relative position between the two rings at this time.
[0072] Specific reference Figure 3 , when the system prompts "Please press button 1", at this time, we press Figure 3The system records the relative position between the primary ring 1 and the secondary ring 2, and displays the image of the first button on the corresponding position of the finger through the smart device.
[0073] When the system prompts "Please press the second button", we press Figure 3 At the "0" position of the finger, the system records the relative position between the main ring 1 and the secondary ring 2, and displays the image of the second button through the smart device at the corresponding position of the finger.
[0074] It should be noted that when the first button and the second button are determined, the position of the press information display area can be determined. Its starting point should be above the first button and its extension direction is from the first button to the second button.
[0075] At the same time, the above steps are repeated to determine the images of the third button, the fourth button, ..., the nth button, and the relative positions between the main ring 1 and the secondary ring 2 are recorded accordingly;
[0076] Here, it should be understood that the relative position between the main ring 1 and the secondary ring 2 can be determined in the following manner:
[0077] Since both the main ring 1 and the secondary ring 2 are provided with a signal receiving module connected to the smart device, the signal receiving module can determine the spatial position of the main ring 1 and the secondary ring 2. Therefore, the relative spatial position between the main ring 1 and the secondary ring 2 can be determined through the spatial position of the main ring 1 and the secondary ring 2. For example, when the first button is pressed, the spatial coordinates of the main ring 1 are (1.1.1) and the spatial coordinates of the secondary ring 2 are (2.3.1) through the connection with the smart device through the signal receiving module. Then we can determine that when the first button is pressed, the spatial coordinates of the secondary ring 2 relative to the main ring 1 are (1.2.0);
[0078] Of course, in another implementation, in order to make the position information more accurate, we can set gyroscope sensors in both the main ring 1 and the secondary ring 2 to determine their respective spatial postures, and then determine the relative posture. For example, when the first button is pressed, the gyroscope sensor can determine that the main ring 1 has a deflection angle of 10 degrees relative to the X-axis-Y-axis plane, a deflection angle of 10 degrees relative to the X-axis-Z-axis plane, and a deflection angle of 10 degrees relative to the Y-axis-Z-axis plane; the secondary ring 2 has a deflection angle of 20 degrees relative to the X-axis-Y-axis plane, a deflection angle of 30 degrees relative to the X-axis-Z-axis plane, and a deflection angle of 10 degrees relative to the Y-axis-Z-axis plane. Then we can determine that when the first button is pressed, the secondary ring 2 has a deflection angle of 10 degrees, 20 degrees, and 0 degrees in the X-axis-Y-axis plane, the X-axis-Z-axis plane, and the Y-axis-Z-axis plane relative to the main ring 1, respectively.
[0079] In addition, it should be understood that the number of the above buttons can be standardized and customized according to the gesture input, or can be customized individually. For example, when we input numbers, we can refer to Figure 3 Make standard key presets; refer to this when inputting English. Figure 4 Standard buttons are preset; when playing games, game buttons can also be customized according to the game manufacturer's game buttons. The present invention is not restricted to a specific button form.
[0080] S2. Gesture input
[0081] When the gesture button trained in S1 is connected to a smart device, the corresponding text is pressed and the corresponding gesture signal is input on the smart device.
[0082] In one embodiment, a vibration sensor can be used to start and end gesture input. Specifically, the secondary ring 2 is double-clicked with the thumb. At the same time, the vibration sensor on the secondary ring 2 senses the click and outputs a signal to start or end the gesture input.
[0083] Of course, in other embodiments, a specific click method may also be set, and the specific click method for starting or ending the gesture input of the present invention is not limited.
[0084] In order to confirm, the relative position of the thumb clicking to other fingers can be confirmed in the following way. Since the spatial positions of the main ring 1 and the secondary ring 2 can be determined, their respective displacement speeds during the clicking process are known, and thus their relative displacement speeds can be determined. When the gesture input is started, the relative displacement speed is detected. When the relative displacement speed is 0, it is determined that a click has occurred. The relative position and relative spatial posture of the main ring 1 and the secondary ring 2 at that time are recorded, and the corresponding buttons are pressed to complete a click.
[0085] S3. Data Correction
[0086] During the specific process of use, due to the influence of factors such as hand growth and the slow formation of habits, the button position will drift slowly during use. At this time, appropriate corrections should be made within the system.
[0087] Specifically, the correction method can be divided into automatic correction and manual correction.
[0088] Manual correction is to correct by re-performing the standard key preset of S1, which will not be described in detail in the present invention.
[0089] Automatic remediation should include the following steps:
[0090] S31. Define the range. In the above S1, we recorded the relative position and relative spatial posture between the main ring 1 and the secondary ring 2. When performing gesture input, a tolerance range and center value can be defined.
[0091] For example, when inputting "Button 1", we preset the standard button. The standard button preset can be multiple times. The relative positions between the main ring 1 and the secondary ring 2 are (X1, Y1, Z1), (X2, Y2, Z2), (X3, Y3, Z3), ..., (Xn, Yn, Zn), then we can determine the center value as To this end, we can define a tolerance range, and those within the tolerance range are considered to have pressed the "first button". For example, we found that the center value (1.3, 2.3, 3.3) is missing, and the tolerance range is set to 0.2. Then, pressing (1.1-1.5, 2.1-2.5, 3.1-3.5) is considered to have pressed the point (1.3, 2.3, 3.3). The relative spatial posture is the same as above, so I will not repeat it.
[0092] S32. Center value conversion. As the hands grow and habits slowly form, the button positions will slowly drift, and we need to convert the center value. Specifically, record the click coordinates of each click that is within the tolerance range. When the coordinates of multiple clicks are all on one side of the center value, we redetermine the center value. Here, we can set a threshold for the number of offsets. When the coordinates of multiple clicks are continuously on one side of the center value (that is, on one side of a plane that passes through the center value), and the number exceeds the threshold, the center value is redetermined based on the coordinates of the multiple clicks, and the tolerance range remains unchanged.
[0093] Embodiment 3:
[0094] The present invention is also used to disclose a gesture input system based on a smart ring.
[0095] The gesture input system includes the gesture input device described in the above-mentioned embodiment 1.
[0096] Also included are:
[0097] A processing module, the processing module is integrated on the above-mentioned smart device, or is connected to the data of the smart device;
[0098] The processing module includes:
[0099] A standard button preset module is used to preset the relative position and relative posture between the main ring 1 and the secondary ring 2 corresponding to each button;
[0100] A gesture analysis module, used to determine the button to be clicked when the relative position and relative posture between the main ring 1 and the secondary ring 2 are obtained;
[0101] A data correction module, used to correct the relative position and relative posture between the main ring 1 and the secondary ring 2 corresponding to each button;
[0102] The data connection module is used to establish data connection between the main ring 1 and the secondary ring 2, and to connect with smart devices.
[0103] Thus, the present invention achieves the following innovations and advantages:
[0104] When the present invention is used, letters are first preset on the fingers of both hands, and the gesture analysis module is used to determine the letters represented by the click action, and the data transmission module is used to transmit the letters to the smart device, which is conducive to realizing gesture input, improving the accuracy of input, and improving the efficiency of input;
[0105] The device of the present invention is in the shape of a ring and is easy to wear. After the device is worn on the hand, the relative position and relative posture between the two rings are used to determine the input gesture. When using the device, the user can input text information in any posture, which alleviates the soreness caused by the palm being suspended in the air for a long time when using the previous input device, and is conducive to improving the comfort of gesture input;
[0106] The present invention is provided with two parts, the main device is worn on the thumb, and the auxiliary device can be worn on any of the other four thumbs. The free position adjustment of the input device body is realized, which is conducive to adjusting the device position according to the situation and improves the practicality of the device.
[0107] The program for implementing the information control of the present invention can be written in one or more programming languages or a combination thereof to form a computer program code for performing the operation of the present invention, and the programming language includes an object-oriented programming language, such as Java, python, C++, and a conventional procedural programming language, such as C or a similar programming language. The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).
[0108] In the embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation.
[0109] In addition, each functional unit in the embodiment of the present invention may be integrated into a processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units. The above-mentioned integrated unit implemented in the form of software functional units may be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the methods of the various embodiments of the present invention.
[0110] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
Claims
1. A gesture input method based on a smart ring, characterized in that: The method comprises the following steps: Wear the main ring on the thumb and the secondary ring on any other finger; The main ring and the secondary ring are used in conjunction with a smart device, and the smart device is a VR glasses, a smart wearable device, or a smart IoT device; According to the voice prompt, press the thumb on the specific part of other fingers, and record the relative position and posture between the two rings at this time, and correspond the relative position and posture to a certain button, and display the image of the button on the smart device at the corresponding position of the finger; Repeat the above steps to determine the relative position and relative posture between the two rings corresponding to all buttons; When gesture input is activated, the corresponding button is determined based on the relative position and relative posture of the two rings when the button is clicked; The following steps are also included: When "according to the voice prompt, press the thumb on the specific part of other fingers and record the relative position and posture between the two rings at this time", determine the center value and preset the error tolerance range; When gesture input is started, record the click coordinates of each click within the tolerance range. When the coordinates of multiple clicks are all on one side of the center value, redetermine the center value. Among them, redefining the center value mainly includes: A threshold of the number of offsets is set, and when the relative position coordinates and relative posture coordinates of multiple clicks are continuously on one side of the center value, the number of times exceeds the threshold, and the corresponding center value is re-determined according to the relative position coordinates and relative posture coordinates of the multiple clicks; The method for determining the center value is: Assume that the relative position coordinates or relative posture coordinates between the main ring and the secondary ring are: (X1, Y1, Z1), (X2, Y2, Z2), (X3, Y3, Z3), ..., (Xn, Yn, Zn), then the center value is 2. A gesture input system based on a smart ring according to the gesture input method of claim 1, characterized in that: The gesture input system comprises: A gesture input device, the gesture input device comprising a primary ring and a secondary ring; A processing module, the processing module includes a standard button preset module, a gesture analysis module, and a data connection module; The standard button preset module is used to preset the relative position coordinates and relative posture coordinates between the main ring and the secondary ring corresponding to each button; The gesture analysis module is used to determine the clicked button when the relative position coordinates and relative posture coordinates between the main ring and the secondary ring are obtained; A data connection module, used for data connection between the primary ring and the secondary ring, and for connection with smart devices; The processing module also includes a data correction module, which is used to correct the relative position coordinates and relative posture coordinates between the main ring and the secondary ring corresponding to each button.
3. The gesture input system based on a smart ring according to claim 2, characterized in that: The data connection module is at least one of the following: a 4G module, a 5G module, a Bluetooth module, and a Wi-Fi module.
