Input control method and system of intelligent wearable device and computer storage medium

By using smart wearable devices in VR/AR devices, using the finger cover body to receive and process typing and pressing signals, and providing key vibration feedback, the problem of low text input efficiency in the prior art is solved, and higher input accuracy and speed are achieved.

CN120161933APending Publication Date: 2025-06-17GEER TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311720967.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-12-14
Publication Date
2025-06-17

AI Technical Summary

Technical Problem

When entering text with existing VR/AR devices, users need to press the handle keys or gesture recognition multiple times to easily cause errors or missed letters, resulting in extremely low typing efficiency.

Method used

A smart wearable device is designed, including a head-mounted display device and a finger cover body for a cover placed on the wearer's finger. By receiving the typing and pressing signal sent by the fingertip body, obtain the spatial environment image of the fingertip body on the virtual keyboard, determine and send the typing vibration signal, so that the fingertip body can generate vibration and provide key vibration feedback.

Benefits of technology

It improves the typing efficiency during the use of virtual reality devices, reduces errors in typing or missing letters, and enhances the accuracy and speed of user typing input in virtual screens.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120161933A_ABST
    Figure CN120161933A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of virtual interaction, in particular to an input control method and system of an intelligent wearable device and a computer storage medium, the intelligent wearable device comprises a head-mounted display device and a fingerstall body used for sleeving a finger of a wearer, and the input control method is applied to the head-mounted display device; the method comprises the following steps: when a typing pressing signal sent by a fingerstall body is accessed, acquiring a space environment image of the fingerstall body on a preset virtual keyboard; according to the typewriting pressing signal and the space environment image, a typewriting vibration signal corresponding to the fingerstall body is determined; and sending the typewriting vibration signal to the fingerstall body, so that the fingerstall body generates vibration according to the typewriting vibration signal. The typewriting efficiency in the use process of the virtual reality equipment is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of virtual interaction technologies, and particularly to an input control method, system, and computer storage medium for intelligent wearable devices. Background Art

[0002] With the continuous development of VR (Virtual Reality) technology or AR (Augmented Reality) technology, VR / AR devices have gradually entered people's lives, providing entertainment content such as movies and games for people.

[0003] Currently, during the use of VR / AR devices, most users use gamepads or gesture recognition products for text input. However, when users type text using a gamepad, since the button settings of the gamepad are relatively simple, users need to press the buttons of the gamepad multiple times to find the letters they need to input, which greatly reduces the typing speed of users in the virtual screen; and in VR / AR products that can perform gesture recognition, gesture input is prone to problems such as typing the wrong letters or missing letters, resulting in a relatively high error rate of text input, thus causing the typing efficiency of users in the virtual screen to be extremely low. That is to say, how to improve the typing efficiency during the use of virtual reality devices is a technical problem that urgently needs to be solved at present. Summary of the Invention

[0004] The main purpose of this application is to provide an input control method, system, and computer storage medium for intelligent wearable devices, aiming to improve the typing efficiency during the use of virtual reality devices.

[0005] To achieve the above objective, this application provides an input control method for an intelligent wearable device. The intelligent wearable device includes a head-mounted display device and a finger sleeve body for being sleeved on the fingers of a wearer. The input control method is applied to the head-mounted display device;

[0006] The input control method includes:

[0007] When receiving the typing press signal sent by the finger sleeve body, obtain the spatial environment image of the finger sleeve body on a preset virtual keyboard;

[0008] Based on the typing press signal and the spatial environment image, determine the typing vibration signal corresponding to the finger sleeve body;

[0009] Send the typing vibration signal to the finger sleeve body for the finger sleeve body to generate vibration according to the typing vibration signal.

[0010] Optionally, the finger sleeve body includes a plurality of finger-enabled finger sleeves, and the step of determining the typing vibration signal corresponding to the finger sleeve body according to the typing press signal and the spatial environment image includes:

[0011] According to the typing press signal, determine the target finger sleeve code for the finger sleeve body to perform the typing press action;

[0012] Determine the designated sleeve finger sleeve codes of each of the finger-enabled finger sleeves, and search for the target finger finger sleeve that matches the target finger sleeve code from the plurality of finger-enabled finger sleeves according to the sleeve finger sleeve code. The target finger finger sleeve is the finger-enabled finger sleeve with the same sleeve finger sleeve code as the target finger sleeve code;

[0013] According to the target finger finger sleeve and the spatial environment image, determine the typing vibration signal corresponding to the finger sleeve body.

[0014] Optionally, the step of determining the typing vibration signal corresponding to the finger sleeve body according to the target finger finger sleeve and the spatial environment image includes:

[0015] Determine the keyboard key contact points of the target finger finger sleeve according to the spatial environment image, and determine the key coordinate positions of the keyboard key contact points in the three-dimensional space where the virtual keyboard is located;

[0016] In response to the keyboard key character corresponding to the key coordinate position, obtain the vibration enable signal of the target finger finger sleeve, and use the vibration enable signal as the typing vibration signal corresponding to the finger sleeve body.

[0017] In addition, to achieve the above object, the present application also provides an input control method for an intelligent wearable device. The intelligent wearable device includes a head-mounted display device and a finger sleeve body for being sleeved on the fingers of a wearer. The input control method is applied to the finger sleeve body;

[0018] The input control method includes:

[0019] After the head-mounted display device displays a preset virtual keyboard, perform a typing press action on the virtual keyboard to obtain a typing press signal;

[0020] After receiving the typing vibration signal sent by the head-mounted display device, generate vibration according to the typing vibration signal; wherein,

[0021] The head-mounted display device is further configured to obtain the spatial environment image of the finger sleeve body on the preset virtual keyboard, and determine the typing vibration signal corresponding to the finger sleeve body according to the typing press signal and the spatial environment image.

[0022] In addition, to achieve the above object, the present application further provides an input control system for a smart wearable device. The input control system of the smart wearable device includes a finger sleeve body sleeved on the finger of a wearer;

[0023] The finger sleeve body includes a plurality of finger-enabled finger sleeves, and each of the finger-enabled finger sleeves is provided with a processing module and a sensing module for two-way communication; wherein,

[0024] The processing module is disposed on the side of each finger-enabled finger sleeve close to the nail bed of the wearer's finger, and the sensing module is disposed on the side of each finger-enabled finger sleeve close to the pulp of the wearer's finger.

[0025] The sensing module is configured to obtain a typing press signal in response to a typing press action performed by the finger sleeve body, and send the typing press signal to the processing module;

[0026] The processing module is configured to upload the typing press signal to a head-mounted display device, and after the head-mounted display device determines a typing vibration signal corresponding to the finger sleeve body according to the typing press signal and a spatial environment image, forward the typing vibration signal sent by the head-mounted display device to the sensing module;

[0027] The sensing module is further configured to receive the typing vibration signal forwarded by the processing module and generate vibration according to the typing vibration signal.

[0028] Optionally, each of the finger-enabled finger sleeves is provided with a receiving cavity for sleeving the finger of the wearer;

[0029] The sensing module includes a capacitance unit and a vibration unit, and the capacitance unit and the vibration unit are respectively electrically connected to the processing module; wherein,

[0030] The capacitance unit and the vibration unit are stacked, the capacitance unit is disposed in the receiving cavity away from the pulp side, and the vibration unit is disposed in the receiving cavity close to the pulp side.

[0031] Optionally, the processing module further includes a communication unit and a working unit;

[0032] The working unit is communicatively connected to the head-mounted display device through the communication unit, and the working unit is respectively electrically connected to the capacitance unit and the vibration unit; wherein,

[0033] The communication unit and the working unit are stacked, the communication unit is disposed in the receiving cavity away from the nail bed side, and the working unit is disposed in the receiving cavity close to the nail bed side;

[0034] The working unit is configured to send the typing press signal sent by the capacitance unit to the head-mounted display device, and after the head-mounted display device determines the typing vibration signal corresponding to the finger sleeve body according to the typing press signal and the spatial environment image, forward the typing vibration signal sent by the head-mounted display device to the vibration unit.

[0035] Optionally, the working unit includes a working chip and a power supply battery, and the working chip is electrically connected to the power supply battery; wherein,

[0036] The working chip and the power supply battery are arranged side by side in the accommodating cavity near the nail bed side.

[0037] Optionally, the input control system of the intelligent wearable device further includes the head-mounted display device, and the head-mounted display device at least includes a virtual reality glasses and a head-mounted display processor, and the virtual reality glasses and the head-mounted display processor are communicatively connected; wherein,

[0038] The virtual reality glasses are configured to generate a keyboard display image corresponding to a preset virtual keyboard in response to a virtual keyboard display signal output by the head-mounted display processor, and display the keyboard display image.

[0039] In addition, to achieve the above object, the present application further provides a computer storage medium, on which an input control program of the intelligent wearable device is stored, and when the input control program of the intelligent wearable device is executed by a processor, the steps of the above intelligent wearable device are implemented.

[0040] The intelligent wearable device designed in the present application includes a head-mounted display device for two-way communication, and a finger sleeve body for being sleeved on the finger of a wearer. When the user performs a typing press action on a preset virtual keyboard displayed by the head-mounted display device through the finger sleeve body, the obtained typing press signal is quickly sent to the head-mounted display device through the finger sleeve body, so as to provide an accurate typing press signal for the subsequent processing flow of perceiving vibration feedback of the corresponding finger; when the head-mounted display device accesses the typing press signal sent by the finger sleeve body, it timely acquires the spatial environment image of the finger sleeve body on the preset virtual keyboard; then, according to the typing press signal and the spatial environment image, the typing vibration signal corresponding to the finger sleeve body can be accurately obtained, and the typing vibration signal is timely sent to the finger sleeve body. At this time, the finger sleeve body will generate vibration for the finger of the user performing the typing press according to the typing vibration signal, so that the finger of the user performing the typing press can timely obtain the key vibration feedback, avoiding the problem that the existing gesture input recognition is prone to typing errors or missing letters, so that the user who obtains the key vibration feedback can improve the accuracy and speed of typing input in the virtual screen, thereby effectively improving the typing efficiency during the use of the virtual reality device. Description of the Drawings

[0041] Figure 1 is a schematic flowchart of the first embodiment of the input control method of the present application;

[0042] Figure 2 is a schematic structural diagram of the input control system of the intelligent wearable device of the present application;

[0043] Figure 3 is a schematic cross-sectional view of the finger-enabled finger sleeve according to the embodiment of the present application;

[0044] Figure 4 is a schematic structural diagram of the head-mounted display device according to the embodiment of the present application;

[0045] Figure 5 is a schematic diagram of another application scenario of the intelligent wearable device according to the embodiment of the present application.

[0046] Explanation of the reference numerals in the drawings:

[0047] Label Name Label Name M10 Input control system of intelligent wearable device 100 Finger sleeve body 200 Head-mounted display device 10 Processing module 20 Induction module 201 Capacitance unit 202 Vibration unit 300 Virtual reality glasses 400 Head-mounted display processor Hx Finger-enabled finger sleeve

[0048] The realization of the purpose, functional features and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. Detailed implementation manners

[0049] Here, the exemplary embodiments will be described in detail, and the examples are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0050] It should be noted that in this article, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including one..." does not exclude the existence of another identical element in the process, method, article or device including that element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanations in the specific embodiments or further in combination with the context of the specific embodiments.

[0051] It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of this document, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to determining". Furthermore, as used in this document, the singular forms "a", "an", and "the" are also intended to include the plural forms unless the context indicates otherwise. It should be further understood that the terms "comprising", "including" indicate the presence of the stated features, steps, operations, elements, components, items, types, and / or groups, but do not preclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, types, and / or groups. The terms "or", "and / or", "including at least one of the following", etc. used in this application may be interpreted inclusively, or mean any one or any combination. For example, "including at least one of the following: A, B, C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C", and again, "A, B or C" or "A, B and / or C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C". An exception to this definition only occurs when the combination of elements, functions, steps, or operations is inherently mutually exclusive in some way.

[0052] It should be understood that although the steps in the flowchart in the embodiments of this application are shown sequentially according to the indication of the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless there is a clear indication in this document, the execution of these steps has no strict order limit and may be executed in other orders. Moreover, at least a part of the steps in the figure may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and their execution order is not necessarily sequential, but may be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.

[0053] Depending on the context, the words "if", "when" as used herein may be interpreted as "when" or "while" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrase "if determined" or "if detecting (stated condition or event)" may be interpreted as "when determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)".

[0054] It should be noted that in this text, step codes such as S10 and S20 are adopted. The purpose is to more clearly and briefly express the corresponding content, and it does not constitute a substantial limitation in terms of sequence. Those skilled in the art may execute S20 first and then S10 during specific implementation, etc., but all of these should be within the protection scope of this application.

[0055] It should be understood that the specific embodiments described herein are only used to explain this application and are not used to limit this application.

[0056] In subsequent descriptions, suffixes such as "module", "component", or "unit" used to represent elements are only for the convenience of explaining this application, and they have no specific meaning in themselves. Therefore, "module", "component", or "unit" can be used interchangeably.

[0057] An input control method for a smart wearable device is provided in an embodiment of this application. Among them, the smart wearable device includes a head-mounted display device for two-way communication, and a finger sleeve body for being sleeved on the finger of a wearer. Refer to Figure 1 as shown Figure 1 is a schematic flowchart of the first embodiment of the input control method of this application. The input control method of this application can be applied to the head-mounted display device, that is, the input control method of this application can be executed by the head-mounted display device.

[0058] The input control method of this application includes:

[0059] Step S10: When receiving the typing press signal sent by the finger sleeve body, obtain the spatial environment image of the finger sleeve body on a preset virtual keyboard.

[0060] In this embodiment, when the user performs a typing press action on the preset virtual keyboard displayed by the head-mounted display device through the finger sleeve body, the obtained typing press signal is quickly sent to the head-mounted display device through the finger sleeve body, so as to provide an accurate typing press signal for the subsequent processing flow of perceiving vibration feedback of the corresponding finger. At this time, when the head-mounted display device receives the typing press signal sent by the finger sleeve body, it can timely and accurately obtain the spatial environment image of the finger sleeve body on the preset virtual keyboard.

[0061] It should be noted that the typing press signal can at least include a target finger sleeve code and a capacitance press electrical signal. Among them, the target finger sleeve code can be understood as a finger-enabled finger sleeve for identifying the finger that the finger sleeve body executes the typing press action, and the finger-enabled finger sleeve of the finger that the finger sleeve body executes the typing press action can also be called the target finger finger sleeve.

[0062] The head-mounted display device can be, for example, a Mixed Reality (MR) device, an Augmented Reality (AR) device, a Virtual Reality (VR) device, an Extended Reality (XR) device, or some combination thereof.

[0063] The preset virtual keyboard can be a software component that allows for character input without physical keys.

[0064] The spatial environment image can be understood as the hand image of the finger sleeve body performing a typing press action on the virtual keyboard image. And this spatial environment image at least includes the typing key pixels of each enabled glove finger in the finger sleeve body.

[0065] Step S20: Determine the typing vibration signal corresponding to the finger sleeve body according to the typing press signal and the spatial environment image.

[0066] In this embodiment, according to the typing press signal sent by the finger sleeve body, the target finger sleeve code for the finger sleeve body to perform the typing press action can be accurately obtained; then determine the sleeved finger sleeve codes specified for each finger enabled finger sleeve in the finger sleeve body, and according to the sleeved finger sleeve codes, the target finger finger sleeve that matches the target finger sleeve code can be accurately found from multiple finger enabled finger sleeves; then obtain the typing key pixels of all enabled glove finger sleeves in the spatial environment image, and use the typing key pixels corresponding to the target finger finger sleeve found from each typing key pixel as the keyboard key contacts of the target finger finger sleeve; then perform three-dimensional reconstruction on the pixel contact position of the keyboard key contacts according to the three-dimensional space where the virtual keyboard is located to obtain the key coordinate position of the keyboard key contacts in this three-dimensional space; then the head-mounted display device responds to the keyboard key characters corresponding to the key coordinate position to obtain the vibration enabling signal of the target finger finger sleeve, and use the vibration enabling signal as the typing vibration signal corresponding to the finger sleeve body.

[0067] In this embodiment, the present application registers and aligns the pixel contact positions of the keyboard key contacts in the spatial environment image with the three-dimensional space where the preset virtual keyboard is located through the head-mounted display device, so as to accurately obtain the key coordinate positions of the keyboard key contacts in the three-dimensional space. Then, according to the key coordinate positions, the keyboard key characters pressed by the target finger thimble can be accurately obtained. Then, the head-mounted display device responds to the keyboard key characters to obtain the vibration enable signal of the target finger thimble, and uses the vibration enable signal as the typing vibration signal corresponding to the thimble body, so that the user can generate vibrations on the fingers through the target finger thimble in the thimble body for the typing vibration signal sent by the head-mounted display device, so that the fingers of the user for typing and pressing can timely obtain the key vibration feedback, and further enable the user who obtains the key vibration feedback to improve the accuracy and speed of typing input in the virtual screen.

[0068] Step S30: Send the typing vibration signal to the thimble body for the thimble body to generate vibration according to the typing vibration signal.

[0069] In this embodiment, according to the communication connection between the head-mounted display device and the thimble body, the head-mounted display device sends the typing vibration signal to the target finger thimble in the thimble body, and then the target finger thimble generates vibrations on the fingers according to the typing vibration signal, so that the fingers of the user for typing and pressing can timely obtain the key vibration feedback, and further enable the user who obtains the key vibration feedback to improve the accuracy and speed of typing input in the virtual screen.

[0070] Further, in some other feasible embodiments, the thimble body includes a plurality of finger enable thimbles. The above step S20: determining the typing vibration signal corresponding to the thimble body according to the typing press signal and the spatial environment image may further include the following implementation steps:

[0071] Step S201: Determine the target thimble code of the thimble body performing the typing press action according to the typing press signal.

[0072] In this embodiment, the head-mounted display device performs thimble code recognition on the typing press signal sent by the thimble body, and can accurately obtain the target thimble code of the thimble body performing the typing press action.

[0073] It should be noted that the finger sleeve body generally includes 10 finger-enabled finger sleeves, which can also be customized according to the user's needs, and the present application does not make any restrictions here. In addition, each finger-enabled finger sleeve corresponds to a set finger sleeve code, and the set finger sleeve code can be "R-1, R-2, R-3, R-4, R-5, L-1, L-2, L-3, L-4, and L-5". Among them, R-1 can be the set finger sleeve code designated for the finger-enabled finger sleeve worn on the right thumb of the wearer, R-2 can be the set finger sleeve code designated for the finger-enabled finger sleeve worn on the right index finger of the wearer, R-3 can be the set finger sleeve code designated for the finger-enabled finger sleeve worn on the right middle finger of the wearer, R-4 can be the set finger sleeve code designated for the finger-enabled finger sleeve worn on the right ring finger of the wearer, R-5 can be the set finger sleeve code designated for the finger-enabled finger sleeve worn on the right little finger of the wearer, L-1 can be the set finger sleeve code designated for the finger-enabled finger sleeve worn on the left thumb of the wearer, L-2 can be the set finger sleeve code designated for the finger-enabled finger sleeve worn on the left index finger of the wearer, L-3 can be the set finger sleeve code designated for the finger-enabled finger sleeve worn on the left middle finger of the wearer, L-4 can be the set finger sleeve code designated for the finger-enabled finger sleeve worn on the left ring finger of the wearer, and L-5 can be the set finger sleeve code designated for the finger-enabled finger sleeve worn on the left little finger of the wearer. The above definition method of the set finger sleeve code is only one implementation mode of the implementation scheme of the present application, and the present application does not make any restrictions on the definition method of the set finger sleeve code.

[0074] Step S202: Determine the set finger sleeve codes designated for each of the finger-enabled finger sleeves, and search for the target finger sleeve that matches the target finger sleeve code from the multiple finger-enabled finger sleeves according to the set finger sleeve codes, where the target finger sleeve is the finger-enabled finger sleeve with the same set finger sleeve code as the target finger sleeve code.

[0075] In this embodiment, the head-mounted display device first determines the set finger sleeve codes designated for each finger-enabled finger sleeve, and then searches for the target finger sleeve that matches the target finger sleeve code from the multiple finger-enabled finger sleeves according to the set finger sleeve codes, where the target finger sleeve is the finger-enabled finger sleeve with the same set finger sleeve code as the target finger sleeve code.

[0076] In a specific embodiment, assuming that the target finger sleeve code is "L-2", after determining the set finger sleeve codes designated for each finger-enabled finger sleeve, compare the target finger sleeve code with the set finger sleeve codes designated for all finger-enabled finger sleeves in the order from left hand to right hand or from right hand to left hand until the set finger sleeve code that is the same as the target finger sleeve code is obtained, and then use the finger-enabled finger sleeve with the same set finger sleeve code as the target finger sleeve code as the target finger sleeve.

[0077] It should be noted that the left - hand order can be from the left - hand thumb to the little finger or from the left - hand little finger to the thumb; the right - hand order can be from the right - hand thumb to the little finger or from the right - hand little finger to the thumb.

[0078] Step S203: Determine the typing vibration signal corresponding to the finger - sleeve body according to the target finger - sleeve and the spatial environment image.

[0079] In this embodiment, determine the keyboard key contacts of the target finger - sleeve according to the spatial environment image, and determine the key coordinate positions of these keyboard key contacts in the three - dimensional space where the virtual keyboard is located; then, in response to the keyboard key characters corresponding to the key coordinate positions, obtain the vibration enabling signal of the target finger - sleeve, and use the vibration enabling signal as the typing vibration signal corresponding to the finger - sleeve body, so that the user can generate vibrations on the fingers through the typing vibration signal sent by the target finger - sleeve in the finger - sleeve body, enabling the fingers for typing presses to receive key vibration feedback in a timely manner, and further enabling the user who receives the key vibration feedback to improve the accuracy and speed of typing input in the virtual screen.

[0080] Further, in some feasible embodiments, the above - mentioned step S203: Determine the typing vibration signal corresponding to the finger - sleeve body according to the target finger - sleeve and the spatial environment image may further include the following implementation steps:

[0081] Step S2031: Determine the keyboard key contacts of the target finger - sleeve according to the spatial environment image, and determine the key coordinate positions of the keyboard key contacts in the three - dimensional space where the virtual keyboard is located.

[0082] In this embodiment, after determining the typing key pixel points of each finger - enabling finger - sleeve in the spatial environment image, arrange the typing key pixel points in descending or ascending order according to the gray - scale values of each typing key pixel point; then traverse the arranged typing key pixel points in descending or ascending order of gray - scale values until the typing key pixel point corresponding to the target finger - sleeve is obtained, and use this typing key pixel point as the keyboard key contact of the target finger - sleeve; then, identify the pixel contact position of this keyboard key contact in the spatial environment image through the head - mounted display device, and finally perform three - dimensional reconstruction on this pixel contact position according to the three - dimensional space where the virtual keyboard is located to obtain the key coordinate position of this keyboard key contact in this three - dimensional space.

[0083] Step S2032: In response to the keyboard key characters corresponding to the key coordinate positions, obtain the vibration enabling signal of the target finger - sleeve, and use the vibration enabling signal as the typing vibration signal corresponding to the finger - sleeve body.

[0084] In this embodiment, the present application registers and aligns the pixel contact positions of the keyboard key contacts in the spatial environment image with the three-dimensional space where the preset virtual keyboard is located through the head-mounted display device, so as to accurately obtain the key coordinate positions of the keyboard key contacts in the three-dimensional space. Then, according to the key coordinate positions, the keyboard key characters pressed by the target finger thimble can be accurately obtained. Then, the head-mounted display device responds to the keyboard key characters, obtains the vibration enable signal of the target finger thimble, and uses the vibration enable signal as the typing vibration signal corresponding to the thimble body, so that the user can generate vibrations on the fingers through the target finger thimble in the thimble body for the typing vibration signal sent by the head-mounted display device, enabling the fingers of the user for typing and pressing to obtain key vibration feedback in a timely manner. Furthermore, the user who obtains the key vibration feedback can improve the accuracy and speed of typing input in the virtual screen.

[0085] In summary, the intelligent wearable device designed by the present application includes a head-mounted display device for two-way communication and a thimble body for being worn on the fingers of the wearer. When the user performs a typing and pressing action on the preset virtual keyboard displayed by the head-mounted display device through the thimble body, the obtained typing and pressing signal is quickly sent to the head-mounted display device through the thimble body, so as to provide an accurate typing and pressing signal for the subsequent processing flow of perceiving vibration feedback for the corresponding finger. When the head-mounted display device receives the typing and pressing signal sent by the thimble body, it timely acquires the spatial environment image of the thimble body on the preset virtual keyboard. Then, based on the typing and pressing signal and the spatial environment image, the typing vibration signal corresponding to the thimble body can be accurately obtained, and the typing vibration signal is timely sent to the thimble body. At this time, the thimble body will generate vibrations on the fingers of the user for typing and pressing according to the typing vibration signal, enabling the fingers of the user for typing and pressing to obtain key vibration feedback in a timely manner, avoiding the problem that existing gesture input recognition is prone to typing errors or missing letters, so that the user who obtains the key vibration feedback can improve the accuracy and speed of typing input in the virtual screen, thereby effectively improving the typing efficiency during the use of virtual reality devices.

[0086] Furthermore, based on the first embodiment of the input control method of the present application, a second embodiment of the input control method of the present application is proposed.

[0087] The present application embodiment provides an input control method for an intelligent wearable device. The intelligent wearable device includes a head-mounted display device for two-way communication and a thimble body for being worn on the fingers of the wearer. The input control method of the present application can be applied to the thimble body, that is, the input control method of the present application can be executed by the thimble body.

[0088] The input control method of the present application includes:

[0089] Step A10: After the preset virtual keyboard is displayed on the head-mounted display device, perform a typing pressing action on the virtual keyboard to obtain a typing pressing signal.

[0090] In this embodiment, after the preset virtual keyboard is displayed on the head-mounted display device, the finger sleeve body will access the virtual keyboard display signal sent by the head-mounted display device, and automatically switch the standby state of the finger sleeve body to the input startup state according to the virtual keyboard display signal. That is, the finger sleeve body designed in this application only works (i.e., the input startup state) when the preset virtual keyboard is displayed on the head-mounted display device, thus effectively avoiding the phenomenon of accidental triggering by the user in the virtual plane. Then, when the wearer uses the finger in the finger sleeve body to enable the finger sleeve to perform a typing pressing operation on the virtual keyboard displayed on the head-mounted display device, the sensing module of the finger enabling finger sleeve responds to the typing pressing operation, outputs a typing pressing signal to the processing module of the finger enabling finger sleeve, and through the communication connection between the processing module and the head-mounted display device, sends the output typing pressing signal to the head-mounted display device, so as to provide an accurate typing pressing signal for the subsequent processing flow of the corresponding finger sensing vibration feedback.

[0091] It should be noted that the finger sleeve body 100 may include a plurality of finger enabling finger sleeves Hx. Each finger enabling finger sleeve is provided with a processing module 10 and a sensing module 20 for two-way communication, and the processing module 10 is electrically connected to the sensing module 20.

[0092] Step A20: After accessing the typing vibration signal sent by the head-mounted display device, generate vibration according to the typing vibration signal; wherein, the head-mounted display device is further configured to obtain a spatial environment image of the finger sleeve body on the preset virtual keyboard, and determine the typing vibration signal corresponding to the finger sleeve body according to the typing pressing signal and the spatial environment image.

[0093] When the head-mounted display device accesses the typing pressing signal sent by the finger sleeve body, the head-mounted display device can also timely and accurately obtain the spatial environment image of the finger sleeve body on the preset virtual keyboard, determine the typing vibration signal corresponding to the finger sleeve body according to the typing pressing signal and the spatial environment image, and send the typing vibration signal to the finger sleeve body. And after the target finger sleeve in the finger sleeve body accesses the typing vibration signal sent by the head-mounted display device, the target finger sleeve generates vibration for the finger according to the typing vibration signal, so that the finger of the user performing the typing pressing can obtain the key vibration feedback in time, and further enables the user who obtains the key vibration feedback to improve the accuracy and speed of typing input in the virtual screen.

[0094] Further, based on the first embodiment and the second embodiment of the input control method of the present application, a third embodiment of the input control method of the present application is proposed. Refer to Figure 2As shown Figure 2 is a schematic structural diagram related to the input control system of the intelligent wearable device of the present application.

[0095] The input control system of the intelligent wearable device of the present application includes a finger sleeve body 100 sleeved on the finger of the wearer; the finger sleeve body 100 includes a plurality of finger-enabled finger sleeves Hx, and each of the finger-enabled finger sleeves Hx is provided with a processing module 10 and a sensing module 20 for two-way communication; wherein,

[0096] The processing module 10 is provided on the side of each finger-enabled finger sleeve Hx close to the nail bed of the wearer's finger, and the sensing module 20 is provided on the side of each finger-enabled finger sleeve Hx close to the pulp of the wearer's finger;

[0097] The sensing module 20 is configured to obtain a typing press signal in response to a typing press action performed by the finger sleeve body 100; and send the typing press signal to the processing module 10;

[0098] The processing module 10 is configured to upload the typing press signal to the head-mounted display device 200, and after the head-mounted display device 200 determines a typing vibration signal corresponding to the finger sleeve body according to the typing press signal and the spatial environment image, forward the typing vibration signal sent by the head-mounted display device 200 to the sensing module 20;

[0099] The sensing module 20 is further configured to receive the typing vibration signal forwarded by the processing module 10 and generate vibration according to the typing vibration signal.

[0100] In this embodiment, the finger sleeve body 100 and the head-mounted display device 200 can establish a communication connection through a communication chip in Bluetooth mode, and the finger sleeve body 100 is used to be sleeved on the fingers of the wearer. Among them, a processing module 10 is arranged on the side of each finger enabling finger sleeve Hx of the finger sleeve body 100 close to the nail bed of the wearer's finger, and a sensing module 20 is arranged on the side of each finger enabling finger sleeve Hx of the finger sleeve body 100 close to the finger pulp of the finger. When the wearer performs a typing press operation on a preset virtual keyboard displayed by the head-mounted display device 200 through the finger enabling finger sleeve Hx of the finger sleeve body 100, the sensing module 20 can timely obtain a typing press signal corresponding to the finger and the finger enabling finger sleeve Hx. Then, according to the electrical connection between the processing module 10 and the sensing module 20, the sensing module 20 sends the typing press signal to the processing module 10. Then, according to the communication connection between the processing module 10 and the head-mounted display device 200, the processing module 10 quickly sends the received typing press signal to the head-mounted display device 200, so as to provide an accurate typing press signal for the subsequent processing flow of sensing vibration feedback for the corresponding finger sleeved with the finger enabling finger sleeve Hx. At this time, based on the received typing press signal and the spatial environment image of the finger sleeve body on the preset virtual keyboard, the head-mounted display device 200 can accurately obtain a vibration enabling signal of the finger enabling finger sleeve Hx (i.e., a typing vibration signal corresponding to the finger sleeve body 100), and according to the communication connection between the processing module 10 and the head-mounted display device 200, the head-mounted display device 200 sends the typing vibration signal to the processing module 10 and sends the typing vibration signal to the sensing module 20 through the processing module 10. At this time, the sensing module 20 will quickly generate vibration for the corresponding finger sleeved with the finger enabling finger sleeve Hx, so that the user can timely obtain key vibration feedback through the corresponding finger sleeved with the finger enabling finger sleeve Hx, which not only meets the user's requirement of still wanting to enjoy the mechanical keyboard touch when using the virtual keyboard, but also enables the user who obtains the key vibration feedback to improve the accuracy and speed of typing input in the virtual screen.

[0101] It should be noted that each finger enabling finger sleeve Hx in the finger sleeve body 100 is respectively worn on the fingers of the user's both hands, that is, the present application effectively improves the typing input speed of the user in the virtual screen by designing multiple finger sleeve bodies 100 to adapt to the both hands of the wearer. In addition, the total number of finger enabling finger sleeves Hx can be 10, and the present application does not make any restrictions here.

[0102] Furthermore, in some feasible embodiments, each finger enabling finger sleeve Hx is provided with a receiving cavity for sleeving the finger of the wearer;

[0103] The induction module 20 includes a capacitance unit 201 and a vibration unit 202. The capacitance unit 201 and the vibration unit 202 are respectively electrically connected to the processing module 10. Among them,

[0104] The capacitance unit 201 and the vibration unit 202 are stacked. The capacitance unit 201 is arranged on the side of the accommodation cavity far from the finger pulp, and the vibration unit 202 is arranged on the side of the accommodation cavity close to the finger pulp.

[0105] In this embodiment, referring to Figures 2 to 3 , Figure 3 is a schematic cross-sectional view of the finger-enabled finger sleeve involved in the embodiment solution of the present application. Each finger-enabled finger sleeve Hx is provided with an accommodation cavity, and the finger of the wearer is placed in the accommodation cavity, so as to ensure that each finger-enabled finger sleeve Hx is firmly sleeved on the finger of the wearer. And each finger-enabled finger sleeve Hx can be made of an elastic material. The finger-enabled finger sleeve Hx made of an elastic material can facilitate the wearer to put on and take off, thereby effectively improving the wearing efficiency of the user.

[0106] In a specific embodiment, referring to Figure 2 , the induction module 20 may further include a capacitance unit 201 and a vibration unit 202. A simple and convenient signal interaction method is constructed through the electrical connection modes of the capacitance unit 201 and the vibration unit 202 with the processing module 10 respectively. In addition, the capacitance unit 201 is arranged on the first side of the vibration unit 202. Among them, the first side of the vibration unit 202 refers to the touch side of the finger sleeve body 100 close to the virtual keyboard image, that is, in the present application, the capacitance unit 201 is arranged on the touch side of the finger sleeve body 100 close to the virtual keyboard image, and the effective touch of the finger can be accurately detected. And the second side of the vibration unit 202 is arranged in the accommodation cavity close to the finger pulp side of the finger, and the corresponding finger of the user can be accurately reminded to sense the vibration emitted by the vibration unit 202 in time.

[0107] It should be noted that the capacitance unit 201 may be a capacitance pressure sensor, and the capacitance pressure sensor may include a fingertip bionic contact capacitance.

[0108] In addition, it should be noted that the vibration unit 202 may be a micro vibration motor. And the vibration frequency or frequency of the micro vibration motor can be customized according to the needs of the user, and the vibration frequency or frequency of the micro vibration motor in each finger-enabled finger sleeve Hx may also be different or the same. When the vibration frequency or frequency of the micro vibration motor in each finger-enabled finger sleeve Hx is different, the user can further determine whether the key input of the corresponding finger is correct according to different vibration frequencies or frequencies, further improving the accuracy of the user's typing input in the virtual screen.

[0109] In a specific embodiment, after a finger wearing the finger-enabled finger sleeve Hx touches the virtual keyboard displayed on the head-mounted display device, the capacitance value of the fingertip bionic contact capacitor changes. At this time, after the capacitance pressure sensor detects the change in the capacitance value of the fingertip bionic contact capacitor, it outputs a typing press signal of the finger-enabled finger sleeve Hx, and according to the electrical connection between the capacitance pressure sensor and the processing module 10, feeds back this typing press signal to the processing module 10 in a timely manner. Then, according to the communication connection between the processing module 10 and the head-mounted display device 200, the processing module 10 quickly sends the received typing press signal to the head-mounted display device 200, so as to provide an accurate typing press signal for the subsequent processing flow of the corresponding finger sensing vibration feedback. At this time, based on the received typing press signal and the spatial environment image, the head-mounted display device 200 can accurately obtain the typing vibration signal corresponding to the finger sleeve body 100, and according to the communication connection between the processing module 10 and the head-mounted display device 200, the head-mounted display device 200 sends this typing vibration signal to the processing module 10, and sends this typing vibration signal to the micro vibration motor through the processing module 10. At this time, the micro vibration motor responds to this typing vibration signal and quickly generates vibration for the finger, so that the finger for typing press by the user can obtain the key vibration feedback in a timely manner, thereby enabling the user who obtains the key vibration feedback to improve the accuracy and speed of typing input in the virtual screen.

[0110] Further, in some other feasible embodiments, referring to Figure 2 , the processing module 10 further includes a communication unit 101 and a working unit 102;

[0111] The working unit 102 is communicatively connected to the head-mounted display device 200 through the communication unit 101, and the working unit 102 is electrically connected to the capacitance unit 201 and the vibration unit 202 respectively; wherein,

[0112] The communication unit 101 and the working unit 102 are stacked, the communication unit 101 is disposed on the side of the accommodation cavity away from the nail bed, and the working unit 102 is disposed on the side of the accommodation cavity close to the nail bed;

[0113] The working unit 102 is configured to send the typing press signal sent by the capacitance unit 201 to the head-mounted display device 200, and after the head-mounted display device 200 determines the typing vibration signal corresponding to the finger sleeve body according to the typing press signal and the spatial environment image, forward the typing vibration signal sent by the head-mounted display device 200 to the vibration unit 202.

[0114] In this embodiment, according to the electrical connection between the working unit 102 and the capacitive unit 201, the working unit 102 receives the typing press signal collected by the capacitive pressure sensor (i.e., the capacitive unit 201), and then sends the typing press signal to the head-mounted display device 200 through the communication unit 101. At this time, based on the received typing press signal, the head-mounted display device 200 can accurately obtain the typing vibration signal of the target finger finger sleeve in the finger sleeve body 100, and send the typing vibration signal to the working unit 102 through the communication unit 101. Then, according to the electrical connection between the working unit 102 and the vibration unit 202, the working unit 102 forwards the typing vibration signal to the vibration unit 202, and the vibration unit 202 generates vibration for the finger wearing the target finger finger sleeve according to the typing vibration signal, so that the finger of the user performing the typing press can timely obtain the key vibration feedback, which not only meets the requirement that the user still wants to enjoy the mechanical keyboard touch when using the virtual keyboard, but also enables the user who obtains the key vibration feedback to improve the accuracy and speed of typing input in the virtual screen.

[0115] It should be noted that the communication unit 101 can be a communication chip in Bluetooth mode, and / or a communication antenna. And the communication chip in Bluetooth mode can be understood as a communication chip with low energy consumption of Bluetooth, and the communication antenna can also be provided with a fast communication chip with low power consumption.

[0116] In this embodiment, the working unit 102 in each finger enabling finger sleeve Hx communicates with the head-mounted display device 200 through the communication unit 101, and the working unit 102 is electrically connected to the capacitive unit 201 and the vibration unit 202 respectively. Through the above circuit communication method, the signals to be processed by each finger enabling finger sleeve Hx in the finger sleeve body 100 of the present application are relatively simple, and then the communication connection between each finger enabling finger sleeve Hx and the head-mounted display device 200 is established through BLE (Bluetooth Low Energy), other low-power communication chips or other fast communication methods, thereby effectively improving the information transmission speed from the finger sleeve body 100 to the head-mounted display device 200, that is, respectively improving the information upload speed of the working unit 102 and the information download speed of the head-mounted display device 200.

[0117] Furthermore, in some feasible embodiments, the working unit 102 includes a working chip and a power supply battery, and the working chip is electrically connected to the power supply battery; wherein,

[0118] The working chip and the power supply battery are arranged side by side on the side of the nail bed of the finger close to the finger in the accommodating cavity.

[0119] In this embodiment, the working unit 102 includes a working chip and a power supply battery. The working chip is electrically connected to the power supply battery, and the power supply battery provides a stable power supply for the working chip. Among them, the working chip and the power supply battery are arranged side by side on the side of the nail bed close to the finger in the accommodating cavity.

[0120] It should be noted that the power supply battery can be a micro lithium battery; the working chip can be an electronic controller, and the electronic controller includes, but is not limited to, a single-chip microcontroller and a central processing unit.

[0121] In another embodiment, the working unit 102 can also be integrated with a communication unit 101. That is, when the working unit 102 is integrated with the communication unit 101, the working unit 101 can directly establish a communication connection with the head-mounted display device 200, and is used to transmit the typing pressing signal received by the working unit 101 to the head-mounted display device 200 in time, thereby effectively improving the signal transmission speed between the finger sleeve body 100 and the head-mounted display device 200.

[0122] Furthermore, in some other feasible embodiments, the head-mounted display device 200 at least includes a virtual reality glasses 300 and a head-mounted display processor 400, and the virtual reality glasses 300 and the head-mounted display processor 400 are communicatively connected; among them,

[0123] The virtual reality glasses 300 are configured to generate a keyboard display image corresponding to a preset virtual keyboard in response to the virtual keyboard display signal output by the head-mounted display processor 400, and display the keyboard display image.

[0124] In this embodiment, the head-mounted display device 200 at least includes a virtual reality glasses 300 and a head-mounted display processor 400. The virtual reality glasses 300 and the head-mounted display processor 400 are communicatively connected. When the virtual reality glasses 300 receive the virtual keyboard display signal output by the head-mounted display processor 400, the virtual reality glasses 300 respond to the virtual keyboard display signal and generate a keyboard display image corresponding to a preset virtual keyboard, so that the user can perform typing pressing operations on the virtual keyboard image through each finger in the finger sleeve body 100 using the finger-enabled finger sleeve Hx. Then, the sensing module 20 in the finger-enabled finger sleeve Hx responds to the typing pressing action of the finger-enabled finger sleeve Hx on the keyboard display image or the preset virtual keyboard, and can accurately obtain the typing pressing signal related to the finger-enabled finger sleeve Hx.

[0125] It should be noted that referring to Figure 4 , Figure 4 is a schematic structural diagram of the head-mounted display device involved in the embodiment solution of the present application. As Figure 4 (a) shows, the virtual reality glasses 300 can be integrated in the head-mounted display processor 400; as Figure 4As shown in (b), the virtual reality glasses 300 can also be externally disposed outside the head-mounted display processor 400, and the present application does not make any restrictions here and can be customized according to the needs of users.

[0126] The keyboard display image can be understood as the device display form of the virtual keyboard in the virtual screen, that is, the keyboard display image can represent the virtual keyboard.

[0127] In this embodiment, the present application does not require other changes to the head-mounted display device 200, nor does it require an increase in the number of head-mounted cameras (i.e., cameras) in the head-mounted display device 200. As long as the communication protocol conforms to and is successfully paired with the finger sleeve body 100, the finger sleeve body 100 can be used to sense the keyboard display image displayed by the head-mounted display device 200. In addition, the delay of the signal processing process between the finger sleeve body 100 and the head-mounted display device 200 does not exceed 20 ms, which is within the acceptable delay range of the human body.

[0128] Further, in another embodiment, the virtual reality glasses 300 further include a camera;

[0129] The camera is configured to collect a spatial environment image of the finger sleeve body on a preset virtual keyboard and input the spatial environment image to the head-mounted display processor;

[0130] The head-mounted display processor is configured to determine a typing vibration signal corresponding to the finger sleeve body according to the typing press signal and the spatial environment image.

[0131] In this embodiment, a hand image of the finger sleeve body 100 performing a typing press action on the virtual keyboard image is captured by a camera to obtain a spatial environment image of the finger sleeve body, and then the spatial environment image is timely input to the head-mounted display processor. At this time, the head-mounted display processor registers and aligns the pixel contact positions of the keyboard key contacts in the spatial environment image with the three-dimensional space where the preset virtual keyboard is located, and then can accurately obtain the key coordinate positions of the keyboard key contacts in the three-dimensional space. Then, according to the key coordinate positions, the keyboard key characters pressed by the target finger sleeve can be accurately obtained. Then, the head-mounted display device responds to the keyboard key characters to obtain a vibration enable signal for the target finger sleeve, and the vibration enable signal is used as the typing vibration signal corresponding to the finger sleeve body, so that the user can generate vibrations on the fingers through the typing vibration signal sent by the head-mounted display device for the target finger sleeve in the finger sleeve body, so that the fingers of the user performing typing presses can timely obtain key vibration feedback, and further enable the user who obtains the key vibration feedback to improve the accuracy and speed of typing input in the virtual screen.

[0132] In this embodiment, without changing the head-mounted display device, the intelligent wearable device designed in the present application improves the typing accuracy and speed of the user in the virtual screen and enhances the typing experience in the virtual reality world through the camera tracking in the head-mounted display device, the pressing feedback and vibration feedback of the finger sleeve body 100.

[0133] In summary, the intelligent wearable device designed in the present application is a fingertip keyboard sensing system that can be applied to virtual reality devices. The intelligent wearable device M10 includes a finger sleeve body 100 and a head-mounted display device 200 that communicate bidirectionally. Among them, the finger sleeve body 100 is used to be sleeved on the fingers of the wearer. A processing module 10 is provided on the side of each finger enabling finger sleeve Hx of the finger sleeve body 100 close to the nail bed of the finger, and a sensing module 20 is provided on the side of each finger enabling finger sleeve Hx of the finger sleeve body 100 close to the finger pulp of the finger. When the user performs a typing pressing operation on the virtual keyboard displayed by the head-mounted display device 200 through the finger sleeve body 100, the sensing module 20 can timely obtain the typing pressing signal related to the finger enabling finger sleeve Hx, and the processing module 10 quickly feeds back the typing pressing signal to the head-mounted display device 200, so as to provide an accurate typing pressing signal for the subsequent processing flow of perceiving the vibration feedback of the corresponding finger; then the head-mounted display device 200 can accurately obtain the typing vibration signal corresponding to the finger enabling finger sleeve Hx based on the received typing pressing signal and the spatial environment image, and send the typing vibration signal to the sensing module 20 through the processing module. At this time, the sensing module 20 will quickly generate vibrations on the finger according to the typing vibration signal, so that the finger performing the typing pressing can timely obtain the key vibration feedback, avoiding the problem that existing gesture input recognition is prone to typing errors or missing letters, so that the user who obtains the key vibration feedback can improve the accuracy and speed of typing input in the virtual screen, thereby effectively improving the typing efficiency during the use of virtual reality devices.

[0134] In another embodiment, refer to Figure 5 , Figure 5It is another application scenario schematic diagram of the smart wearable device involved in the embodiment solution of the present application. Ten finger-enabled finger cots Hx are respectively worn on the fingers of the wearer's both hands. Each finger-enabled finger cot Hx should be powered by a micro lithium battery, have a BLE or other low-power communication chip, and establish a communication connection with the head-mounted display device 200. There is a bionic pressing capacitor (i.e., a capacitive sensor) at the fingertip and a micro vibration motor for providing tactile feedback. The head-mounted display device needs a camera with high image acquisition ability (6DOF). This camera can be integrated on the virtual reality glasses, or can be externally disposed outside the virtual reality glasses. Then, the hand movements in the pixel range of the virtual keyboard image are captured by the camera and photographed at a high refresh rate to obtain the actual hand image. At the same time, during the key pressing process, the user exerts a squeezing effect on the bionic pressing capacitor of the finger-enabled finger cot Hx, obtaining a typing pressing signal of the finger-enabled finger cot Hx. Then, the processing module 10 in the finger-enabled finger cot Hx transmits this typing pressing signal back to the head-mounted display device 200 through the communication chip (the two can be the same chip). The head-mounted processor 400 in the head-mounted display device 200 first quickly processes the photographed actual hand image and the virtual keyboard image to obtain the user's key pressing information, and then conveys a vibration signal to the micro vibration motor in combination with the user's key pressing and squeezing situation (i.e., the typing pressing signal), giving the user a perception. The user who obtains the perception feedback can improve the input accuracy and speed.

[0135] In addition, the present invention also provides a computer storage medium, on which an input control program of the smart wearable device is stored, and the input control program of the smart wearable device is executed by a processor to perform the above-mentioned input control method of the smart wearable device.

[0136] The specific implementation manner of the computer storage medium of the present invention is basically the same as that of each embodiment of the above-mentioned input control method of the smart wearable device, and will not be repeated here.

[0137] It can be understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided by the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, as known to those of ordinary skill in the art, with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided by the embodiments of the present application are equally applicable to similar technical problems.

[0138] The serial numbers of the above embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.

[0139] The steps in the method of the embodiments of the present application can be adjusted, combined, and deleted according to actual needs.

[0140] The units in the devices of the embodiments of the present application can be combined, divided, and deleted according to actual needs.

[0141] In this application, for the description of the same or similar term concepts, technical solutions, and / or application scenarios, generally only the first occurrence is described in detail. When it appears repeatedly later, for the sake of brevity, it is generally not described again. When understanding the technical solutions and other content of this application, for the same or similar term concepts, technical solutions, and / or application scenario descriptions that are not described in detail later, reference can be made to the relevant detailed descriptions before them.

[0142] In this application, the descriptions of each embodiment have their own focuses. For the parts not described in detail or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0143] The technical features of the technical solutions of this application can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combinations of these technical features do not conflict, they should all be considered as within the scope recorded in this application.

[0144] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described embodiment methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases, the former is a better implementation method. Based on such an understanding, the essence of the technical solutions of this application, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium as described above (such as ROM / RAM, magnetic disk, optical disc), and includes several instructions for causing a terminal device (which can be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the methods of each embodiment of this application.

[0145] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer storage medium or transmitted from one computer storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line) or wirelessly (such as optical, wireless, microwave, etc.). The computer storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, a storage disk, a magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a Solid State Disk (SSD)), etc.

[0146] The above are only the preferred embodiments of the present application, and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, shall be equally included in the patent protection scope of the present application.

Claims

1. An input control method for an intelligent wearable device, characterized in that, The intelligent wearable device includes a head-mounted display device and a finger sleeve body for being sleeved on the fingers of a wearer. The input control method is applied to the head-mounted display device; The input control method includes: When receiving the typing press signal sent by the finger sleeve body, obtaining the spatial environment image of the finger sleeve body on a preset virtual keyboard; Determining the typing vibration signal corresponding to the finger sleeve body according to the typing press signal and the spatial environment image; Sending the typing vibration signal to the finger sleeve body for the finger sleeve body to generate vibration according to the typing vibration signal.

2. The input control method for an intelligent wearable device according to claim 1, characterized in that, The finger sleeve body includes a plurality of finger-enabled finger sleeves. The step of determining the typing vibration signal corresponding to the finger sleeve body according to the typing press signal and the spatial environment image includes: Determining the target finger sleeve code of the finger sleeve body performing the typing press action according to the typing press signal; Determining the sleeved finger sleeve codes specified by each finger-enabled finger sleeve, and searching for the target finger finger sleeve that matches the target finger sleeve code from the plurality of finger-enabled finger sleeves according to the sleeved finger sleeve code. The target finger finger sleeve is the finger-enabled finger sleeve with the same sleeved finger sleeve code and the target finger sleeve code; Determining the typing vibration signal corresponding to the finger sleeve body according to the target finger finger sleeve and the spatial environment image.

3. The input control method for an intelligent wearable device according to claim 1, characterized in that, The step of determining the typing vibration signal corresponding to the finger sleeve body according to the target finger finger sleeve and the spatial environment image includes: Determining the keyboard key contact points of the target finger finger sleeve according to the spatial environment image, and determining the key coordinate positions of the keyboard key contact points in the three-dimensional space where the virtual keyboard is located; Responding to the keyboard key character corresponding to the key coordinate position to obtain the vibration enabling signal of the target finger finger sleeve, and using the vibration enabling signal as the typing vibration signal corresponding to the finger sleeve body.

4. An input control method for an intelligent wearable device, characterized in that, The intelligent wearable device includes a head-mounted display device and a finger sleeve body for being sleeved on the fingers of a wearer. The input control method is applied to the finger sleeve body; The input control method includes: After the head-mounted display device displays a preset virtual keyboard, performing a typing press action on the virtual keyboard to obtain a typing press signal; After receiving the typing vibration signal sent by the head-mounted display device, generating vibration according to the typing vibration signal; wherein, The head-mounted display device is further configured to obtain the spatial environment image of the finger sleeve body on a preset virtual keyboard, and determine the typing vibration signal corresponding to the finger sleeve body according to the typing press signal and the spatial environment image.

5. An input control system for an intelligent wearable device, characterized in that, The input control system of the intelligent wearable device includes a finger sleeve body sleeved on the fingers of a wearer; The finger sleeve body includes a plurality of finger-enabled finger sleeves, and each finger-enabled finger sleeve is provided with a processing module and a sensing module for two-way communication; wherein, The processing module is provided on the side of each finger-enabled finger sleeve close to the nail bed of the wearer's finger, and the sensing module is provided on the side of each finger-enabled finger sleeve close to the finger pulp of the wearer's finger; The induction module is configured to obtain a typing press signal in response to a typing press action performed by the finger sleeve body, and send the typing press signal to the processing module; The processing module is configured to upload the typing press signal to the head-mounted display device, and after the head-mounted display device determines a typing vibration signal corresponding to the finger sleeve body based on the typing press signal and the spatial environment image, forward the typing vibration signal sent by the head-mounted display device to the induction module; The induction module is further configured to receive the typing vibration signal forwarded by the processing module and generate vibrations according to the typing vibration signal.

6. The input control system for an intelligent wearable device according to claim 5, characterized in that, Each finger-enabled finger sleeve is provided with a receiving cavity for sleeving the finger of the wearer; The induction module includes a capacitance unit and a vibration unit, and the capacitance unit and the vibration unit are respectively electrically connected to the processing module; wherein, The capacitance unit and the vibration unit are stacked, the capacitance unit is arranged on the side away from the finger pulp in the receiving cavity, and the vibration unit is arranged on the side close to the finger pulp in the receiving cavity.

7. The input control system for an intelligent wearable device according to claim 6, characterized in that, The processing module further includes a communication unit and a working unit; The working unit is communicatively connected to the head-mounted display device through the communication unit, and the working unit is respectively electrically connected to the capacitance unit and the vibration unit; wherein, The communication unit and the working unit are stacked, the communication unit is arranged on the side away from the nail bed in the receiving cavity, and the working unit is arranged on the side close to the nail bed in the receiving cavity; The working unit is configured to send the typing press signal sent by the capacitance unit to the head-mounted display device, and after the head-mounted display device determines a typing vibration signal corresponding to the finger sleeve body based on the typing press signal and the spatial environment image, forward the typing vibration signal sent by the head-mounted display device to the vibration unit.

8. The input control system of the intelligent wearable device according to claim 7, wherein, The working unit includes a working chip and a power supply battery, and the working chip is electrically connected to the power supply battery; wherein, The working chip and the power supply battery are arranged side by side on the side close to the nail bed in the receiving cavity.

9. The input control system of the intelligent wearable device according to claim 5, wherein, The input control system of the smart wearable device further includes the head-mounted display device, and the head-mounted display device at least includes a virtual reality glasses and a head-mounted display processor, and the virtual reality glasses and the head-mounted display processor are communicatively connected; wherein, The virtual reality glasses are configured to generate a keyboard display image corresponding to a preset virtual keyboard in response to a virtual keyboard display signal output by the head-mounted display processor, and display the keyboard display image.

10. A computer storage medium, wherein, An input control program of the smart wearable device is stored on the computer storage medium, and when the input control program of the smart wearable device is executed by a processor, the steps of the input control method of the smart wearable device according to any one of claims 1 to 3, and / or claim 4 are implemented.