Text input method and device, wearable equipment and storage medium

Abstract

The embodiment of the invention provides a text input method and device, wearable equipment and a storage medium. The method is applied to the wearable device and comprises the steps that an interaction mode is determined, and an input box is obtained based on the interaction mode; determining a corresponding text input mode based on the interaction mode; and determining a target keyboard according to a text input mode corresponding to the interaction mode, so that a user inputs a text on the input box through the target keyboard. The embodiment of the invention aims to associate the interaction mode with the text input mode, so that the text input efficiency of a user is improved, and the use experience of the user is improved.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence technology, and in particular to a text input method, a text input device, a wearable device, and a computer-readable storage medium. Background Art

[0002] With the commercialization of wearable devices, wearable devices such as smart watches and smart glasses are used by more and more people, and text input technology for wearable devices has become a hot topic and difficulty in current research.

[0003] Taking smart glasses as an example, at present, the research on text input based on smart glasses is mainly divided into the following categories: inputting text by mapping the virtual keyboard to other locations, inputting text by connecting other devices, etc. However, the relevant technology does not take into account the impact of different interaction methods selected by users on text input. For example, when the user selects the interaction method of touching the touch area of ​​the temple with a finger for interaction, and the selected text input method is to map the virtual keyboard to other locations for text input, then the user may repeatedly raise his hand to interact with the touch area of ​​the temple, and then use his hand to click on the mapped virtual keyboard for text input, which results in the user's text input efficiency being slow and the user experience being poor. Summary of the invention

[0004] The present application provides a text input method, a text input device, a wearable device and a computer-readable storage medium, which aim to associate an interaction mode with a text input mode, thereby improving the efficiency of user text input and enhancing the user's usage experience.

[0005] To achieve the above object, the present application provides a text input method, which is applied to a wearable device, and the text input method includes:

[0006] Determine an interaction mode, and obtain an input box based on the interaction mode;

[0007] Determine a corresponding text input mode based on the interaction mode;

[0008] A target keyboard is determined according to the text input mode corresponding to the interaction mode, so that the user can input text on the input box through the target keyboard.

[0009] In addition, to achieve the above-mentioned purpose, the present application also provides a text input device, the text input device comprising:

[0010] An interaction mode determination module, used to determine an interaction mode and obtain an input box based on the interaction mode;

[0011] A text input mode determination module, used to determine a corresponding text input mode based on the interaction mode;

[0012] The text input module is used to determine a target keyboard according to the text input mode corresponding to the interaction mode, so that the user can input text on the input box through the target keyboard.

[0013] In addition, to achieve the above-mentioned purpose, the present application also provides a wearable device, which includes a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and implement the steps of any one of the text input methods provided in the embodiments of the present application when executing the computer program.

[0014] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor implements the steps of any one of the text input methods provided in the embodiments of the present application.

[0015] The text input method, text input device, wearable device and computer-readable storage medium disclosed in the embodiments of the present application can determine the interaction mode and obtain the input box based on the interaction mode. Further, the corresponding text input mode can be determined based on the interaction mode. Thus, the target keyboard can be determined according to the text input mode corresponding to the interaction mode, so that the user can enter text in the input box through the target keyboard. The present application aims to associate the interaction mode with the text input mode, determine the corresponding text input mode according to the interaction mode, and then determine the appropriate target keyboard to meet the user's input needs. By comprehensively utilizing the interaction mode and the corresponding text input mode, a more flexible and intuitive user experience can be provided, allowing users to easily enter text in the input box, that is, to improve the efficiency of user text input and enhance the user's experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0017] Figure 1 It is a flowchart of a text input method provided in an embodiment of the present application;

[0018] Figure 2 is a schematic diagram of a process for determining a target keyboard provided in an embodiment of the present application;

[0019] Figure 3 It is a schematic diagram of a flow chart of determining a text input mode provided in an embodiment of the present application;

[0020] Figure 4 This is a schematic diagram of a first scenario of a text input method provided in an embodiment of the present application;

[0021] Figure 5 is a schematic diagram of a second scenario of a text input method provided in an embodiment of the present application;

[0022] Figure 6 is a schematic block diagram of a text input device provided in an embodiment of the present application;

[0023] Figure 7 It is a schematic block diagram of a wearable device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0025] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor do they have to be executed in the order described. For example, some operations / steps can also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions. In addition, although the functional modules are divided in the device schematic, in some cases, the module division can be different from that in the device schematic.

[0026] The term "and / or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0027] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0028] With the commercialization of wearable devices, such as smart watches, health bracelets, and smart glasses, more and more people are using them, and text input technology for wearable devices has become a hot topic and difficulty in current research. Taking smart glasses as an example, at present, the research on text input based on smart glasses is mainly divided into the following methods: mapping the virtual keyboard to other locations (such as the palm), using laser projection keyboard, connecting other devices for character information input, etc.

[0029] However, in the process of implementing the present invention, the inventors found that the related art has at least the following shortcomings: Although the related art can realize character information input of smart glasses in the above-mentioned manner, it does not take into account the impact of different interaction methods selected by users on text input. For example, when the interaction method selected by the user is to touch the touch area of ​​the temple with a finger for interaction, and the text input method selected is to map the virtual keyboard to the palm for text input, then the user may repeatedly raise his hand to interact with the touch bar of the temple, and then click the virtual keyboard on the palm for text input, which results in the user's text input efficiency being slow and the user experience being poor.

[0030] Based on the above reasons, this application provides a text input method, please refer to Figure 1 , Figure 1 Schematic diagram of a text input method provided by an embodiment of the present application. Figure 1 As shown, the text input method includes steps S11 to S13.

[0031] Furthermore, the text input method of the present application is applied to a wearable device, and the wearable device may be smart glasses, such as AR glasses, VR glasses, etc., which is not limited in the present application.

[0032] Step S11: Determine the interaction mode, and obtain an input box based on the interaction mode.

[0033] Optionally, the interaction mode includes a head-controlled interaction mode and a hand-selection interaction mode.

[0034] It should be noted that the interaction mode refers to the way in which a user transmits information to or controls a wearable device. Specifically, a user can control a transmittable device or transmit information to a wearable device through a head-controlled interaction mode and a hand-selected interaction mode.

[0035] Among them, the head-controlled interaction mode requires the user to move his head to adjust the central gaze point on the wearable device screen. That is, the central gaze point on the wearable device screen is a dynamic focus, which can move with the movement of the user's head. It can be understood that the element or control where the central gaze point stays on the wearable device screen is the element or control that the user wants to interact with. Therefore, the user can move the central gaze point to the position of the element or control that he wants to interact with by moving his head.

[0036] Furthermore, after the central gaze point moves to the position of the element or control with which the user wants to interact, the user can use a finger to touch the touch area of ​​the temple, such as clicking on the touch area to select the element or control, and then interact with the element or control at which the central gaze point is aligned.

[0037] In addition, the hand-selected interaction mode is for the user to use the finger ring to interact with the elements or controls on the wearable device. Specifically, the user can move the finger ring so that the finger ring ray emitted by the finger ring is aimed at the element or control to be interacted with. Further, after the finger ring ray emitted by the finger ring is aimed at the element or control to be interacted with, the user can use a finger to touch or slide the touch area of ​​the finger ring to interact with the element or control aligned with the finger ring ray.

[0038] It can be understood that when the interaction mode selected by the user is the head-controlled interaction mode, the user can use the finger to touch the touch area of ​​the temple to open the input box for text input; when the interaction mode selected by the user is the hand-selected interaction mode, the user can move the finger ring so that the finger ring ray emitted by the finger ring is aligned with the input box, and then use the finger to touch or slide the touch area of ​​the finger ring to open the input box for text input.

[0039] In an embodiment of the present application, the two interaction modes, head-controlled interaction mode and hand-selection interaction mode, provide different ways, allowing users to interact naturally and intuitively with virtual content such as elements or controls on wearable devices by moving their heads or hands (rings), and at the same time, can open text boxes for text input according to different interaction modes.

[0040] Step S12: Determine a corresponding text input mode based on the interaction mode.

[0041] Optionally, the text input mode includes a palm input mode, a default input mode and a cross-screen input mode.

[0042] Optionally, determining the corresponding text input mode based on the interaction mode includes: when the interaction mode is a hand-selection interaction mode, determining the corresponding text input mode to be a palm input mode; or, when the interaction mode is a head-controlled interaction mode, determining the corresponding text input mode to be a cross-screen input mode or a default input mode.

[0043] It should be noted that the palm input mode is a mode in which the default soft keyboard on the wearable device is anchored on the palm (such as the palm), and the user uses the fingers on the default soft keyboard anchored on the palm to input text. Specifically, the wearable device can identify the palm of the user through a palm recognition algorithm. After the palm is identified, the default soft keyboard can be anchored on the palm, and the user's fingertips can be identified through a fingertip recognition algorithm, and then the character corresponding to the user's fingertips on the soft keyboard is confirmed to achieve text input.

[0044] Among them, palm recognition algorithm and fingertip recognition algorithm are technologies used to identify and track the user's palm or fingertip on wearable devices or other devices. The palm recognition algorithm can be used to determine the position and direction of the user's hand, and then recognize the user's palm. The fingertip recognition algorithm focuses on detecting and tracking the fingertip position, and can capture the fine movements of the fingers, such as finger clicks, slides, or drawing gestures, and is often used for virtual keyboard input, gesture interaction, and precise interaction with virtual interface elements.

[0045] In addition, the default soft keyboard of the wearable device is a virtual keyboard set on the wearable device, which usually adopts a simplified keyboard layout to adapt to the limited space of the wearable device screen. Among them, the operating system of the default soft keyboard can be Android system, IOS system, etc., which is not limited in this application.

[0046] Typically, the default position of the default soft keyboard depends on how the wearable device is designed. For example, the default soft keyboard may be located at the bottom or center of the screen of the wearable device, etc., or the position may be adjusted according to user needs, which is not limited in this application.

[0047] Furthermore, the default input mode is a method of directly inputting text on the default soft keyboard of the wearable device. The position of the default soft keyboard remains unchanged at the above default position. Since the default soft keyboard is virtual, the user can use a finger or gesture to slide or click on the virtual keyboard to input text.

[0048] In addition, the cross-screen input mode usually requires the wearable device to establish a communication connection with the terminal device (such as a mobile phone, computer, etc.) so that the screen on the wearable device is connected to the screen of the terminal device. For example, taking the terminal device as a mobile phone as an example, the screen of the wearable device can be anchored in the upper half of the mobile phone screen, so that the user can see the screen content of the wearable device in the upper half of the mobile phone screen. Furthermore, the lower half of the mobile phone screen can pop up its own virtual keyboard. As a result, the user can use the virtual keyboard on the mobile phone to input text and see the input text in real time in the upper half of the mobile phone screen.

[0049] It is understandable that when the user selects the head-controlled interaction mode, he needs to interact by touching the touch area of ​​the temple with his fingers. If the text input mode selected at the same time is the palm input mode, the user may repeatedly raise his hand to interact with the touch bar on the temple, and then click on the default soft keyboard anchored on the palm to input text, which will result in the user's text input efficiency being slow and the experience being poor.

[0050] Based on the above reasons, this application determines that the corresponding text input mode is the palm input mode when the interaction mode is the hand-selection interaction mode; when the interaction mode is the head-controlled interaction mode, the corresponding text input mode is determined to be the cross-screen input mode or the default input mode.

[0051] Optionally, when the interaction mode is the manual selection interaction mode, the corresponding text input may also be determined to be a cross-screen input mode or a default input mode, which is not limited in this application.

[0052] In an embodiment of the present application, an interaction mode may be associated with a text input mode, and a corresponding text input mode may be determined by determining the interaction mode, so as to improve the efficiency of user text input.

[0053] Step S13: determining a target keyboard according to the text input mode corresponding to the interaction mode, so that the user can input text in the input box through the target keyboard.

[0054] The target keyboard is the keyboard used by the user when inputting text.

[0055] Since different text input modes correspond to different keyboards, for example, the keyboard corresponding to the palm input mode is the default soft keyboard anchored on the palm; the keyboard corresponding to the default input mode is the default soft keyboard in the default position; the keyboard corresponding to the cross-screen input mode is the keyboard on the terminal device connected to the wearable device. Therefore, after confirming the interaction mode and the text input mode, the target keyboard can be further determined according to the text input mode, so that the user can enter text in the input box through the target keyboard.

[0056] In an embodiment of the present application, the corresponding text input mode can be determined according to the interaction mode, and then the appropriate target keyboard can be determined, so that the user can easily enter text in the input box, thereby improving the user's text input efficiency and enhancing the user's usage experience.

[0057] The text input method disclosed in the embodiment of the present application can determine the interaction mode and obtain the input box based on the interaction mode. Furthermore, the corresponding text input mode can be determined based on the interaction mode. Thus, the target keyboard can be determined according to the text input mode corresponding to the interaction mode, so that the user can input text on the input box through the target keyboard. The present application aims to associate the interaction mode with the text input mode, determine the corresponding text input mode according to the interaction mode, and then determine the appropriate target keyboard to meet the user's input needs. By comprehensively utilizing the interaction mode and the corresponding text input mode, a more flexible and intuitive user experience can be provided, allowing users to easily input text on the input box, that is, improving the efficiency of user text input and enhancing the user's experience.

[0058] Please continue reading Figure 2 , Figure 2 is a flow chart of determining a target keyboard provided by an embodiment of the present application. Figure 2 As shown, when the interaction mode is the hand selection interaction mode and the text input mode is the palm input mode, steps S131 to S133 can be used to determine the target keyboard according to the text input mode corresponding to the interaction mode, so that the user can input text on the input box through the target keyboard.

[0059] Step S131: The palm of the user is recognized by the sensor within a preset time to obtain a recognition result.

[0060] It should be noted that the sensor may be a camera or a camera on a wearable device, which is not limited in this application. Further, the preset time is 10s, 15s, 20s, etc., which is not limited in this application, and the preset time of 15s is used as an example for explanation.

[0061] Specifically, the image of the user's palm (such as the palm) can be obtained within 15 seconds through the camera or camera on the wearable device, and the palm of the user is recognized through the palm recognition algorithm to obtain a recognition result.

[0062] For the description of the palm recognition algorithm, please refer to step S12, and to avoid repetition, it is not described here.

[0063] Optionally, while turning on the sensor for palm recognition, the wearable device may further pop up a prompt to inform the user to open the palm and put it in front of the eyes to improve the success rate of palm recognition.

[0064] In the embodiment of the present application, the palm of the user can be recognized by the sensor within a preset time to obtain a recognition result, which is used to determine the text input mode as the palm input mode.

[0065] Step S132: when the recognition result is successful and no interruption occurs, anchor the preset soft keyboard at the palm position to obtain the anchored preset soft keyboard.

[0066] Step S133: determining the anchored preset soft keyboard as the target keyboard, so that the user can input text in the input box through the target keyboard.

[0067] Among them, the preset soft keyboard is the default soft keyboard on the wearable device.

[0068] Specifically, when the recognition result is successful and no interruption occurs during the recognition process, the preset soft keyboard can be anchored at the palm position to obtain the anchored preset soft keyboard, and the anchored preset soft keyboard is determined as the target keyboard, so that the user can enter text in the input box through the target keyboard.

[0069] Optionally, it is possible to determine whether an interruption occurs during the recognition process based on the data of the sensor. Specifically, during the process of using the sensor for palm recognition, sensor data can be continuously received for implementing palm recognition based on the sensor data. Among them, the sensor data is the position, shape, or other features of the palm, and the present application does not limit this. If the sensor data is interrupted during the palm recognition process, it indicates that an interruption occurs during the palm recognition process.

[0070] Optionally, after obtaining the recognition result, it further includes: when the recognition result is not recognized or the interruption time exceeds the preset time after recognition success, restoring the preset soft keyboard to the preset position; determining the preset soft keyboard restored to the preset position as the target keyboard, so that the user can input text in the input box through the target keyboard.

[0071] Specifically, when the recognition result is not recognized or the interruption time exceeds 15s after recognition success, the preset soft keyboard can be restored to the preset position, and the preset soft keyboard restored to the preset position is determined as the target keyboard, so that the user can input text in the input box through the target keyboard.

[0072] It should be noted that the preset position of the default soft keyboard is also the default position of the default soft keyboard, which depends on the design method of the wearable device. For example, the default soft keyboard can be located at the bottom or the center of the screen of the wearable device, etc., and can also be adjusted according to the needs of the user. The present application does not limit this.

[0073] Optionally, after obtaining the recognition result, it further includes: when the interruption time does not exceed the preset time after recognition success, obtaining the palm position before the recognition interruption; anchoring the preset soft keyboard at the palm position before the recognition interruption to obtain the preset soft keyboard after the initial anchoring; determining the preset soft keyboard after the initial anchoring as the target keyboard, so that the user can input text in the input box through the target keyboard.

[0074] Specifically, when the interruption time does not exceed 15s after recognition success, the palm position before the recognition interruption can be obtained, and then the preset soft keyboard is anchored at the palm position before the recognition interruption to obtain the preset soft keyboard after the initial anchoring, and the preset soft keyboard after the initial anchoring is determined as the target keyboard, so that the user can input text in the input box through the target keyboard.

[0075] On the basis of the above embodiment, after obtaining the preset soft keyboard after the initial anchoring, it also includes: recognizing the user's palm again through the sensor within a preset time to obtain a secondary recognition result; when the secondary recognition result is successful recognition and no interruption occurs, anchoring the preset soft keyboard after the initial anchoring to the palm position after the secondary recognition to obtain the final anchored preset soft keyboard; determining the final anchored preset soft keyboard as the target keyboard, so that the user can enter text on the input box through the target keyboard.

[0076] Specifically, after obtaining the preset soft keyboard after the initial anchoring, the user's palm can be recognized again through the sensor within 15 seconds to obtain a secondary recognition result. When the secondary recognition result is successful recognition and no interruption occurs, the preset soft keyboard after the initial anchoring is further anchored at the palm position after the secondary recognition to obtain the final anchored preset soft keyboard. Thus, the final anchored preset soft keyboard can be determined as the target keyboard, so that the user can enter text in the input box through the target keyboard.

[0077] In an embodiment of the present application, the palm of the user can be recognized by the sensor within a preset time to obtain a recognition result, and then the corresponding target keyboard is determined based on different recognition results, so that the user can enter text in the input box through the target keyboard.

[0078] See also Figure 3 , Figure 3 is a flow chart of determining a text input mode provided by an embodiment of the present application. Figure 3 As shown, when the interaction mode is the head-controlled interaction mode, the corresponding text input mode can be determined based on the interaction mode through steps S121 to S122.

[0079] Step S121: when the interaction mode is the head-controlled interaction mode, determine whether the text input mode is the palm input mode.

[0080] Step S122: when the text input mode is not the palm input mode, determining that the text input mode is the cross-screen input mode or the default input mode.

[0081] Specifically, when the interaction mode is the head-controlled interaction mode, it can be determined whether the current text input mode is the palm input mode. When the text input mode is not the palm input mode, the text input mode is determined to be the cross-screen input mode or the default input mode according to the user's own preference or favoriteness. For example, when the user prefers the cross-screen input mode to the default input mode, the text input mode can be pre-set as the cross-screen input mode. Therefore, when the text input mode is not the palm input mode, the text input mode can be determined to be the cross-screen input mode preferred by the user.

[0082] It can be understood that the method of the present application can provide personalized setting options, allowing users to adjust and determine the text input mode according to their own preferences or likes, thereby helping to improve the overall user experience.

[0083] Optionally, after determining whether the text input mode is the palm input mode, it also includes: when the text input mode is the palm input mode, further determining whether the wearable device is connected to the terminal device; if the wearable device is connected to the terminal device, switching the text input mode from the palm input mode to the cross-screen input mode; if the wearable device is not connected to the terminal device, switching the text input mode from the palm input mode to the default input mode.

[0084] Specifically, when the text input mode is the palm input mode, it can be further determined whether the wearable device is connected to the terminal device. If the wearable device is connected to the terminal device, the text input mode is switched from the palm input mode to the cross-screen input mode; if the wearable device is not connected to the terminal device, the text input mode is switched from the palm input mode to the default input mode.

[0085] It can be understood that when the text input mode is the cross-screen input mode, the target keyboard is the keyboard corresponding to the terminal device; when the text input mode is the default input mode, the target keyboard is the preset soft keyboard corresponding to the wearable device. Thus, text input can be implemented on the input box through the target keyboard.

[0086] In an embodiment of the present application, when the interaction mode is a head-controlled interaction mode, the text input mode can be determined as a cross-screen input mode or a default input mode, so that the user can conveniently enter text in the input box, thereby improving the efficiency of the user's text input and enhancing the user's experience.

[0087] See also Figure 4 as well as Figure 5 , Figure 4 This is a schematic diagram of a first scenario of a text input method provided in an embodiment of the present application; Figure 5 This is a schematic diagram of a second scenario of a text input method provided in an embodiment of the present application.

[0088] like Figure 4 As shown, when the user is wearing a wearable device, that is, AR glasses, the AR glasses can determine which interaction mode is currently in accordance with the user's choice. When the current interaction mode is the hand-selected interaction mode, the user can move the ring so that the ring ray emitted by the ring is aligned with the input box, and then use the finger to touch or slide the touch area of ​​the ring to open the input box for text input. At this time, a default soft keyboard may pop up at the default position of the field of view of the AR glasses. The operating system of the default soft keyboard may be an Android system, an IOS system, etc., which is not limited in this application.

[0089] Furthermore, the camera sensor can be turned on and the palm recognition algorithm can be turned on to recognize the user's palm (such as the palm) within a preset time (such as within 15 seconds) through the palm recognition algorithm to obtain a recognition result. At the same time, in order to improve the success rate of palm recognition, the wearable device can further pop up a prompt to inform the user to open the palm and put it in front of the eyes.

[0090] When the recognition result is successful, the recognition process is not interrupted. Therefore, the preset soft keyboard can be anchored at the palm position to obtain the anchored preset soft keyboard. The anchored preset soft keyboard is determined as the target keyboard, so that the user can input text in the input box through the target keyboard until the user cancels the input after completing the input and takes off the AR glasses.

[0091] When the recognition result is not recognized or the interruption time after successful recognition exceeds 15s, a prompt "The palm is not recognized, and the palm input has ended" is popped up to prompt the user. At the same time, the preset soft keyboard is restored to the default position, and the preset soft keyboard restored to the default position is determined as the target keyboard, so that the user can enter text in the input box through the target keyboard until the user cancels the input after completing the input and takes off the AR glasses.

[0092] When the recognition result is that the interruption time after successful recognition is less than 15s, the palm position before the recognition interruption can be obtained, and then the preset soft keyboard is anchored to the palm position before the recognition interruption to obtain the preset soft keyboard after the initial anchoring. The user's palm is recognized again by the sensor within the preset time to obtain the secondary recognition result; when the secondary recognition result is that the recognition is successful and no interruption occurs, the preset soft keyboard after the initial anchoring is anchored to the palm position after the secondary recognition to obtain the preset soft keyboard after the final anchoring; the preset soft keyboard after the final anchoring is determined as the target keyboard, so that the user can enter text in the input box through the target keyboard until the user cancels the input after completing the input and takes off the AR glasses.

[0093] like Figure 5 As shown, when the user is wearing a wearable device, that is, AR glasses, the AR glasses can determine which interaction mode is currently in accordance with the user's choice. When the current interaction mode is the head-controlled interaction mode, the user can use a finger to touch the touch area of ​​the temple to open the input box for text input. Furthermore, it can be determined whether the text input mode is a palm input mode (more specifically, a palm input mode). When the text input mode is not a palm input mode, the text input mode is determined to be a cross-screen input mode or a default input mode according to the input method selected by the user (for example, according to one's own preference or favorite), and then the text is input according to the determined text input mode until the user cancels the input after completing the input and takes off the AR glasses.

[0094] When the text input mode is the palm input mode, it can be further determined whether the wearable device is connected to a terminal device (such as a mobile phone). If the wearable device is connected to the terminal device, the text input mode is switched from the palm input mode to the cross-screen input mode; if the wearable device is not connected to the terminal device, the text input mode is switched from the palm input mode to the default input mode. Thus, text can be input according to the determined text input mode until the user cancels the input after completing the input and takes off the AR glasses.

[0095] See also Figure 6 , Figure 6 1 is a schematic block diagram of a text input device provided in an embodiment of the present application. The text input device can be configured in a server to execute the aforementioned text input method.

[0096] like Figure 6 As shown, the text input device 200 includes: an interaction mode determination module 201 , a text input mode determination module 202 , and a text input module 203 .

[0097] An interaction mode determination module 201 is used to determine an interaction mode and obtain an input box based on the interaction mode;

[0098] A text input mode determination module 202, configured to determine a corresponding text input mode based on the interaction mode;

[0099] The text input module 203 is used to determine a target keyboard according to the text input mode corresponding to the interaction mode, so that the user can input text on the input box through the target keyboard.

[0100] The interaction mode determination module 201 is also used to determine that the corresponding text input mode is the palm input mode when the interaction mode is the hand-selection interaction mode; or, when the interaction mode is the head-controlled interaction mode, determine that the corresponding text input mode is the cross-screen input mode or the default input mode.

[0101] The text input module 203 is also used to identify the palm of the user through a sensor within a preset time to obtain a recognition result; when the recognition result is successful and no interruption occurs, the preset soft keyboard is anchored on the palm position to obtain the anchored preset soft keyboard; the anchored preset soft keyboard is determined as the target keyboard, so that the user can input text on the input box through the target keyboard.

[0102] The text input module 203 is also used to restore the preset soft keyboard to a preset position when the recognition result is not recognized or the interruption time after successful recognition exceeds the preset time; and determine the preset soft keyboard restored to the preset position as the target keyboard, so that the user can input text on the input box through the target keyboard.

[0103] The text input module 203 is also used to obtain the palm position before the recognition is interrupted when the recognition result is that the interruption time after the recognition is successful does not exceed the preset time; anchor the preset soft keyboard on the palm position before the recognition is interrupted to obtain the preset soft keyboard after the initial anchoring; determine the preset soft keyboard after the initial anchoring as the target keyboard, so that the user can input text on the input box through the target keyboard.

[0104] The text input module 203 is also used to recognize the palm of the user again through the sensor within the preset time to obtain a secondary recognition result; when the secondary recognition result is successful recognition without interruption, the preset soft keyboard after the initial anchoring is anchored on the palm position after the secondary recognition to obtain the final anchored preset soft keyboard; the final anchored preset soft keyboard is determined as the target keyboard, so that the user can input text on the input box through the target keyboard.

[0105] The text input mode determination module 202 is also used to determine whether the text input mode is the palm input mode when the interaction mode is the head-controlled interaction mode; when the text input mode is not the palm input mode, determine that the text input mode is the cross-screen input mode or the default input mode.

[0106] The text input mode determination module 202 is also used to further determine whether the wearable device is connected to the terminal device when the text input mode is the palm input mode; if the wearable device is connected to the terminal device, the text input mode is switched from the palm input mode to the cross-screen input mode; if the wearable device is not connected to the terminal device, the text input mode is switched from the palm input mode to the default input mode.

[0107] The text input module 203 is also used to determine that the target keyboard is the keyboard corresponding to the terminal device when the text input mode is the cross-screen input mode; when the text input mode is the default input mode, determine that the target keyboard is the preset soft keyboard corresponding to the wearable device.

[0108] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0109] The method of the present application can be used in many general or special computing system environments or configurations, such as personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer terminal devices, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices.

[0110] Exemplarily, the above method and apparatus may be implemented in the form of a computer program. The computer program may be implemented in the form of a computer program. Figure 7 The wearable device shown is running on the

[0111] See also Figure 7 , Figure 7 is a schematic diagram of a wearable device provided in an embodiment of the present application. The wearable device may be a server. Figure 7 As shown, the wearable device 400 includes a processor 401, a memory 402, an image acquisition module 403 and a network interface connected via a system bus, wherein the memory 402 may include a volatile storage medium, a non-volatile storage medium and an internal memory.

[0112] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor 401 can execute any text input method.

[0113] The processor 401 is used to provide computing and control capabilities to support the operation of the entire wearable device 400 .

[0114] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any text input method.

[0115] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that the structure of the wearable device is only a block diagram of a part of the structure related to the present application scheme, and does not constitute a limitation on the wearable device 400 to which the present application scheme is applied. The specific wearable device 400 may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0116] It should be understood that the processor 401 may be a central processing unit (CPU), and the processor 401 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0117] Among them, in some embodiments, the processor 401 is used to run a computer program stored in the memory to implement the following steps: determine the interaction mode and obtain an input box based on the interaction mode; determine the corresponding text input mode based on the interaction mode; determine the target keyboard according to the text input mode corresponding to the interaction mode, so that the user can enter text on the input box through the target keyboard.

[0118] In some embodiments, the processor 401 is further used to determine that the corresponding text input mode is the palm input mode when the interaction mode is the hand-selection interaction mode; or, when the interaction mode is the head-controlled interaction mode, determine that the corresponding text input mode is the cross-screen input mode or the default input mode.

[0119] In some embodiments, the processor 401 is also used to identify the palm of the user through a sensor within a preset time to obtain a recognition result; when the recognition result is successful and no interruption occurs, the preset soft keyboard is anchored at the palm position to obtain the anchored preset soft keyboard; the anchored preset soft keyboard is determined as the target keyboard, so that the user can enter text on the input box through the target keyboard.

[0120] In some embodiments, the processor 401 is also used to restore the preset soft keyboard to a preset position when the recognition result is not recognized or the interruption time after successful recognition exceeds the preset time; and determine the preset soft keyboard restored to the preset position as the target keyboard, so that the user can enter text on the input box through the target keyboard.

[0121] In some implementations, the processor 401 is further configured to, when the recognition result is that the interruption time after the recognition is successful does not exceed the preset time, obtain the palm position before the recognition is interrupted; anchor the preset soft keyboard to the palm position before the recognition is interrupted to obtain the preset soft keyboard after the initial anchoring; determine the preset soft keyboard after the initial anchoring as the target keyboard, so that the user can input text on the input box through the target keyboard. .

[0122] In some embodiments, the processor 401 is also used to identify the user's palm again through the sensor within the preset time to obtain a secondary recognition result; when the secondary recognition result is successful recognition without interruption, the preset soft keyboard after the initial anchoring is anchored at the palm position after the secondary recognition to obtain the final anchored preset soft keyboard; the final anchored preset soft keyboard is determined as the target keyboard, so that the user can enter text on the input box through the target keyboard.

[0123] In some embodiments, the processor 401 is also used to determine whether the text input mode is the palm input mode when the interaction mode is the head-controlled interaction mode; when the text input mode is not the palm input mode, determine that the text input mode is the cross-screen input mode or the default input mode.

[0124] In some embodiments, the processor 401 is also used to further determine whether the wearable device is connected to the terminal device when the text input mode is the palm input mode; if the wearable device is connected to the terminal device, the text input mode is switched from the palm input mode to the cross-screen input mode; if the wearable device is not connected to the terminal device, the text input mode is switched from the palm input mode to the default input mode.

[0125] In some embodiments, the processor 401 is also used to determine that the target keyboard is the keyboard corresponding to the terminal device when the text input mode is the cross-screen input mode; when the text input mode is the default input mode, determine that the target keyboard is a preset soft keyboard corresponding to the wearable device.

[0126] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions, and when the program instructions are executed, any one of the text input methods provided in the embodiments of the present application is implemented.

[0127] The computer-readable storage medium may be an internal storage unit of the wearable device described in the foregoing embodiment, such as a hard disk or memory of the wearable device. The computer-readable storage medium may also be an external storage device of the wearable device, such as a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the wearable device.

[0128] Furthermore, the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, and the like.

[0129] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A text input method, It is characterized in that Applied to a wearable device, the text input method includes: Determine an interaction mode, and obtain an input box based on the interaction mode; Determine a corresponding text input mode based on the interaction mode; A target keyboard is determined according to the text input mode corresponding to the interaction mode, so that the user can input text on the input box through the target keyboard.

2. The method according to claim 1, It is characterized in that The interaction mode includes a head-controlled interaction mode and a hand-selected interaction mode, the text input mode includes a palm input mode, a default input mode and a cross-screen input mode, and determining the corresponding text input mode based on the interaction mode includes: When the interaction mode is the hand selection interaction mode, determining that the corresponding text input mode is the palm input mode; or, When the interaction mode is the head-controlled interaction mode, the corresponding text input mode is determined to be the cross-screen input mode or the default input mode.

3. The method according to claim 2, It is characterized in that The interaction mode is the hand selection interaction mode, the text input mode is the palm input mode, and determining a target keyboard according to the text input mode corresponding to the interaction mode so that the user inputs text on the input box through the target keyboard includes: Recognize the palm of the user by a sensor within a preset time to obtain a recognition result; When the recognition result is successful recognition and no interruption occurs, anchoring the preset soft keyboard at the palm position to obtain the anchored preset soft keyboard; The anchored preset soft keyboard is determined as the target keyboard, so that the user can input text on the input box through the target keyboard.

4. The method according to claim 3, It is characterized in that After obtaining the recognition result, the method further includes: When the recognition result is not recognized or the interruption time after successful recognition exceeds the preset time, restoring the preset soft keyboard to a preset position; The preset soft keyboard restored to the preset position is determined as the target keyboard, so that the user can input text on the input box through the target keyboard.

5. The method according to claim 3, It is characterized in that After obtaining the recognition result, the method further includes: When the recognition result is that the interruption time after the recognition is successful does not exceed the preset time, obtaining the palm position before the recognition is interrupted; Anchoring the preset soft keyboard at the palm position before the recognition interruption to obtain the preset soft keyboard after the initial anchoring; The preset soft keyboard after the initial anchoring is determined as the target keyboard, so that the user can input text on the input box through the target keyboard.

6. The method according to claim 5, It is characterized in that After obtaining the preset soft keyboard after the initial anchoring, the method further includes: Recognize the palm of the user again by the sensor within the preset time to obtain a secondary recognition result; When the secondary recognition result is that the recognition is successful without interruption, anchoring the preset soft keyboard after the initial anchoring to the palm position after the secondary recognition, to obtain the final anchored preset soft keyboard; The finally anchored preset soft keyboard is determined as the target keyboard, so that the user can input text on the input box through the target keyboard.

7. The method according to claim 2, It is characterized in that The interaction mode is the head-controlled interaction mode, and determining a corresponding text input mode based on the interaction mode includes: When the interaction mode is the head-controlled interaction mode, determining whether the text input mode is the palm input mode; When the text input mode is not the palm input mode, the text input mode is determined to be the cross-screen input mode or the default input mode.

8. The method according to claim 7, It is characterized in that After determining whether the text input mode is the palm input mode, the method further includes: When the text input mode is the palm input mode, further determining whether the wearable device is connected to a terminal device; If the wearable device is connected to the terminal equipment, switching the text input mode from the palm input mode to the cross-screen input mode; If the wearable device is not connected to the terminal equipment, the text input mode is switched from the palm input mode to the default input mode.

9. The method according to claim 8, It is characterized in that The determining the target keyboard according to the text input mode corresponding to the interaction mode includes: When the text input mode is the cross-screen input mode, determining that the target keyboard is a keyboard corresponding to the terminal device; When the text input mode is the default input mode, the target keyboard is determined to be a preset soft keyboard corresponding to the wearable device.

10. A text input device, It is characterized in that The text input device comprises: An interaction mode determination module, used to determine an interaction mode and obtain an input box based on the interaction mode; A text input mode determination module, used to determine a corresponding text input mode based on the interaction mode; The text input module is used to determine a target keyboard according to the text input mode corresponding to the interaction mode, so that the user can input text on the input box through the target keyboard.

11. A wearable device, It is characterized in that It comprises a memory and a processor; wherein the memory is connected to the processor and is used to store a program; the processor is used to implement the steps of the text input method as described in any one of claims 1 to 9 by running the program stored in the memory.

12. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, enables the processor to implement the steps of the text input method according to any one of claims 1 to 9.

Images