Information input method, apparatus, wearable device and computer-readable storage medium

Abstract

The present application relates to an information input method, an apparatus, a wearable device and a computer-readable storage medium. The information input method comprises: detecting a bearing medium in a shooting view field range of a wearable device; acquiring position information of the bearing medium; displaying an input interface of the wearable device on the basis of the position information of the bearing medium, the input interface being located on the bearing medium; and in response to receiving an input operation in the input interface, determining input information on the basis of the input operation.

Description

Information input method, device, wearable device and computer-readable storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on November 29, 2023, with application number 202311623065.7 and invention name “Information input method, device, wearable device and computer-readable storage medium”, the entire contents of which are incorporated by reference into the application. Technical Field

[0002] The present application relates to the field of human-computer interaction technology, and in particular to an information input method, apparatus, wearable device, and computer-readable storage medium. Background Art

[0003] Existing wearable devices, such as AR / VR glasses, feature text input, a crucial component of human-computer interaction. One existing implementation involves cross-screen input via a mobile phone. While this text input method enables human-computer interaction through text input, users must use the phone's input interface as the text input terminal to complete text input on the AR / VR glasses. This means that to complete text input on the AR / VR glasses, users must simultaneously wear the AR / VR glasses and carry a phone with text input capabilities. Without the phone, the AR / VR glasses become incapable of text input, making them inconvenient and degrading the user experience. Therefore, in the process of implementing human-computer interaction through text input on wearable devices, how to make it more convenient for users to use the wearable devices and enable information input during information exchange with the wearable devices has become a pressing issue.

[0004] Summary of the Invention

[0005] The present application provides an information input method, apparatus, wearable device and computer-readable storage medium, which enable users to more conveniently complete information input on the wearable device during human-computer interaction with the wearable device.

[0006] In a first aspect, the present application provides an information input method, the method comprising:

[0007] Detecting a carrier medium within a shooting field of view of the wearable device;

[0008] Obtaining location information of the carrier medium;

[0009] Displaying an input interface of the wearable device according to the position information of the carrier medium, where the input interface is located on the carrier medium;

[0010] In response to receiving an input operation in the input interface, input information is determined according to the operation.

[0011] In a second aspect, the present application further provides an information input device, comprising:

[0012] A carrier medium detection module, configured to detect a carrier medium within the shooting field of view of the wearable device;

[0013] A location information acquisition module, for acquiring location information of the carrier medium;

[0014] an input interface display module, configured to display an input interface of the wearable device according to the position information of the carrier medium, wherein the input interface is located on the carrier medium;

[0015] The input information determining module is configured to determine input information according to an input operation received in the input interface.

[0016] In a third aspect, the present application also provides a wearable device, which includes a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and implement the information input method as described above when executing the computer program.

[0017] In a fourth aspect, the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the information input method as described above.

[0018] The present application discloses an information input method, device, wearable device and computer-readable storage medium, which detects a carrier medium within the shooting field of view of a shooting device of the wearable device; obtains the position information of the carrier medium, and then displays the input interface of the wearable device according to the position information of the carrier medium, wherein the input interface is located on the carrier medium; responds to an input operation received in the input interface, and determines input information according to the input operation. The above-mentioned information input method obtains the position information of the carrier medium, and displays the input interface of the wearable device according to the position information of the carrier medium, wherein the position where the input interface is displayed is on the carrier medium. After the input interface is located, the user can perform relevant input operations on the input interface, and the input information is determined according to the operations. In the process of human-computer interaction between the user and the wearable device, by displaying a virtual input interface on the carrier medium, information is input on the virtual input interface without the need for other physical input interfaces, which is more convenient for the user to use. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0020] FIG1 is a schematic block diagram of the structure of a wearable device provided in an embodiment of the present application;

[0021] FIG2 is a schematic flow chart of an information input method provided in an embodiment of the present application;

[0022] FIG3 is a schematic flow chart of another information input method provided in an embodiment of the present application;

[0023] FIG4 is a schematic block diagram of another information input method provided by an embodiment of the present application;

[0024] FIG5 is a diagram showing an input interface display effect according to an embodiment of the present application;

[0025] FIG6 is a schematic block diagram of an information input device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0027] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, combined, or partially merged, so the actual execution order may vary depending on the actual situation.

[0028] It should be understood that the terms used in this specification are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0029] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0030] Embodiments of the present application provide an information input method, apparatus, wearable device, and computer-readable storage medium. The information input method can be applied to a wearable device, wherein the method obtains location information of a carrier medium and displays an input interface for the wearable device based on the location information of the carrier medium. The input interface is located on the carrier medium, and a user inputs information on the input interface, which is displayed. The input interface of the wearable device is a virtual input interface presented by the wearable device and does not require the use of other physical input interfaces, making it more convenient for users to use.

[0031] The wearable device may be a wearable device such as AR glasses, a smart bracelet or a smart watch.

[0032] Please refer to Figure 1, which is a schematic block diagram of the structure of a wearable device 100 provided in an embodiment of the present application. In Figure 1, the wearable device 100 includes a processor 1001 and a memory 1002, wherein the processor 1001 and the memory 1002 are connected via a bus, such as an Inter-Integrated Circuit (I2C) bus or any other suitable bus.

[0033] Memory 1002 may include a storage medium and internal memory. The storage medium may be either a volatile storage medium or a non-volatile storage medium. The storage medium may store an operating system and a computer program. The computer program includes program instructions that, when executed, cause the processor 1001 to execute any one of the information input methods described in the embodiments of the present application.

[0034] The processor 1001 is used to provide computing and control capabilities to support the operation of the entire wearable device 100.

[0035] The processor 1001 may be a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0036] In addition to a processor and a memory, the wearable device 100 also includes a camera, a depth sensor, a display device, etc., wherein the camera can also be called a shooting device, which is used to shoot the surrounding environment and the user of the wearable device, etc., for example, to shoot within its shooting field of view to determine whether there is a preset carrier medium within its shooting field of view, such as the user's palm, book or handwriting tablet. The depth sensor is, for example, a depth camera or a binocular camera, which is used to measure the distance from the target object (such as the carrier medium) to the wearable device. The display device is used to display information, such as for displaying an input interface and inputting information.

[0037] In some embodiments, the wearable device may be a smartwatch, smart bracelet, AR glasses, etc. Taking AR glasses as an example, AR glasses include a camera, a depth sensor, and a display device. The display device, specifically the waveguide display module of the AR glasses, is used to present virtual information to the user.

[0038] The following describes some embodiments of the present application in detail with reference to the accompanying drawings. In the absence of conflict, the following embodiments and features therein may be combined with each other.

[0039] Please refer to Figure 2, which is a schematic flow chart of an information input method provided in an embodiment of the present application. The information input method can be applied to wearable devices.

[0040] As shown in FIG. 2 , the information input method specifically includes steps S201 to S204 .

[0041] S201: Detecting a carrier medium within a shooting field of view of a wearable device.

[0042] Specifically, the user can trigger the wearable device to start shooting by pressing a button, speaking a voice, or performing a gesture, and then detect the carrier medium within the wearable device's field of view. For example, the user can lightly press the start shooting button on the wearable device to put the wearable device into shooting mode. The wearable device captures an image within its field of view, and based on the captured image, the wearable device detects whether there is a carrier medium in the captured image. If the wearable device detects that there is a carrier medium in the captured image, the subsequent steps of the information input method will be continued. If the wearable device detects that there is no carrier medium in the captured image, the subsequent steps of the information input method will be terminated.

[0043] It should be noted that the carrier medium here is the carrier medium pre-set by the wearable device. When the carrier medium in the captured image is the same as the pre-set carrier medium, the wearable device determines that there is a carrier medium within the shooting field of view. Conversely, if the captured image does not contain the pre-set carrier medium, the wearable device will determine that there is no carrier medium within the shooting field of view. In addition, the user can also use voice, for example, the user issues a voice command: "I want to shoot", and the wearable device automatically shoots an image within the shooting field of view after receiving the above voice command issued by the user. Based on the captured image results, the wearable device detects whether there is a carrier medium in the captured image. The specific process of the wearable device detecting whether there is a carrier medium in the captured image is the same as the above-mentioned button method, which will not be repeated here.

[0044] Exemplarily, the carrier medium can be the user's palm, cardboard, book, etc.; the wearable device can be augmented reality (AR) glasses or virtual reality (VR) glasses or smart watches or smart bracelets and other wearable devices.

[0045] In some embodiments, before detecting the carrier medium within the shooting field of view of the wearable device, the user's gesture action is obtained; if the user's gesture action matches the preset input gesture action, the wearable device is controlled to enter the input interface mode, and the carrier medium within the shooting field of view of the wearable device is detected. The preset input gesture action can be two palm pinches or other reasonable preset input gesture actions. For example, if the user's gesture action is two palm pinches, the user's gesture action matches the preset input gesture action, and the wearable device is controlled to enter the input interface mode and detect the carrier medium within the shooting field of view of the wearable device; on the contrary, if the user's gesture action is two fists or any other gesture action other than two palm pinches, the user's gesture action does not match the preset input gesture action, and the wearable device does not execute the operation of entering the input interface mode, and the information input method ends.

[0046] For example, the shooting field of view range of the wearable device can be the shooting field of view range detected by the camera in the wearable device. The shooting field of view range can be a shooting field of view angle of 60° or 80° and a range of 70cm or 80cm from the wearable device. There is no restriction on the specific value of the field of view angle within the shooting field of view range and the distance that can be detected by the wearable device. It can be reasonably set according to the needs of the actual application scenario.

[0047] Specifically, the wearable device detects the carrier medium within its own shooting field of view. If the wearable device detects the carrier medium within its own shooting range, the subsequent steps of the information input method are continued. If the wearable device does not detect the carrier medium within its own shooting range, the execution process of the information input method is terminated.

[0048] S202: Acquire location information of the carrier medium.

[0049] Exemplarily, the position information of the carrier medium may be acquired by triangulation or the like based on a depth sensor, wherein the depth sensor may be a depth camera or a binocular camera.

[0050] Exemplarily, the position information of the carrier medium may be obtained by photographing the carrier medium through a wearable device. By photographing the carrier medium, the wearable device obtains the position of the carrier medium in the photographed image.

[0051] In some embodiments, if a carrier medium exists within the field of view, before obtaining the position information of the carrier medium, the residence time of the carrier medium within the field of view is obtained; if the residence time is greater than or equal to the preset residence time of the carrier medium, the step of obtaining the position information of the carrier medium is executed. If the residence time is less than the preset residence time of the carrier medium, the step of obtaining the position information of the carrier medium is stopped. The preset residence time can be any suitable time set according to the actual scenario requirements, such as 2s or 3s. For example, if the preset residence time of the carrier medium is 3s, if the wearable device obtains that the carrier medium has resided within the field of view for 5s, then the residence time of the carrier medium within the field of view of 5s is greater than the preset residence time of the carrier medium of 3s, and the step of obtaining the position information of the carrier medium is executed; if the wearable device obtains that the carrier medium has resided within the field of view for 2s, then the residence time of the carrier medium within the field of view of 2s is less than the preset residence time of the carrier medium of 3s, and the step of obtaining the position information of the carrier medium is stopped.

[0052] Exemplarily, the position information of the carrier medium includes first position information and second position information, wherein the first position information is the distance from the carrier medium to the wearable device; and the second position information is the position of the carrier medium in the image captured by the wearable device.

[0053] Exemplarily, the first position information of the carrier medium is the distance from the carrier medium to the wearable device. For example, the first position information of the carrier medium can be 40 cm or 45 cm or any other suitable distance. Further, assuming that the carrier medium here is the user's palm and the wearable device is AR glasses, then based on the appropriate viewing distance from the eyes to the palm of a general user, the first position information between the palm and the wearable device can be determined to be 40 cm. Of course, it is understandable that if the user is a teenager or a smaller user or a taller user, etc., the corresponding first position information can also be reasonably set, and there is no restriction here.

[0054] Exemplarily, the second position information is the position of the carrier medium in an image captured by the wearable device. For example, the position in the image captured by the wearable device can be any suitable position in the image captured by the camera, such as the lower left corner, upper left corner, upper right corner, or lower right corner. When the carrier medium is a palm, if the palm is within the capture field of view of the wearable device, the wearable device captures the palm, obtains the position in the captured palm image, and obtains the second position information of the palm image.

[0055] S203: Displaying an input interface of the wearable device according to the position information of the carrier medium, where the input interface is located on the carrier medium.

[0056] Taking AR glasses as an example, the input interface is displayed via the AR glasses' waveguide display module based on the carrier medium's position information, and the input interface is positioned on the carrier medium. Taking the carrier medium as an example, the palm's position information is specifically used to ensure that the displayed input interface matches the size of the palm and is displayed precisely on the palm.

[0057] In some embodiments, if the first position information of the carrier medium is within a preset distance range and the second position information is within a preset position range, the input interface of the wearable device is displayed, wherein the preset distance range is determined based on the distance from the carrier medium to the wearable device, and the preset position range is the corresponding position range within the shooting field of view of the wearable device.

[0058] For example, if the carrier medium is a palm and the wearable device is AR glasses, the preset distance range is a distance range determined based on the palm. Specifically, it can be a distance range determined based on factors such as the user's arm length and the user's comfort level when observing their palm while wearing the AR glasses. Considering that if the user's palm is too close to the AR glasses, it is uncomfortable for the user to view their palm while wearing the AR glasses, making it inconvenient for the user to perform corresponding input operations, and if the user's palm is too far away, the AR glasses cannot detect the palm within the AR glasses' field of view when the user is wearing the AR glasses, making it inconvenient for the user to perform input operations later, the preset distance range can be set to 30cm to 60cm, 35cm to 65cm, or any other suitable distance range. Furthermore, if the carrier medium is a palm and the wearable device is AR glasses, when the preset distance range is 30cm to 60cm, the AR glasses detect that the first palm position information is 40cm. At this time, the first palm position information is within the preset distance range. The AR glasses then determine the palm position information. If the position information is within the preset position range, the AR glasses input interface is displayed. Conversely, when the preset distance range is 30cm to 60cm, the AR glasses detect the first palm position information at 20cm. At this time, the first palm position information is not within the preset distance range. At this time, the information input is terminated, or the distance between the palm and the AR glasses is adjusted. The AR glasses then re-acquire the first palm position information and re-determine whether the first palm position information is within the preset distance range. It should be noted that different users may have different arm lengths. The preset distance range here can be reasonably set based on factors such as different user arm lengths.

[0059] For example, if the carrier medium is a palm and the wearable device is an AR glasses, the preset position range is the position range corresponding to the shooting field of view of the AR glasses, specifically the preset position range corresponding to the shooting field of view of the AR glasses is 70° or 80°. If the palm is within the preset position range, the input interface of the AR glasses is displayed. According to the position of the displayed input interface, if the palm is at the location of the input interface, the input interface is directly located on the palm. If the palm is not at the location of the input interface, the palm can move in the direction of the position of the input interface, or the AR glasses can rotate in the direction of the palm, so that the input interface moves in the direction of the palm until the input interface is located on the palm; if the position information of the palm is not within the preset position range, that is, the palm is not detected within the shooting field of view of the AR glasses, end this step, or move the palm, or rotate the AR glasses until the position information of the palm is within the preset position range.

[0060] It should be noted that the position of the palm and the preset position range are both variable. The purpose is to detect the palm within the preset distance range, and then the palm carries the input interface.

[0061] Exemplarily, if the first position information of the carrier medium is within a preset distance range and the second position information of the carrier medium is within a preset position range, the input interface of the wearable device is displayed. For example, taking the carrier medium as a palm and the wearable device as AR glasses, for example, the known preset distance range is 30cm to 60cm, and the preset position range corresponds to the preset position range when the AR glasses have a field of view of 75°. If the first position information of the palm is 42cm, then the first position information of the palm as the carrier medium is within the preset distance range. Next, a determination is made as to whether the second position information of the palm is within the preset position range. If the second position information of the palm is within the preset position range when the AR glasses have a field of view of 75°, the input interface of the AR glasses is displayed. Specifically, if the palm is positioned correctly to display the input interface, the input interface of the AR glasses is displayed directly on the palm. If the palm is not positioned where the input interface is displayed, the user can adjust the specific position of the palm or rotate the field of view of the AR glasses to display the input interface on the palm.

[0062] For another example, the known preset distance range is 35cm to 65cm, and the first position information of the palm is 80cm. At this time, the first position information of the palm is not within the preset distance range, and the input interface of the AR glasses will not be displayed.

[0063] It should be noted that if the first position information of the palm is within a preset distance range, the AR glasses can automatically adjust the size of the input interface according to the value of the first position information, and adjust the input interface to fit the size of the palm, and display the input interface in the palm through the imaging principle.

[0064] S204: In response to receiving an input operation in the input interface, determine input information according to the input operation.

[0065] Among them, the user's input operation on the input interface can be click, slide, touch, etc. For example, if the user performs a click operation on the input interface, the wearable device obtains the first indication information and the second indication information of the user clicking the input interface, and based on the first indication information and the second indication information, the wearable device determines the input information.

[0066] In some embodiments, first indication information from the indicating end of the input indicator used by the user can be obtained by triangulation or other methods using a depth camera or a binocular RGB camera on the wearable device. If the difference between the first indication information of the indicating end and the first position information of the carrier medium is within a preset range, where the preset range can be any other suitable range such as (-1mm∽1mm) or (-1.2mm∽0.9mm), it is determined that the indicating end of the input indicator touches the input interface located on the carrier medium. The wearable device captures an image of the specific position where the indicating end touches the input interface, and obtains second indication information of the indicating end on the input interface based on the position of the indicating end in the image captured by the wearable device. Based on the second indication information of the indicating end on the input interface, the input information is determined, where the first indication information of the indicating end is the distance from the indicating end to the wearable device, and the second indication information of the indicating end is the specific position where the indicating end touches the input interface.

[0067] It should be noted that the input indicator may be any suitable input indicator such as a finger or a pen, and the indicating end may be any suitable indicating end such as a fingertip or a pen tip, and there is no limitation on this.

[0068] For example, if the input indicator is a user's finger, first indication information from the user's fingertip is obtained, where the first indication information from the fingertip represents the distance from the finger to the wearable device. If the difference between the first indication information from the fingertip and the first position information of the carrier medium is within a preset range, it is determined that the fingertip has touched the input interface located on the carrier medium. For example, if the carrier medium is a palm, the preset range is (-1mm∽1mm). If the first indication information from the fingertip is 20.1cm and the first position information of the palm is 20cm, the difference between the first position information of the fingertip and the first position information of the palm is 0.1cm, or 1mm. If the difference between the first indication information from the fingertip and the first position information of the palm is within the preset range, it is determined that the fingertip has touched the input interface located on the palm. The wearable device can obtain second indication information from the indicating end on the input interface. Conversely, if the carrier medium is a palm, if the first indication information from the fingertip is 20.5cm and the first position information of the palm is 20cm, the difference between the first indication information from the fingertip and the first position information of the palm is 0.5cm, or 5mm. At this time, if the difference between the first indication information of the fingertip and the first position information of the palm is not within the preset range, it is determined that the fingertip has not touched the input interface located on the palm, and the wearable device cannot obtain the second indication information of the indicating end on the input interface.

[0069] Exemplarily, the second indication information of the indicating end on the input interface is obtained, and the input information is determined based on the second indication information of the indicating end on the input interface. For example, when the indicating end is a fingertip, if the fingertip touches MNO, GHI, GHI, ABC, MNO, MNO, and ABC in the nine pinyin keys in sequence, then the specific positions of the fingertip on the input interface captured in sequence by the wearable device are the positions of MNO, GHI, GHI, ABC, MNO, MNO, and ABC, that is, the second indication information of the fingertip on the input interface is the positions of MNO, GHI, GHI, ABC, MNO, MNO, and ABC, respectively. Based on the second indication information of the fingertip on the input interface, the wearable device determines that the input information is "How are you?"

[0070] The above embodiment provides an information input method that detects a carrier medium within the field of view of a wearable device, obtains position information of the carrier medium, and displays an input interface for the wearable device based on the carrier medium's position information, wherein the carrier medium's position information includes first position information and second position information. In response to receiving an input operation on the input interface, input information is determined based on the input operation. By displaying a virtual input interface on the carrier medium, user convenience is enhanced.

[0071] Please refer to FIG. 3 , which is a schematic flow chart of another information input method provided by an embodiment of the present application. The information input method specifically includes steps S301 to S304 .

[0072] S301: In response to receiving an input operation in an input interface, determine input information according to the input operation.

[0073] For example, the operation performed by the user on the input interface may be clicking, sliding, touching, etc.

[0074] For example, if the input indicator is a pen held by the user and the carrier medium is the user's palm, the preset range is (-1.2mm∽0.9mm). When the first indication information of the pen tip is 20.1cm and the first position information of the palm is 20cm, the difference between the first indication information of the pen tip and the first position information of the palm is 0.1cm, that is, 1mm. At this time, if the difference between the first indication information of the pen tip and the first position information of the palm is within the preset range, it is determined that the pen tip has touched the input interface located on the palm, and the wearable device can obtain the second indication information of the indicating end on the input interface. Conversely, if the difference between the first indication information of the pen tip and the first position information of the palm is not within the preset range, the wearable device cannot obtain the second indication information of the indicating end on the input interface.

[0075] S302: Acquire input information and display the input information in a display box of the input interface.

[0076] For example, after the wearable device determines the input information, it displays the input information in the display box of the input interface. For example, if the wearable device determines that the input information is "how are you", the input information "you", "good", and "may" are displayed in sequence in the display box of the input interface.

[0077] S303: If it is detected that the carrier medium moves out of the shooting field of view, or if it is detected that the state of the carrier medium changes, the input interface is hidden.

[0078] For example, after obtaining the user's operation on the input interface and determining the input information based on the operation, if it is detected that the carrier medium has moved out of the shooting field of view, or if it is detected that the state of the carrier medium has changed, the input interface is hidden. The change in the state of the carrier medium may be that the carrier medium changes from an open state to a closed state or any other state in which the input interface cannot be displayed. Hiding the input interface may be that the wearable device performs an operation to minimize the input interface or performs an operation to exit the input interface.

[0079] S304: Exit the input interface mode.

[0080] For example, the input interface mode can be exited by pressing a button, speaking a voice, or performing a gesture.

[0081] In some embodiments, the user's gesture can be acquired again. If the user's gesture matches a preset exit gesture, the wearable device is controlled to exit the input interface mode. The preset exit gesture can be a double fist clenching or other reasonable preset exit gesture. For example, if the user's gesture is a double fist clenching, the user's gesture matches the preset exit gesture, and the wearable device is controlled to exit the input interface mode. Conversely, if the user's gesture is any other gesture other than a double fist clenching, the user's gesture does not match the preset exit gesture, and the input interface mode is not exited.

[0082] The above-mentioned embodiment provides another information input method, which obtains input information by acquiring the user's input operation on the input interface and displays the input information within the display frame of the input interface. If it is detected that the carrier medium has moved out of the shooting field of view or the state of the carrier medium has changed, the input interface is hidden, and finally, the input interface mode is exited. In this method, when the user completes information input, the wearable device's input interface mode can be promptly exited through human-computer interaction based on the user's gestures, which is convenient and easy for the user to perform operations.

[0083] Specifically, here, the implementation process of the information input method is analyzed in detail using the user using an AR glasses device and the user's palm as an example. Please refer to Figure 4, which is a schematic block diagram of another information input method provided by an embodiment of the present application, which can specifically include the following steps S401 to S406.

[0084] S401: Detecting a carrier medium within a shooting field of view of a wearable device.

[0085] Exemplarily, the user can turn on the camera on the AR glasses by lightly touching the leg of the AR glasses or clicking the control button of the AR glasses. The user's gesture action is obtained in the camera on the AR glasses; if the user's gesture action matches the preset input gesture action, the AR glasses are controlled to enter the input interface mode, and the palm within the shooting field of view of the AR glasses is detected. If the shooting field of view of the AR glasses is within the range of 50° shooting field of view and 70cm away from the camera, if a palm is detected within the shooting field of view with a shooting field of view angle of 50° and a distance of 70cm from the camera, the subsequent steps of the information input method are continued. If no palm is detected within the shooting field of view with a shooting field of view angle of 50° and a distance of 70cm from the shooting device, the execution process of the information input method is terminated.

[0086] S402 : Obtain the residence time of the carrier medium within the shooting field of view; if the residence time is greater than or equal to the preset residence time of the carrier medium, execute the step of obtaining the position information of the carrier medium.

[0087] For example, if the detected time that the palm remains within the field of view is 4 seconds and the preset time is 3 seconds, the palm's time within the field of view is greater than the preset time, and the step of obtaining the position information of the carrier medium is performed. Conversely, if the detected time that the palm remains within the field of view is 2 seconds and the preset time is 3 seconds, the palm's time within the field of view is less than the preset time, and the step of obtaining the position information of the carrier medium is not performed, and the information input method ends.

[0088] S403: Acquire location information of the carrier medium.

[0089] For example, the first position information of the palm can be 40 cm. Here, the first position information of the palm is depth information, which represents the distance between the palm and the AR glasses. The second position information of the palm can be the position of the palm in the image captured by the AR glasses.

[0090] S404: Displaying an input interface of the wearable device according to the location information of the carrier medium.

[0091] For example, based on the first palm position information of 40cm and the second palm position information, where the preset distance range is 30cm to 60cm, the first palm position information is within the preset distance range. Then, it is determined whether the second palm position information is within the preset position range. Assume that the preset position range is the preset position range corresponding to the AR glasses' shooting field of view of 80°. If the second palm position information is within the preset position range corresponding to the shooting field of view of 80°, if the palm position at this time is just enough to display the input interface, the AR glasses' input interface is directly displayed on the palm. If the palm position is just different from the input interface position at this time, the AR glasses' input interface can be moved by moving the palm or the user turning the head. After the palm or input interface moves, the palm can just display the input interface. If the palm position information is not within the above-mentioned preset position range, the user can adjust the specific position of the palm or change the shooting field of view of the AR glasses camera by turning the AR glasses to display the AR glasses' input interface on the palm. It should be noted that the position information of the palm and the input interface of the AR glasses are not fixed. The palm can change with the change of the position information of the input interface of the AR glasses, and the position information of the input interface of the AR glasses can also be changed to adapt to the position of the palm.

[0092] S405: In response to receiving an input operation in the input interface, determine input information according to the input operation.

[0093] Exemplarily, the first indication information of the fingertip of the user's other hand is obtained. Assuming that the first indication information of the fingertip is 20.1 cm and the preset range is (-1mm∽1mm), the difference between the first indication information of the fingertip of the other hand and the first position information of the palm is 0.1 cm, that is, 1 mm. At this time, the difference between the first indication information of the fingertip of the other hand and the first position information of the palm is within the preset range, and it is determined that the fingertip of the finger touches the input interface located on the palm.

[0094] Exemplarily, second indication information of the fingertip on the input interface is obtained, and the input information is determined based on the second indication information of the fingertip on the input interface. For example, if the second indication information of the fingertip on the input interface is the positions of MNO, GHI, GHI, ABC, MNO, MNO, ABC in the nine pinyin keys, then the input information can be determined to be "How are you?" based on the second indication information of the fingertip on the input interface.

[0095] For example, after the input information is confirmed, the input information "you", "good", and "may" are displayed in sequence in the display box of the input interface. The specific display effect of the input interface of AR glasses and palm text input can be seen in Figure 5.

[0096] S406: If it is detected that the carrier medium moves out of the shooting field of view, or if it is detected that the state of the carrier medium changes, the input interface is hidden.

[0097] For example, after obtaining the user's operation on the input interface and determining the input information based on the operation, if the palm is detected to move out of the shooting field of view, or the palm state is detected to change from an open state to a clenched fist, or other changes occur that make it impossible to display the input interface, the input interface is hidden. At this time, the AR glasses obtain the user's gesture action. If the user's gesture action is two clenched fists, which matches the preset exit gesture action, the AR glasses are controlled to close the input interface mode.

[0098] The above embodiment provides an information input method for interaction between an AR glasses device and a palm. This method describes the specific process of interaction between the AR glasses and the palm, starting with the AR glasses entering an input interface mode by acquiring user gestures, followed by information input through interaction between the AR glasses, the palm, and fingers, until the AR glasses close the input interface mode. During the entire information input process between the AR glasses and the palm, no other physical input interface is required, and a virtual input interface is presented on a carrier medium, such as a palm, allowing the user to conveniently perform information input operations.

[0099] Please refer to Figure 6, which is a schematic block diagram of an information input device provided by an embodiment of the present application, wherein the information input device is used to execute the aforementioned information input method.

[0100] As shown in FIG6 , the information input device 600 includes: a carrier medium detection module 601 , a position information acquisition module 602 , an input interface display module 603 , and an input information determination module 604 .

[0101] It should be noted that those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0102] The above-mentioned device can be implemented in the form of a computer program, and the computer program can be run on the wearable device shown in FIG1 .

[0103] A computer-readable storage medium is also provided in an embodiment of the present application. The computer-readable storage medium stores a computer program. The computer program includes program instructions. The processor executes the program instructions to implement any information input method provided in the embodiment of the present application.

[0104] The computer-readable storage medium may be an internal storage unit of the computer device in the aforementioned embodiment, such as a hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash memory card, etc. equipped on the computer device.

[0105] The above are only specific embodiments of the present application, but the scope of protection of the present application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and such modifications or substitutions should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for inputting information, wherein: Applied to wearable devices, including: Detecting a carrier medium within a shooting field of view of the wearable device; Acquiring location information of the carrier medium; Displaying an input interface of the wearable device according to the position information of the carrier medium, wherein the input interface is located on the carrier medium; In response to receiving an input operation in the input interface, input information is determined according to the input operation.

2. The information input method according to claim 1, wherein: The responding to receiving the input operation in the input interface and determining the input information according to the input operation includes: Acquire first indication information of an indication end of an input indication member used by a user, wherein the first indication information of the indication end is a distance from the indication end to the wearable device; If the difference between the first indication information of the indication end and the first position information of the carrier medium is within a preset range, it is determined that the indication end of the input indicator touches the input interface located on the carrier medium; The second indication information of the indicating end on the input interface is obtained, and the input information is determined according to the second indication information of the indicating end on the input interface.

3. The information input method according to claim 1, wherein: Before obtaining the position information of the carrier medium, the method includes: Obtaining the residence time of the carrier medium within the shooting field of view; If the residence time is greater than or equal to the preset residence time of the carrier medium, the step of obtaining the position information of the carrier medium is performed.

4. The information input method according to claim 2, wherein: Before obtaining the position information of the carrier medium, the method includes: Obtaining the residence time of the carrier medium within the shooting field of view; If the residence time is greater than or equal to the preset residence time of the carrier medium, the step of obtaining the position information of the carrier medium is performed.

5. The information input method according to claim 1, wherein: The step of displaying the input interface of the wearable device according to the position information of the carrier medium includes: If the first position information of the carrier medium is within a preset distance range and the second position information of the carrier medium is within a preset position range, the input interface of the wearable device is displayed, wherein the position information of the carrier medium includes the first position information and the second position information, the preset distance range is determined according to the distance from the carrier medium to the wearable device, and the preset position range is the corresponding position range within the shooting field of view of the wearable device.

6. The information input method according to claim 1, wherein: After the input information is determined, the method further includes: The input information is acquired, and the input information is displayed in a display box of the input interface.

7. The information input method according to claim 2, wherein: After the input information is determined, the method further includes: The input information is acquired, and the input information is displayed in a display box of the input interface.

8. The information input method according to claim 3, wherein: After the input information is determined, the method further includes: The input information is acquired, and the input information is displayed in a display box of the input interface.

9. The information input method according to claim 5, wherein: After the input information is determined, the method further includes: The input information is acquired, and the input information is displayed in a display box of the input interface.

10. The information input method according to claim 1, wherein: After the response receives an input operation in the input interface and determines input information according to the input operation, the method includes: If it is detected that the carrier medium moves out of the shooting field of view, or if it is detected that the state of the carrier medium changes, the input interface is hidden.

11. The information input method according to claim 2, wherein: After the response receives an input operation in the input interface and determines input information according to the input operation, the method includes: If it is detected that the carrier medium moves out of the shooting field of view, or if it is detected that the state of the carrier medium changes, the input interface is hidden.

12. The information input method according to claim 3, wherein: After the response receives an input operation in the input interface and determines input information according to the input operation, the method includes: If it is detected that the carrier medium moves out of the shooting field of view, or if it is detected that the state of the carrier medium changes, the input interface is hidden.

13. The information input method according to claim 5, wherein: After the response receives an input operation in the input interface and determines input information according to the input operation, the method includes: If it is detected that the carrier medium moves out of the shooting field of view, or if it is detected that the state of the carrier medium changes, the input interface is hidden.

14. The information input method according to claim 6, wherein: After the response receives an input operation in the input interface and determines input information according to the input operation, the method includes: If it is detected that the carrier medium moves out of the shooting field of view, or if it is detected that the state of the carrier medium changes, the input interface is hidden.

15. The information input method according to claim 1, wherein: The method further comprises: Get the user's gesture actions; If the user's gesture action matches the preset input gesture action, controlling the wearable device to enter the input interface mode, and detecting the carrier medium within the shooting field of view of the wearable device; If the user's gesture action matches the preset exit gesture action, the wearable device is controlled to exit the input interface mode.

16. The information input method according to claim 3, wherein: The method further comprises: Get the user's gesture actions; If the user's gesture action matches the preset input gesture action, controlling the wearable device to enter the input interface mode, and detecting the carrier medium within the shooting field of view of the wearable device; If the user's gesture action matches the preset exit gesture action, the wearable device is controlled to exit the input interface mode.

17. The information input method according to claim 10, wherein: The method further comprises: Get the user's gesture actions; If the user's gesture action matches the preset input gesture action, controlling the wearable device to enter the input interface mode, and detecting the carrier medium within the shooting field of view of the wearable device; If the user's gesture action matches the preset exit gesture action, the wearable device is controlled to exit the input interface mode.

18. An information input device, wherein: include: A carrier medium detection module, which detects the carrier medium within the shooting field of view of the wearable device; A location information acquisition module, which acquires the location information of the carrier medium; An input interface display module, which displays an input interface of the wearable device according to the position information of the carrier medium, wherein the input interface is located on the carrier medium; The input information determination module is responsive to receiving an input operation in the input interface and determines input information according to the input operation.

19. A wearable device, wherein: The wearable device includes a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the information input method as claimed in claim 1 when executing the computer program.

20. A computer-readable storage medium, wherein: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the information input method according to claim 1.

Images