Information input method, apparatus and device, and storage medium

By synchronizing information between the head-mounted device and the terminal device, and utilizing the input boxes and virtual keyboard on the terminal device, the problem of limited input on the head-mounted device is solved, realizing a convenient information input method and improving input efficiency.

WO2026026239A1PCT designated stage Publication Date: 2026-02-05ZHUHAI MOJIE TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2025/100163
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-07-31
Filing Date
2025-06-10
Publication Date
2026-02-05

AI Technical Summary

Technical Problem

The input methods of head-mounted devices are limited, making it inconvenient for users to input information while wearing them.

Method used

By connecting the head-mounted device and the terminal device, the input information in the terminal device is synchronized to the display interface of the head-mounted device. Information is input using the input box and virtual keyboard of the terminal device, and the virtual keyboard of the local input box is hidden in the head-mounted device.

Benefits of technology

It improves the input efficiency of head-mounted devices, provides a convenient input method, and solves the problem of inconvenient input for users while wearing them.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025100163_05022026_PF_FP_ABST
    Figure CN2025100163_05022026_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present application provide an information input method, apparatus and device, and a storage medium. The method comprises: in response to an editing instruction input in a first input box and determining that a terminal device connected to a head-mounted device meets an input condition, sending to the terminal device first information related to the first input box; and receiving second information sent by the terminal device and displaying the second information, a second input box being displayed on a display interface of the terminal device when the terminal device receives the first information.
Need to check novelty before this filing date? Find Prior Art

Description

Information input methods, devices, equipment and storage media

[0001] This disclosure claims priority to Chinese Patent Application No. 202411048130.2, filed with the Chinese Patent Office on July 31, 2024, entitled "Information Input Method, Apparatus, Information Input Device and Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of information input technology, and in particular to an information input method, apparatus, head-mounted device, and storage medium. Background Technology

[0003] With technological advancements, head-mounted devices such as AR (Augmented Reality) glasses and VR (Virtual Reality) glasses are becoming increasingly popular. However, because these devices are worn on the user's head, their input methods are more limited compared to handheld devices. Therefore, a convenient input method is urgently needed for head-mounted devices. Summary of the Invention

[0004] This application provides an information input method, apparatus, device, and storage medium, aiming to provide a convenient input method for head-mounted devices and improve their input efficiency.

[0005] In a first aspect, embodiments of this application provide an information input method, the method being applied to a head-mounted device, the method comprising:

[0006] In response to receiving an editing instruction entered into the first input box of the head-mounted device, and determining that the terminal device connected to the head-mounted device meets the input conditions, the first information related to the first input box is sent to the terminal device;

[0007] The terminal device receives and displays the second information sent by the terminal device, wherein the second information is information entered in the second input box of the terminal device, and the second input box is displayed on the display interface of the terminal device when the terminal device receives the first information.

[0008] Secondly, embodiments of this application provide an information input method, the method being applied to a terminal device, the method comprising:

[0009] In response to receiving a first message sent by the head-mounted device, the second input box is controlled to be displayed on the display interface of the terminal device, wherein the first message is sent when the head-mounted device receives an editing instruction entered in the first input box and determines that it meets the input conditions of the terminal device;

[0010] Receive the second information entered in the second input box and send the second information to the head-mounted device.

[0011] Thirdly, embodiments of this application also provide an information input device, which is applied to a head-mounted device, and the information input device includes:

[0012] The first information sending module is configured to respond to receiving an editing instruction input into the first input box of the head-mounted device and determining that the terminal device connected to the head-mounted device meets the input conditions, and to send first information related to the first input box to the terminal device.

[0013] The second information receiving module is used to receive and display the second information sent by the terminal device. The second information is information input into a second input box in the terminal device, and the second input box is displayed on the display interface of the terminal device when the terminal device receives the first information.

[0014] Fourthly, embodiments of the invention also provide an information input device, which is applied to a terminal device, and the information input device includes:

[0015] The second input box display module is used to control the second input box to be displayed on the display interface of the terminal device in response to receiving the first information sent by the head-mounted device, wherein the first information is sent by the head-mounted device when it receives the editing instruction entered in the first input box and determines that it meets the input conditions of the terminal device;

[0016] The second information sending module is used to receive the second information entered in the second input box and send the second information to the head-mounted device.

[0017] Fifthly, the invention also provides an information input device, the information input device including a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for implementing communication between the processor and the memory, wherein when the computer program is executed by the processor, it implements the information input method as described in the first or second aspect.

[0018] In a sixth aspect, embodiments of this application also provide a storage medium for computer-readable storage, the storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the information input method as described in the first or second aspect.

[0019] This application provides an information input method, apparatus, device, and storage medium. In this embodiment, when a head-mounted device receives an editing instruction entered in a first input box and determines that a terminal device connected to the head-mounted device meets the input conditions, it sends first information related to the first input box to the terminal device; it then receives and displays second information sent by the terminal device. The second information is the information entered in a second input box on the terminal device, which is displayed on the terminal device's display interface when the terminal device receives the first information. By synchronizing the information entered in the terminal device to the head-mounted device, the problem of inconvenient input for users while wearing the head-mounted device is solved, providing a convenient input method and improving the input efficiency of the head-mounted device. Attached Figure Description

[0020] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 is a schematic block diagram of a head-mounted device provided in an embodiment of this application;

[0022] Figure 2 is a flowchart illustrating an information input method provided in an embodiment of this application;

[0023] Figure 3 is a reference schematic diagram of a first input box and a first virtual keyboard provided in an embodiment of this application;

[0024] Figure 4 is another flowchart illustrating an information input method provided in an embodiment of this application;

[0025] Figure 5 is another flowchart illustrating an information input method provided in an embodiment of this application;

[0026] Figure 6 is a schematic block diagram of an information input device provided in an embodiment of this application;

[0027] Figure 7 is another structural schematic block diagram of an information input device provided in an embodiment of this application. Detailed Implementation

[0028] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0029] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0030] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0031] This application provides an information input method, apparatus, head-mounted device, and storage medium. The technical solutions provided in this application are as follows.

[0032] In this embodiment of the application, the head-mounted device can be AR (Augmented Reality) glasses, AR helmets, VR glasses, etc.

[0033] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0034] Figure 1 is a schematic block diagram of an information input device provided in an embodiment of this application.

[0035] As shown in Figure 1, the information input device 100 includes a processor 101 and a memory 102. The processor 101 and the memory 102 are connected by a bus 103, such as an I2C (Inter-integrated Circuit) bus.

[0036] Specifically, processor 101 provides computing and control capabilities to support the operation of the entire head-mounted device 100. Processor 101 can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0037] Specifically, the memory 102 can be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a portable hard drive, etc.

[0038] Those skilled in the art will understand that the structure shown in FIG1 is merely a block diagram of a portion of the structure related to the embodiments of this application, and does not constitute a limitation on the information input device to which the embodiments of this application are applied. The specific information input device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0039] The processor 101 is used to run a computer program stored in the memory 102. The computer program can be set in an information input device, which is connected to an accessory device, and implements any of the information input methods provided in the embodiments of this application when the computer program is executed.

[0040] When the information input device is a head-mounted device, the following information input method is implemented when the computer program is executed.

[0041] In one embodiment, the processor is configured to run a computer program stored in memory, and to perform the following steps when executing the computer program:

[0042] In response to receiving an editing instruction entered into the first input box of the head-mounted device, and determining that the terminal device connected to the head-mounted device meets the input conditions, the first information related to the first input box is sent to the terminal device;

[0043] The terminal device receives and displays the second information sent by the terminal device, wherein the second information is information entered in the second input box of the terminal device, and the second input box is displayed on the display interface of the terminal device when the terminal device receives the first information.

[0044] In one embodiment, after the step of sending the first information related to the first input box to the terminal device, the processor, when executing the computer program, is further configured to implement the following steps:

[0045] The virtual keyboard corresponding to the first input box is kept hidden.

[0046] In one embodiment, after the steps of receiving the second information sent by the terminal device and displaying the second information, the processor, when executing the computer program, is further configured to implement the following steps:

[0047] If it is detected that the second virtual keyboard corresponding to the second input box is in a hidden state, or a hidden instruction to hide the second virtual keyboard is received, then the first virtual keyboard is controlled to switch from a hidden state to a displayed state so that the first virtual keyboard is displayed on the display interface of the head-mounted device.

[0048] In one embodiment, after the step of controlling the first virtual keyboard to switch from a hidden state to a displayed state so that the first virtual keyboard is displayed on the display interface of the head-mounted device if it is detected that the second virtual keyboard corresponding to the second input box is in a hidden state, or a hiding instruction to hide the second virtual keyboard is received, the processor is further configured to implement the following steps when executing the computer program:

[0049] If the cursor is in the first input box, then the first input box is in an input-enabled state.

[0050] In one embodiment, after the steps of receiving the second information sent by the terminal device and displaying the second information, the processor, when executing the computer program, is further configured to implement the following steps:

[0051] If a message deletion instruction is received from the terminal device, or if a message deletion instruction received by the terminal device is detected, the second message displayed on the head-mounted device is deleted according to the message deletion instruction.

[0052] In one embodiment, after the steps of receiving the second information sent by the terminal device and displaying the second information, the processor, when executing the computer program, is further configured to implement the following steps:

[0053] If an information sending instruction is received from the terminal device, or if it is detected that the terminal device has received an information sending instruction, then the second information is sent.

[0054] In one embodiment, after the step of sending the first information related to the first input box to the terminal device, the processor, when executing the computer program, is further configured to implement the following steps:

[0055] If the number of characters corresponding to the second information displayed in the first input box is greater than or equal to a preset number, then a prompt message is output and / or the prompt message is sent to the terminal device, wherein the prompt message indicates that the number of characters displayed in the first input box is greater than or equal to the preset number.

[0056] In one embodiment, the processor, when executing the computer program, is further configured to perform the following steps:

[0057] During the process of receiving the second information, or within a preset time period after receiving the second information, the head-mounted device is controlled to be in a screen-on state.

[0058] When the information input device is a terminal device, the following information input method is implemented when the computer program is executed.

[0059] In one embodiment, the processor is configured to run a computer program stored in memory, and to perform the following steps when executing the computer program:

[0060] In response to receiving a first message sent by the head-mounted device, the second input box is controlled to be displayed on the display interface of the terminal device, wherein the first message is sent when the head-mounted device receives an editing instruction entered in the first input box and determines that it meets the input conditions of the terminal device;

[0061] Receive the second information entered in the second input box and send the second information to the head-mounted device.

[0062] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the head-mounted device described above can be referred to the corresponding process in the following information input method embodiments, and will not be repeated here.

[0063] The following will describe in detail the information input method provided by the embodiments of this application with reference to the head-mounted device shown in Figure 1. It should be noted that the head-mounted device in Figure 1 is only used to explain the information input method provided by the embodiments of this application, and does not constitute a limitation on the application scenarios of the information input method provided by the embodiments of this application.

[0064] Please refer to Figure 2, which is a flowchart illustrating an information input method provided in an embodiment of this application.

[0065] As shown in Figure 2, this information input method is applied to a head-mounted device, and the information input method includes steps S101-S102.

[0066] Step S101: In response to receiving an editing instruction entered in the first input box of the head-mounted device, and determining that the terminal device connected to the head-mounted device meets the input conditions, first information related to the first input box is sent to the terminal device.

[0067] A communication connection is established between the head-mounted device and the terminal device, such as via Bluetooth or WiFi. In this embodiment, the terminal device can be a mobile phone, personal computer, etc. When an input box is displayed on the head-mounted device's screen, the head-mounted device detects whether it has received an editing command entered in that input box. To easily distinguish between the input boxes in the terminal device and the head-mounted device, in this embodiment, the input box in the head-mounted device is referred to as the first input box, and the input box in the terminal device is referred to as the second input box. The input box corresponds to the input box of the virtual keyboard. In one embodiment, the editing command is a command entered by the user in the first input box of the head-mounted device. This editing command can be a click command from the user to the first input box. When the head-mounted device receives this click command, it indicates that the user wants to enter information in the first input box. In another embodiment, the editing command can be an input command triggered by the user in the virtual keyboard corresponding to the first input box. When the head-mounted device receives this input command, it indicates that the user has started entering information in the first input box.

[0068] When the head-mounted device receives an editing instruction and determines that the connected terminal device meets the input conditions, it sends the first information related to the first input box to the terminal device. The input conditions can be set to one of the following, depending on the specific circumstances:

[0069] The first input condition is that the application related to the head-mounted device installed on the terminal device is running in the foreground.

[0070] The second type of input condition is that the application related to the head-mounted device installed on the terminal device is running in the foreground, and the head-mounted device is anchored to the screen of the terminal device. Once the head-mounted device is anchored to the screen of the terminal device, it indicates that the head-mounted device has determined the screen position of the terminal device.

[0071] The third type of input condition is that the application related to the head-mounted device installed on the terminal device is running in the foreground, and the head-mounted device is anchored to the screen of the terminal device and / or the current battery level of the terminal device is greater than the preset battery level. The preset battery level can be set according to specific needs, such as 10%, 20%, etc.

[0072] The first information related to the first input box includes the editing command and the content already displayed in the first input box, as shown in Figure 3. "Hello" is the content already displayed in the first input box, and the content to be selected corresponding to the pinyin "ma" below is the content corresponding to the editing command. At this time, the editing command is the input command triggered by the user in the virtual keyboard corresponding to the first input box. The first information includes "Hello" and the content to be selected corresponding to the pinyin "ma".

[0073] Step S102: Receive the second information sent by the terminal device and display the second information, wherein the second information is the information entered in the second input box in the terminal device, and the second input box is displayed on the display interface of the terminal device when the terminal device receives the first information.

[0074] After the head-mounted device sends the first information to the terminal device, the head-mounted device checks whether it has received the second information sent by the terminal device. The second information is the information entered by the user in the second input box on the terminal device. When the terminal device receives the first information from the head-mounted device, it displays the second input box on its display interface, allowing the user to input information through it. If the first information received by the terminal device includes content already displayed in the first input box, the terminal device will simultaneously display that content in the first input box in the second input box. When the head-mounted device receives the second information, it displays it. The display position of the second information is determined by the current display interface of the head-mounted device. For example, if the current display interface is a WiFi password input interface, the second information will be displayed in the WiFi password input box; if the current display interface is a search interface, the second information will be displayed in the search information input box. It is understood that when the terminal device displays the second input box on its display interface, it will also display the corresponding virtual keyboard, allowing the user to input information using the virtual keyboard to obtain the second information. If the head-mounted device does not receive the second message from the terminal device, the head-mounted device continues to check whether it has received the second message from the terminal device. The user can enter information in the first and second input boxes as at least one of the following: text, numbers, symbols, and emoticons.

[0075] In this embodiment, when the head-mounted device receives an editing instruction entered in a first input box and determines that the terminal device connected to the head-mounted device meets the input conditions, it sends first information related to the first input box to the terminal device; it then receives and displays second information sent by the terminal device, wherein the second information is the information entered in the second input box in the terminal device, and the second input box is displayed on the terminal device's display interface when the terminal device receives the first information. By synchronizing the information entered in the terminal device to the head-mounted device, the problem of inconvenience for users to input information while wearing the head-mounted device is solved, providing a convenient input method for the head-mounted device and improving its input efficiency.

[0076] In one embodiment, referring to FIG4, the information input method further includes:

[0077] Step S103: Control the first virtual keyboard corresponding to the first input box to be in a hidden state.

[0078] After the head-mounted device sends the first information to the terminal device, the head-mounted device controls the first virtual keyboard corresponding to the first input box to be hidden. For ease of distinction, in this embodiment, the virtual keyboard in the head-mounted device is designated as the first virtual keyboard, and the virtual keyboard in the terminal device is designated as the second virtual keyboard. Referring to Figure 3, controlling the first virtual keyboard in Figure 3 to be hidden means that the head-mounted device no longer displays the virtual keyboard used for user input, thereby expanding the display interface of existing information in the head-mounted device, preventing the first virtual keyboard from occupying the display interface of the head-mounted device, and saving the display resources of the head-mounted device.

[0079] In one embodiment, the method further includes:

[0080] If it is detected that the second virtual keyboard corresponding to the second input box is in a hidden state, or a hidden instruction to hide the second virtual keyboard is received, then the first virtual keyboard is controlled to switch from a hidden state to a displayed state so that the first virtual keyboard is displayed on the display interface of the head-mounted device.

[0081] After the head-mounted device controls the first virtual keyboard to be hidden, it monitors whether the second virtual keyboard corresponding to the second input field in the terminal device is also hidden, or determines whether it has received a hide command from the terminal device to hide the second virtual keyboard. Understandably, when the virtual keyboard is hidden, the user cannot input information using it. When the user triggers a hide command to hide the second virtual keyboard in the terminal device, the terminal device will detect this command. The terminal device can actively send this command to the head-mounted device, or it can act as an active device, proactively monitoring whether a hide command has been triggered in the terminal device.

[0082] When the head-mounted device detects or receives a command to hide the second virtual keyboard, it controls the first virtual keyboard to switch from a hidden state to a displayed state, so that the first virtual keyboard is displayed on the head-mounted device's display interface. Understandably, when the first virtual keyboard is displayed on the head-mounted device's display interface, the user can input information using the first virtual keyboard. If the head-mounted device does not detect that the second virtual keyboard is hidden, and / or does not receive a command to hide the second virtual keyboard from the terminal device, the head-mounted device will continue to monitor whether the second virtual keyboard is hidden, or continue to monitor whether it has received a command to hide the second virtual keyboard from the terminal device.

[0083] In this embodiment, when the head-mounted device detects that the second virtual keyboard is in a hidden state, or receives a hidden command from the terminal device to hide the second virtual keyboard, it controls the first virtual keyboard to switch from a hidden state to a displayed state, thereby displaying the first virtual keyboard on the display interface of the head-mounted device. When the user cannot input information through the second virtual keyboard in the terminal device, the first virtual keyboard in the head-mounted device is retrieved in a timely manner, and the first virtual keyboard switches from a hidden state to a displayed state, making it convenient for the user to input information through the first virtual keyboard, thus improving the input efficiency of user information input.

[0084] In one embodiment, the information input method further includes: if the cursor is in the first input box, then the first input box is controlled to be in an input-enabled state.

[0085] In this embodiment, the head-mounted device monitors the position of the control cursor in real time or periodically. The control cursor indicates the object the user wants to control, such as the control cursor corresponding to a mouse. When the head-mounted device detects the control cursor in the first input box, that is, when the control cursor is displayed in the first input box, the head-mounted device puts the first input box into an input-enabled state. It can be understood that when the first input box is in an input-enabled state, it indicates that the first virtual keyboard has been displayed on the head-mounted device's display interface, and the user can input information using the first virtual keyboard.

[0086] In one embodiment, to improve the accuracy of controlling the first input box to be in an input-enabled state, the head-mounted device can monitor the display duration of the control cursor in the first input box. If the display duration is greater than or equal to a preset duration, the head-mounted device controls the first input box to be in an input-enabled state; if the display duration is less than the preset duration, the head-mounted device controls the first input box to remain in an input-unenabled state. The preset duration can be set according to specific needs, such as 3s or 5s.

[0087] The first input box is the input box in the head-mounted device. Multiple input boxes can be displayed simultaneously on the head-mounted device's interface. Therefore, when the control cursor is placed in any input box on the head-mounted device, the input box where the control cursor is located is defined as the target input box. At this time, the head-mounted device controls the target input box to be in an input-enabled state, and the virtual keyboard corresponding to the target input box will also be displayed on the head-mounted device's interface, allowing the user to input information in the target input box using the virtual keyboard. It is understandable that the head-mounted device's display interface can also be a virtual interface.

[0088] In this embodiment, when the head-mounted device detects the control cursor in the first input box, it controls the first input box to be in an input-enabled state so that the user can input information on the head-mounted device, thereby improving the efficiency of switching information input methods on the head-mounted device. The switching of information input methods includes switching from information input on the terminal device to information input on the head-mounted device, and switching from information input on the head-mounted device to information input on the terminal device.

[0089] In one embodiment, the method further includes: if an information deletion instruction sent by the terminal device is received, or if an information deletion instruction received by the terminal device is detected, then the second information displayed by the head-mounted device is deleted according to the information deletion instruction.

[0090] When a user inputs information using the second virtual keyboard on their terminal device, the user can trigger a deletion command on the terminal device to remove part or all of the information already entered. After the user triggers the deletion command, the terminal device can act as the active end to send the command to the head-mounted device. When the head-mounted device receives the deletion command from the terminal device, or when the head-mounted device detects that the terminal device has received the deletion command, it deletes part or all of the displayed second information according to the command. For example, if the second information is "Let's have dinner together tomorrow afternoon," and the user triggers a deletion command on the terminal device to delete "Let's have dinner together," the head-mounted device will also delete "Let's have dinner together" from the displayed second information, leaving only "Tomorrow afternoon" as the second information, thus achieving information synchronization between the terminal device and the head-mounted device.

[0091] This implementation achieves synchronization of input information between the terminal device and the head-mounted device by synchronously deleting the displayed second information according to the information deletion command triggered by the user in the terminal device.

[0092] In one embodiment, the method further includes: if an information sending instruction is received from the terminal device, or if it is detected that the terminal device has received an information sending instruction, then the second information is sent.

[0093] If the current information input scenario requires information transmission, the head-mounted device determines whether it has received an information transmission command from the terminal device, or whether it has detected that the terminal device has received an information transmission command. If the head-mounted device receives an information transmission command from the terminal device, or detects that the terminal device has received an information transmission command, the head-mounted device sends the second information. This information transmission command is triggered by the user on the terminal device, and the user can decide whether to trigger the information transmission command on the terminal device according to specific needs.

[0094] Examples of message sending scenarios are as follows: In a WeChat chat interface, the user needs to send the entered information for the recipient to receive it; in a search interface, the user needs to trigger a confirmation command, such as clicking the "enter" key on the keyboard, before a search will be performed based on the currently entered information. In a WeChat chat scenario, when a head-mounted device sends a second message based on a message sending command, the user currently chatting with the user wearing the head-mounted device will receive this second message; in a search scenario, when a head-mounted device sends a second message based on a message sending command, it indicates that the second message has been sent to a search engine, and a search will then be performed based on this second message.

[0095] Understandably, when a user triggers a message sending command on the terminal device, it indicates that the user has completed the message input, at which point the terminal device can close the second input box.

[0096] This embodiment controls the head-mounted device to send the second information through the information sending command in the terminal device, which eliminates the need for the user to trigger the information sending command in the head-mounted device, thus improving the convenience of triggering the information sending command.

[0097] In one embodiment, the method further includes:

[0098] If the number of characters corresponding to the second information displayed in the first input box is greater than or equal to a preset number, then a prompt message is output and / or the prompt message is sent to the terminal device, wherein the prompt message indicates that the number of characters displayed in the first input box is greater than or equal to the preset number.

[0099] When the head-mounted device receives the second information sent by the terminal device, the second information will be displayed in the first input box. The second information in the head-mounted device and the terminal device is synchronized; for example, if the user enters text on the terminal device, that text will also be displayed in the second input box on the head-mounted device. That is, while the user is entering the second information on the terminal device, the head-mounted device continuously receives the second information sent by the terminal device. During the process of receiving the second information, the head-mounted device determines whether the number of characters corresponding to the second information displayed in the first input box is greater than or equal to a preset number. This preset number can be set according to specific needs, such as 10 or 20. If it is determined that the number of characters corresponding to the second information displayed in the first input box is greater than or equal to the preset number, the head-mounted device generates and outputs a prompt message, and / or sends the generated prompt message to the terminal device. The prompt message indicates that the number of characters displayed in the first input box is greater than or equal to the preset number. When the number of characters displayed in the first input box is greater than or equal to the preset number, it indicates that the first input box has reached its display limit. If the user wants to continue entering information, at least some information in the second information needs to be deleted. If the number of characters corresponding to the second information displayed in the first input box is less than the preset number, it indicates that the user can continue to input information through the head-mounted device or terminal device.

[0100] In this embodiment of the present disclosure, when the head-mounted device reaches the upper limit of the input information, a prompt message is output or sent to the terminal device to inform the user that the input information has reached the character limit, so that the user can understand the reason why the information cannot be entered in a timely manner.

[0101] In one embodiment, the method further includes:

[0102] During the process of receiving the second information, or within a preset time period after receiving the second information, the head-mounted device is controlled to be in a screen-on state.

[0103] In this embodiment, when the head-mounted device receives the second information sent by the terminal device, it is determined that the head-mounted device has interacted. Therefore, during the process of the head-mounted device receiving the second information, or within a preset time after receiving the second information, the head-mounted device is controlled to remain in a bright screen state to avoid the head-mounted device being in a black screen state during the process of receiving the second information. The preset time can be set according to specific needs, such as 2 minutes or 3 minutes.

[0104] In one embodiment, if the head-mounted device is in a screen-off state, it generates a shutdown command and sends the command to the terminal device. When the terminal device receives the shutdown command, it closes the second input field accordingly.

[0105] This embodiment controls the head-mounted device to be in a bright screen state during the process of receiving the second information, or within a preset time after receiving the second information, thus avoiding the head-mounted device being in a black screen state during the process of receiving the second information, making it convenient for the user to view the input information.

[0106] Please refer to Figure 5, which is a flowchart illustrating an information input method provided in an embodiment of this application.

[0107] As shown in Figure 5, this information input method is applied to a terminal device, and the information input method includes steps S201-S202.

[0108] Step S201: In response to receiving the first information sent by the head-mounted device, control the second input box to be displayed on the display interface of the terminal device, wherein the first information is sent by the head-mounted device when it receives the editing instruction entered in the first input box and determines that it meets the input conditions of the terminal device;

[0109] Step S202: Receive the second information entered in the second input box and send the second information to the head-mounted device.

[0110] When the head-mounted device receives an editing instruction from the user in the first input box and determines that the connected terminal device meets the input conditions, it sends the first information related to the first input box to the terminal device. Upon receiving the first information, the terminal device controls its second input box to appear on its display interface. It is understood that when the second input box is displayed on the terminal device's display interface, the corresponding second virtual keyboard will also appear on the terminal device's display interface, allowing the user to input information via the second virtual keyboard. While the second input box is displayed on the terminal device's display interface, the terminal device periodically or in real-time monitors whether the user has entered second information in the second input box via the second virtual keyboard. If the terminal device receives the second information entered by the user in the second input box via the second virtual keyboard, it sends this second information to the head-mounted device.

[0111] In one embodiment, if the communication connection between the terminal device and the head-mounted device is lost while the user is inputting information through the second input box in the terminal device, the second information that the terminal device has already sent to the head-mounted device will not be affected and can still be displayed in the first input box in the head-mounted device. The user can continue to input information through the first virtual keyboard corresponding to the first input box.

[0112] In this embodiment of the disclosure, after receiving the first information sent by the head-mounted device, the terminal device displays the second input box on the display interface of the terminal device. The first information is sent by the head-mounted device when it receives the editing instruction entered in the first input box and determines that it meets the input conditions of the terminal device. When the terminal device receives the second information entered in the second input box, it sends the second information to the head-mounted device. By synchronizing the information entered in the terminal device to the head-mounted device, the problem of inconvenience for users to input while wearing the head-mounted device is solved, providing a convenient input method for the head-mounted device and improving the input efficiency of the head-mounted device.

[0113] Please refer to Figure 6, which is a schematic block diagram of an information input device provided in an embodiment of this application.

[0114] As shown in Figure 6, the information input device 600 is applied to a head-mounted device, and the information input device 600 includes:

[0115] The first information sending module 610 is configured to, in response to receiving an editing instruction input into the first input box of the head-mounted device and determining that the terminal device connected to the head-mounted device meets the input conditions, send first information related to the first input box to the terminal device.

[0116] The second information receiving module 620 is used to receive second information sent by the terminal device and display the second information, wherein the second information is information input into a second input box in the terminal device, and the second input box is displayed on the display interface of the terminal device when the terminal device receives the first information.

[0117] In one embodiment, the information input device 600 further includes:

[0118] The first state control module is used to control the virtual keyboard corresponding to the first input box to be in a hidden state.

[0119] In one embodiment, the information input device 600 further includes:

[0120] The state switching module is used to control the first virtual keyboard to switch from a hidden state to a displayed state if it detects that the second virtual keyboard corresponding to the second input box is in a hidden state, or receives a hidden instruction to hide the second virtual keyboard, so that the first virtual keyboard is displayed on the display interface of the head-mounted device.

[0121] In one embodiment, the information input device 600 further includes:

[0122] The second state control module is used to control the first input box to be in an input-enabled state if the control cursor is in the first input box.

[0123] In one embodiment, the information input device 600 further includes:

[0124] The information deletion module is used to delete the second information displayed on the head-mounted device according to the information deletion instruction if it receives an information deletion instruction sent by the terminal device or detects that the terminal device has received an information deletion instruction.

[0125] In one embodiment, the information input device 600 further includes:

[0126] The information sending module is used to send the second information if it receives an information sending instruction from the terminal device or detects that the terminal device has received an information sending instruction.

[0127] In one embodiment, the information input device 600 further includes:

[0128] The prompt information processing module is used to output prompt information and / or send the prompt information to the terminal device if the number of characters corresponding to the second information displayed in the first input box is greater than or equal to a preset number, wherein the prompt information indicates that the number of characters displayed in the first input box is greater than or equal to the preset number.

[0129] In one embodiment, the information input device 600 further includes:

[0130] The third state control module is used to control the head-mounted device to be in a screen-on state during the process of receiving the second information or within a preset time after receiving the second information.

[0131] Please refer to Figure 7, which is a schematic block diagram of an information input device provided in an embodiment of this application.

[0132] As shown in Figure 7, the information input device 700 is applied to a terminal device, and the information input device 700 includes:

[0133] The second input box display module 710 is used to control the second input box to be displayed on the display interface of the terminal device in response to receiving the first information sent by the head-mounted device, wherein the first information is sent by the head-mounted device when it receives the editing instruction entered in the first input box and determines that it meets the input conditions of the terminal device;

[0134] The second information sending module 720 is used to receive the second information entered in the second input box and send the second information to the head-mounted device.

[0135] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the information input device described above can be referred to the corresponding process in the aforementioned information input method embodiments, and will not be repeated here.

[0136] This application also provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs that can be executed by one or more processors to implement any of the information input methods provided in the specification of this application.

[0137] The storage medium can be an internal storage unit of the head-mounted device described in the foregoing embodiments, such as the hard drive or memory of the head-mounted device. Alternatively, the storage medium can be an external storage device of the head-mounted device, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the head-mounted device.

[0138] It will be understood by those skilled in the art that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware embodiments, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0139] It should be understood that the term "and / or" as used in this specification and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes such combinations. It should be noted that, herein, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0140] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments. The above descriptions are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An information input method, applied to a head-mounted device, the method comprising: sending first information related to a first input box to a terminal device in response to receiving an editing instruction input in the first input box of the head-mounted device and determining that the terminal device connected to the head-mounted device meets an input condition; receiving second information sent by the terminal device and displaying the second information, wherein the second information is information input in a second input box of the terminal device, and the second input box is displayed on a display interface of the terminal device when the terminal device receives the first information.

2. The information input method according to claim 1, wherein After the step of sending the first information related to the first input box to the terminal device, the method further comprises: controlling a virtual keyboard corresponding to the first input box to be in a hidden state.

3. The information input method according to claim 2, wherein After the step of receiving the second information sent by the terminal device and displaying the second information, the method further comprises: if a second virtual keyboard corresponding to the second input box is monitored to be in a hidden state or a hiding instruction of the second virtual keyboard is received, controlling the first virtual keyboard to switch from a hidden state to a display state so that the first virtual keyboard is displayed on a display interface of the head-mounted device.

4. The information input method according to Claim 3, wherein After the step of if a second virtual keyboard corresponding to the second input box is monitored to be in a hidden state or a hiding instruction of the second virtual keyboard is received, controlling the first virtual keyboard to switch from a hidden state to a display state so that the first virtual keyboard is displayed on a display interface of the head-mounted device, the method further comprises: if a cursor is controlled in the first input box, controlling the first input box to be in an inputtable state.

5. The information input method according to Claim 1, wherein After the step of receiving the second information sent by the terminal device and displaying the second information, the method further comprises: if an information deletion instruction sent by the terminal device is received or an information deletion instruction received by the terminal device is monitored, deleting the second information displayed by the head-mounted device according to the information deletion instruction.

6. The information input method according to Claim 1, wherein After the step of receiving the second information sent by the terminal device and displaying the second information, the method further comprises: if an information sending instruction sent by the terminal device is received or an information sending instruction received by the terminal device is monitored, sending the second information.

7. The information input method according to Claim 1, wherein After the step of sending the first information related to the first input box to the terminal device, the method further comprises: if a number of characters corresponding to the second information displayed in the first input box is greater than or equal to a preset number, outputting a prompt information and / or sending the prompt information to the terminal device, wherein the prompt information represents that the number of characters displayed in the first input box is greater than or equal to the preset number.

8. The information input method according to Claim 1, wherein The method further comprises: controlling the head-mounted device to be in a screen-on state during the receiving of the second information or within a preset time length after the receiving of the second information. 9.An information input method, applied to a terminal device, the method further comprising: in response to receiving the first information sent by the head-mounted device, controlling the second input box to be displayed on the display interface of the terminal device, wherein The first information is an editing instruction input in a first input box and sent when a terminal device connected to the head-mounted device meets an input condition; The second information input in the second input box is received and sent to the head-mounted device. 10.An information input apparatus applied to a head-mounted device, comprising: a first information sending module configured to send first information related to a first input box of the head-mounted device to a terminal device in response to receiving an editing instruction input in the first input box and determining that the terminal device connected to the head-mounted device meets an input condition; a second information receiving module configured to receive second information sent by the terminal device and display the second information, wherein the second information is information input in a second input box of the terminal device, and the second input box is displayed on a display interface of the terminal device when the terminal device receives the first information.

11. The information input apparatus according to claim 10, wherein The information input apparatus further comprises: a first state control module configured to control a virtual keyboard corresponding to the first input box to be in a hidden state.

12. The information input apparatus according to claim 11, wherein The information input apparatus further comprises: a state switching module configured to control the first virtual keyboard to switch from a hidden state to a display state and display the first virtual keyboard on a display interface of the head-mounted device if it is monitored that a second virtual keyboard corresponding to the second input box is in a hidden state or a hidden instruction of the second virtual keyboard is received.

13. The information input apparatus according to claim 12, wherein The information input apparatus further comprises: a second state control module configured to control the first input box to be in an inputtable state if a cursor is controlled to be in the first input box.

14. The information input apparatus according to claim 10, wherein The information input apparatus further comprises: an information deleting module configured to delete second information displayed by the head-mounted device according to an information deleting instruction if the information deleting instruction sent by the terminal device is received or it is monitored that the information deleting instruction is received by the terminal device.

15. The information input apparatus according to claim 10, wherein The information input apparatus further comprises: an information sending module configured to send the second information if an information sending instruction sent by the terminal device is received or it is monitored that the information sending instruction is received by the terminal device.

16. The information input apparatus according to claim 10, wherein The information input apparatus further comprises: a prompt information processing module configured to output a prompt information and / or send the prompt information to the terminal device if a character number corresponding to the second information displayed in the first input box is greater than or equal to a preset number, wherein the prompt information represents that the character number displayed in the first input box is greater than or equal to the preset number.

17. The information input apparatus according to claim 10, wherein The information input apparatus further comprises: a third state control module configured to control the head-mounted device to be in a screen-on state during a process of receiving the second information or within a preset time length after the second information is received. 18.An information input apparatus applied to a terminal device, comprising: The second input box display module is configured to, in response to receiving the first information sent by the head-mounted device, control the second input box to be displayed on the display interface of the terminal device, wherein the first information is the editing instruction input in the first input box and sent by the head-mounted device when it is determined that the terminal device meets the input condition; The second information sending module is configured to receive the second information input in the second input box and send the second information to the head-mounted device. 19.An information input device, comprising a processor, a memory, a computer program stored on the memory and executable by the processor, and a data bus for realizing connection communication between the processor and the memory, wherein the computer program, when executed by the processor, realizes the information input method according to any one of claims 1 to 8 or claim 9. 20.A storage medium for computer-readable storage, the storage medium storing one or more programs that are executable by one or more processors to implement the information input method according to any one of claims 1 to 8 or claim 9.

Citation Information

Patent Citations

  • Utilizing external devices to offload text entry on a head-mountable device

    CN105745567A

  • Information interaction method and device, display equipment and storage medium

    CN114579034A

  • Text input method, mobile device, head-mounted display device and storage medium

    CN115176224A

  • Method and device for inputting characters in virtual world

    CN116437066A

  • Information input method and device, information input equipment and storage medium

    CN119024962A