Input control method, device and electronic equipment

Abstract

The present application discloses an input control method device and an electronic device, the method comprising: in response to entering a first state, turning on a first mode, the first state being a state where input is required; receiving first data sent by a first device, wherein the first data is data associated with the first mode. In the implementation of this scheme, when text input is required, the text input is not performed locally, but the text data required to be input is obtained from the first device; thus, when the current device is not convenient for text input, the user can input text through the first device, and then the local device obtains the required text data from the first device; this implementation solves the problem of inconvenient input of some devices that are not convenient for text input operations, and improves the user experience.

Description

Technical Field

[0001] The present application relates to control technology, and more specifically, to an input control method, device and electronic device. Background Art

[0002] Currently, AR (Augmented Reality) devices and VR (Virtual Reality) devices usually use virtual keyboards for input, which has low operating efficiency and poor user experience. Summary of the invention

[0003] In view of this, this application provides the following technical solutions:

[0004] An input control method, comprising:

[0005] In response to entering a first state, starting a first mode, wherein the first state is a state where input is required;

[0006] First data sent by a first device is received, wherein the first data is data associated with the first mode.

[0007] Optionally, in response to entering the first state, starting the first mode includes:

[0008] In response to entering the first state, an image acquisition mode is started to acquire and output first display information of the first device, where the first display information at least includes an input interface of the first device.

[0009] Optionally, in response to entering the first state, starting the first mode includes:

[0010] In response to entering the first state, the screen unobstructed mode is turned on so that no content is output on the display screen.

[0011] Optionally, in the case where it is detected that the currently displayed page contains the first object, it is determined to enter the first state;

[0012] or,

[0013] When a data input instruction is recognized, it is determined to enter the first state.

[0014] Optionally, before receiving the first data sent by the first device, the method further includes:

[0015] The second data is sent to the first device, wherein the second data includes an input object requiring text input.

[0016] Optionally, the second data further includes a context attribute of the input object, where the context attribute is used to indicate the type of text that the input object needs to input.

[0017] Optionally, sending the second data to the first device includes:

[0018] Processing the first content in the currently displayed page into encrypted second data and sending the encrypted second data to the first device;

[0019] The receiving first data sent by the first device includes:

[0020] The encrypted first data associated with the input object returned by the first device based on the second data is received.

[0021] Optionally, the first data is data received by the first device triggered by its input device.

[0022] The present application also discloses an input control device, comprising:

[0023] A mode activation module, configured to activate a first mode in response to entering a first state, wherein the first state is a state where input is required;

[0024] The data receiving module is used to receive first data sent by a first device, wherein the first data is data associated with the first mode.

[0025] Furthermore, the present application also discloses an electronic device, comprising:

[0026] processor;

[0027] A memory, configured to store executable instructions of the processor;

[0028] The executable instructions include: in response to entering a first state, starting a first mode, the first state being a state requiring input; receiving first data sent by a first device, wherein the first data is data associated with the first mode.

[0029] It can be known from the above technical solutions that, compared with the prior art, the embodiments of the present application disclose an input control method device and an electronic device, the method comprising: in response to entering a first state, turning on a first mode, the first state being a state where input is required; receiving first data sent by a first device, wherein the first data is data associated with the first mode. In the implementation of this solution, when text input is required, the text input is not performed locally, but the text data required to be input is obtained from the first device; thus, when the current device is not convenient for text input, the user can input text through the first device, and then the local device obtains the required text data from the first device; this implementation solves the problem of inconvenient input of some devices that are not convenient for text input operations, and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0031] Figure 1 A flowchart of an input control method disclosed in an embodiment of the present application;

[0032] Figure 2 A flowchart of another input control method disclosed in an embodiment of the present application;

[0033] Figure 3 A schematic diagram of a display interface on a first device disclosed in an embodiment of the present application;

[0034] Figure 4 A schematic diagram of a display interface on another first device disclosed in an embodiment of the present application;

[0035] Figure 5 This is a schematic diagram of an interaction timing of an input control method disclosed in an embodiment of the present application;

[0036] Figure 6 A schematic diagram of the structure of an input control device disclosed in an embodiment of the present application;

[0037] Figure 7 A schematic diagram of the structure of an electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0038] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0039] Figure 1 This is a flow chart of an input control method disclosed in an embodiment of the present application. Figure 1 As shown, the input control method may include:

[0040] Step 101: In response to entering a first state, starting a first mode, wherein the first state is a state where input is required.

[0041] The embodiments of the present application do not impose fixed restrictions on the types of electronic devices to which the input control method is applied, and can solve the problem of inconvenient text input on electronic devices. For example, for some wearable devices, such as virtual reality VR devices or augmented reality AR devices, because they are worn on the user's head, when text input is required, the user usually needs to keep moving the head to select input characters and confirm the selection. Not only is the input process slow, it is also easy to make the user feel tired. Therefore, for these electronic devices that are inconvenient for text input, the present application scheme is proposed to achieve convenient and efficient text input. In the following content, the corresponding content will be introduced by taking the wearable device as the executor of the input control method described in the present application scheme as an example to facilitate understanding.

[0042] The first mode may be a mode that indicates that a certain function of the system is enabled, or a mode that indicates different working states of a certain function of the system. Different implementations of the first mode will be described in detail in the following embodiments, and will not be described in detail here.

[0043] Step 102: Receive first data sent by a first device, wherein the first data is data associated with the first mode.

[0044] After the first mode is turned on, the system can trigger the first device to obtain the first data and send the obtained first data to itself. The first data can be the text content that needs to be input, and the first data is obtained by the user through the input interface including the virtual keyboard. That is, the first data is the data received by the first device from its input device. Of course, the input device of the first device can be a physical input device or a virtual input device. After the system receives the first data, the corresponding text input operation is implemented.

[0045] There are also different implementations of the system triggering the first device to obtain the first data. For example, after the system turns on the first mode, it sends a command to the first device to instruct it to obtain the first data; or after the system turns on the first mode, it sends some data content to the first device, so that the first device directly enters the page for obtaining the first data after parsing and identifying the data content.

[0046] The first data is associated with the first mode, which means that the first data can be obtained only after entering the first mode.

[0047] The first device may be an electronic device such as a mobile phone, a PAD, a tablet computer, a laptop computer, etc. Any device that can conveniently input text through an input device such as a hand or a stylus pen can be the first device. The first device and the execution subject of the input control method described in the present application can establish a connection and exchange data in a variety of ways. The way to connect and pair the two can be, but is not limited to, any one of Bluetooth, network, and implementation connection.

[0048] The input control method described in this embodiment does not perform text input locally when text input is required, but obtains the required text data from the first device; thus, when the current device is not convenient for text input, the user can input text through the first device, and then the local device obtains the required text data from the first device; this implementation solves the problem of inconvenient input on some devices that are not convenient for text input operations, and improves the user experience.

[0049] In one implementation, in response to entering the first state, starting the first mode may include: in response to entering the first state, starting the image acquisition mode to acquire and output first display information of the first device, where the first display information at least includes an input interface of the first device.

[0050] In this implementation, since the user wears a wearable device on his head, such as a virtual reality VR device, the user's eyes cannot see the external environment. Therefore, even if the first device can easily implement text input, the user's eyes have no way to see the first device. Therefore, in this implementation, the image of a certain area in front of the user's face can be acquired through the camera on the wearable device. When the user holds the first device and places it in front of him, the wearable device can capture the image of the first device, including the display of the first device, and may also include a physical input device connected to the first device. The first display information can be the input interface of the first device, that is, the first display information only needs to contain content that can satisfy the user's text input, such as a text input box and a virtual keyboard.

[0051] After obtaining the image of the first device, that is, after obtaining the first display information, the first display information can be directly controlled to be output in the display area, so that the user can see the image of the first device in front of him and input text on the first device through finger control. This is equivalent to using the camera on the wearable device as the "eyes" of the user to view the external environment, so that the user can perform input operations on the external first device while wearing the wearable device on his head.

[0052] In another implementation, in response to entering the first state, starting the first mode may include: in response to entering the first state, starting a screen unobstructed mode so that no content is output on the display screen.

[0053] In this implementation, since the user wears a wearable device on his head, such as an augmented reality (AR) device, and since the screen of the AR device itself has a certain degree of transparency, when the user wears the AR device and the screen of the AR device is in an unobstructed mode, the user can see the external environment through the screen of the AR device.

[0054] After turning on the screen unobstructed mode, the user can see the external environment, the first device, and perform text input operations on the first device.

[0055] The determination of the first state may be determined by detecting the output content of the display area, such as detecting that a text input box is included in the display page on the display screen. Alternatively, the determination of the first state may also be determined after detecting a specific input instruction, wherein the specific input instruction may be a voice instruction, such as a speaker issuing a voice instruction of "Please enter a password". It should be noted that in the implementation of determining to enter the first state based on a voice instruction, the display content on the display area may or may not include a text input box, and this application does not impose a fixed restriction on this.

[0056] Based on the above content, when it is detected that the currently displayed page contains a first object, such as the aforementioned text input box, it can be determined that the first state is entered; or, when a data input instruction is recognized, such as the aforementioned voice instruction, it can be determined that the first state is entered.

[0057] Figure 2 This is a flow chart of another input control method disclosed in an embodiment of the present application. Figure 2 As shown, in one implementation, the input control method may include:

[0058] Step 201: In response to entering a first state, starting a first mode, wherein the first state is a state where input is required.

[0059] Step 202: Send second data to the first device, where the second data includes an input object that requires text input.

[0060] The input object that requires text input may include, but is not limited to, a text input box. When the output page of the wearable device includes an input object that requires text input, it indicates that text input is currently required. In this case, the input objects in the current page can be packaged and sent to the first device, so that after the first device parses the input object, it performs text input in it to obtain the first data.

[0061] Step 203: Receive first data sent by a first device, where the first data is data associated with the first mode.

[0062] In this embodiment, after entering the first state, the system will package the text input object in the current display page and send it to the first device, so that after the first device parses and obtains the text input object, the user can conveniently enter text information in the input object. The display effect of the input object on the wearable device side is the same as its display effect on the first device, so that the user will not feel out of place, and the user's input experience is improved.

[0063] In the above embodiment, the second data may include not only the input object for text input, but also the context attribute of the input object. The context attribute here is used to indicate the type of text that needs to be input by the input object.

[0064] After receiving the second data, the first device obtains the original content of the second data by decoding, and further determines what type of text input is required based on the context attribute. For example, if the original content of the context is "Please enter a password", then its context attribute corresponds to character input, and the first device can directly call out the character keyboard for the user to directly input numbers on the numeric keyboard. The schematic diagram of the display interface on the first device is as follows: Figure 3 For another example, if the original content of the context is "Please answer the preset question", and the context attribute corresponds to text input, the first device can call out a virtual keyboard with nine pinyin keys based on user habits, and the display interface on the first device is as follows: Figure 4 shown.

[0065] Of course, in some implementations, in order to prevent the user from feeling lost and to prevent the user from forgetting what to input after the wearable device enters the first mode, the context attribute may also be the original content of the context, so that in addition to displaying the text input box, the first device will also display its context, so that the user can always know what to input. Figure 3In the display content of the first device, "Please enter password" is also included above the text input box, and Figure 4 The display content of the first device only includes a text input box and a virtual keyboard.

[0066] In a specific implementation, the sending of the second data to the first device may include: processing the first content in the currently displayed page into encrypted second data and sending the encrypted second data to the first device. The receiving of the first data sent by the first device may include: receiving the encrypted first data associated with the input object returned by the first device based on the second data.

[0067] In this implementation, both the second data sent by the wearable device to the first device and the first data returned by the first device are encrypted, which can effectively protect the security of the data and the privacy of the user. This application does not limit the encryption method and encryption algorithm used between the wearable device and the first device, as long as it can meet the user's usage requirements.

[0068] In addition, if the user inputs highly private data such as a password, when the user enters the password, the text input box may not display the actual input content, but instead use an asterisk to replace the user's input content, so that the password data may be maliciously peeped at.

[0069] Figure 5 This is a schematic diagram of the interaction sequence of an input control method disclosed in an embodiment of the present application. Figure 5 As shown, in a specific implementation, an input system module can be added to the virtual scene application of the wearable device, and the input system module can identify the location and context where the user needs to input in the scene, such as the login window that requires continuous input of the account and password. The text input location and context attributes are packaged by the input system module and then sent to the mobile phone.

[0070] After the mobile phone receives the above packaged content, it can be considered that it has received an input command, and the input scene and context attributes are parsed to start the corresponding program on the mobile phone and send a prompt signal, such as a prompt sound or vibration; then the input window will be automatically output and the virtual keyboard will be called out. As mentioned above, the corresponding type of virtual keyboard and input box can be started according to the context attributes. The input box here refers to an input box that can directly display the input content, or an input box that hides the real content and can only display the *.

[0071] When the user triggers input in the input box on the first device, the device can turn on the front camera function and display a picture window taken by the camera in the current user scene. The user can see external content through the camera window.

[0072] After the user completes a series of input ports and confirms completion, the input content will be encrypted and transmitted to the input system module of the wearable device. The input system module decrypts the input content and displays it in the corresponding text input object; then the camera window of the wearable device is automatically closed, and the corresponding application on the mobile phone will automatically exit, waiting for the next trigger.

[0073] The above content is a relatively complete record of a specific implementation, which can be combined with these contents and Figure 5 Understand the relevant contents recorded in each embodiment of this application. Compared with the traditional head-to-head text input method of virtual reality VR devices and augmented reality AR devices, this technical solution can significantly improve the efficiency and fluency of user input. And through the camera window, the user can operate the first device such as a mobile phone without taking off the wearable device and other additional operations. It is convenient and fast for users to use, and the user satisfaction is high.

[0074] For the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0075] The method is described in detail in the embodiments disclosed in the above-mentioned application. The method of the application can be implemented by various forms of devices. Therefore, the application also discloses a device, and a specific embodiment is given below for detailed description.

[0076] Figure 6 Schematic diagram of the structure of an input control device disclosed in an embodiment of the present application. Figure 6 As shown, the input control device 60 may include:

[0077] A mode activation module 601, configured to activate a first mode in response to entering a first state, wherein the first state is a state where input is required;

[0078] The data receiving module 602 is configured to receive first data sent by a first device, wherein the first data is data associated with the first mode.

[0079] The input control device described in this embodiment does not perform text input locally when text input is required, but obtains the required text data from the first device; thus, when the current device is not convenient for text input, the user can input text through the first device, and then the local device obtains the required text data from the first device; this implementation solves the problem of inconvenient input on some devices that are not convenient for text input operations, and improves the user experience.

[0080] In one implementation, the mode activation module is specifically used to: in response to entering the first state, activate the image acquisition mode to acquire and output first display information of the first device, where the first display information at least includes an input interface of the first device.

[0081] In one implementation, the mode activation module is specifically used to: in response to entering the first state, activate the screen unobstructed mode so that no content is output on the display screen.

[0082] In one implementation, the input control device further includes: a state detection module, configured to determine to enter the first state when it is detected that the currently displayed page contains the first object; or determine to enter the first state when a data input instruction is recognized.

[0083] In one implementation, the input control device further includes: a data sending module, configured to send second data to the first device before the data receiving module receives first data sent by the first device, wherein the second data includes an input object requiring text input.

[0084] In one implementation, the second data further includes a context attribute of the input object, and the context attribute is used to indicate the type of text that the input object needs to input.

[0085] In one implementation, the data sending module is specifically used to: process the first content in the currently displayed page into encrypted second data and send it to the first device; then the data receiving module is specifically used to: receive the encrypted first data associated with the input object returned by the first device based on the second data.

[0086] In one implementation, the first data is data triggered by an input device receiving input from the first device.

[0087] Any one of the input control devices described in the above embodiments includes a processor and a memory. The mode activation module, data receiving module, status detection module, data sending module, etc. in the above embodiments are all stored in the memory as program modules, and the processor executes the above program modules stored in the memory to realize corresponding functions.

[0088] The processor includes a kernel, which retrieves the corresponding program module from the memory. One or more kernels can be set, and the processing of the access data can be realized by adjusting the kernel parameters.

[0089] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0090] In an exemplary embodiment, a computer-readable storage medium is also provided, which can be directly loaded into the internal memory of a computer and contains software code. After being loaded and executed by a computer, the computer program can implement the steps shown in any embodiment of the above-mentioned input control method.

[0091] In an exemplary embodiment, a computer program product is also provided, which can be directly loaded into the internal memory of a computer, wherein the computer program contains software codes, and after being loaded and executed by a computer, the computer program can implement the steps shown in any embodiment of the input control method described above.

[0092] Furthermore, an embodiment of the present invention provides an electronic device. Figure 7 This is a schematic diagram of the structure of an electronic device disclosed in an embodiment of the present application. Figure 7 As shown, the electronic device 70 includes at least one processor 701, and at least one memory 702 and a bus connected to the processor 701; wherein the processor 701 and the memory 702 communicate with each other via the bus 703; the memory is used to store the executable instructions of the processor, and the processor is used to call the programmable instructions in the memory to execute the above-mentioned input control method.

[0093] The executable program instructions include: in response to entering a first state, starting a first mode, the first state being a state requiring input; receiving first data sent by a first device, wherein the first data is data associated with the first mode.

[0094] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0095] It should also be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0096] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0097] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An input control method, at least applied to a wearable device that can be worn on the head, comprising: In response to entering a first state, starting a first mode, triggering a first device to obtain first data, wherein the first state is a state where input is required; receiving first data sent by a first device, wherein the first data is data associated with the first mode; Before receiving the first data sent by the first device, the method further includes: The second data is sent to the first device, wherein the second data includes an input object requiring text input.

2. The input control method according to claim 1, wherein in response to entering the first state, starting the first mode comprises: In response to entering the first state, an image acquisition mode is started to acquire first display information of a first device and output it to a display area in the wearable device, where the first display information at least includes an input interface of the first device.

3. The input control method according to claim 1, wherein in response to entering the first state, starting the first mode comprises: In response to entering the first state, the screen unobstructed mode is turned on so that no content is output on the display screen.

4. The input control method according to claim 1, wherein: In the case where it is detected that the currently displayed page includes the first object, determining to enter the first state; or, When a data input instruction is recognized, it is determined to enter the first state. 5 . The input control method according to claim 1 , wherein the second data further comprises a context attribute of the input object, wherein the context attribute is used to indicate a type of text that the input object needs to input.

6. The input control method according to claim 1, wherein sending the second data to the first device comprises: Processing the first content in the currently displayed page into encrypted second data and sending the encrypted second data to the first device; The receiving first data sent by the first device includes: The encrypted first data associated with the input object returned by the first device based on the second data is received.

7. The input control method according to any one of claims 1 to 6, wherein the first data is data received by the first device when the input device triggers the input.

8. An input control device, at least applied to a wearable device that can be worn on the head, comprising: A mode activation module, configured to activate a first mode in response to entering a first state, triggering a first device to obtain first data, wherein the first state is a state where input is required; a data receiving module, configured to receive first data sent by a first device, wherein the first data is data associated with the first mode; The input control device is also used for: The second data is sent to the first device, wherein the second data includes an input object requiring text input.

9. An electronic device, at least applied to a wearable device that can be worn on the head, comprising: processor; A memory, configured to store executable instructions of the processor; Among them, the executable instructions include: in response to entering a first state, turning on a first mode, triggering a first device to obtain first data, the first state being a state where input is required; receiving first data sent by the first device, wherein the first data is data associated with the first mode; before receiving the first data sent by the first device, it also includes: sending second data to the first device, wherein the second data includes an input object that requires text input.

Images