Input mode switching method and device, head-mounted equipment and storage medium
By automatically switching the input mode according to the ambient brightness in the head-mounted device, the problem of low accuracy of user input information when the ambient brightness is dark, and the intelligence and accuracy of input mode switching are improved.
Patent Information
- Application Number
- CN202311809162.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-26
- Publication Date
- 2025-06-27
AI Technical Summary
In head-mounted devices, it is difficult for users to accurately input information when the ambient brightness is dark when wearing the device, resulting in low accuracy of identifying the user's input information.
Ambient brightness is obtained when the current input mode of the head-mounted device is in the palm input mode, and if the brightness is less than the preset threshold, the target input mode is determined based on the preset input mode switching strategy and switch to that mode.
It improves the accuracy of the head-mounted device to identify user input information when the ambient brightness is dark, and realizes the function of automatically switching input modes, reduces the frequency of user manual switching, and improves the intelligence of input mode switching.
Smart Images

Figure CN120215684A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of device control, and in particular to a method and device for switching input modes, a head-mounted device, and a storage medium. Background Art
[0002] With the continuous improvement of communication technology, more and more intelligent devices have emerged, such as head-mounted devices like augmented reality devices and virtual reality devices. When a user uses a head-mounted device, the head-mounted device needs to be worn on the user's head. In related technologies, if a user wants to input relevant information in the head-mounted device during the process of wearing the head-mounted device, relevant information can be input through input modes such as the built-in input method, voice input, and cross-screen input in the head-mounted device. Among these input modes, how to switch input modes is an urgent problem to be solved. Summary of the Invention
[0003] Embodiments of the present invention provide a method and device for switching input modes, a head-mounted device, and a storage medium, aiming to improve the intelligence of input mode switching of the head-mounted device.
[0004] In a first aspect, embodiments of the present invention provide a method for switching input modes. The method is applied to a head-mounted device and includes:
[0005] When the current input mode of the head-mounted device is the palm input mode, obtain the ambient brightness of the current environment of the head-mounted device;
[0006] In response to the ambient brightness being less than a preset brightness threshold, determine a target input mode based on a preset input mode switching strategy;
[0007] Control the input mode of the head-mounted device to switch from the palm input mode to the target input mode.
[0008] Optionally, the step of "in response to the ambient brightness being less than a preset brightness threshold, determine a target input mode based on a preset input mode switching strategy" includes:
[0009] In response to the ambient brightness being less than a preset brightness threshold, obtain the current remaining power of the head-mounted device;
[0010] If the remaining power is less than a first preset power threshold, determine a target input mode based on a preset input mode switching strategy.
[0011] Optionally, the method further includes:
[0012] If the remaining power is greater than or equal to the preset power threshold, control the head-mounted device to turn on the light to increase the ambient brightness.
[0013] Optionally, when the input mode switching strategy is a priority switching strategy, the determining of the target input mode based on a preset input mode switching strategy in response to the ambient brightness being less than a preset brightness threshold includes:
[0014] In response to the ambient brightness being less than a preset brightness threshold, determining the input mode with the highest priority in the input modes;
[0015] Determining the target input mode according to the input mode with the highest priority.
[0016] Optionally, the determining the input mode with the highest priority as the target input mode includes:
[0017] In response to the input mode with the highest priority being a cross-screen input mode, determining whether the head-mounted device is connected to a terminal device;
[0018] If the head-mounted device is not connected to a terminal device, determining the input mode with the highest priority except the palm input mode and the cross-screen input mode as the target input mode.
[0019] Optionally, after determining whether the head-mounted device is connected to a terminal device, it further includes:
[0020] If the head-mounted device is connected to a terminal device, obtaining the current battery power of the terminal device;
[0021] If the current battery power is less than a second preset battery power threshold, determining the input mode with the highest priority except the palm input mode and the cross-screen input mode as the target input mode.
[0022] Optionally, when the input mode switching strategy is a sequential switching strategy, the determining of the target input mode based on a preset input mode switching strategy in response to the ambient brightness being less than a preset brightness threshold includes:
[0023] In response to the ambient brightness being less than a preset brightness threshold, determining the next input mode corresponding to the palm input mode based on the sequential switching strategy;
[0024] Determining the next input mode as the target input mode.
[0025] In a second aspect, an embodiment of the present invention further provides a switching device for an input mode. The switching device for the input mode is applied to a head-mounted device, and the switching device for the input mode includes:
[0026] A brightness acquisition module, configured to acquire the ambient brightness of the current environment of the head-mounted device when the current input mode of the head-mounted device is a palm input mode;
[0027] An input mode determination module, configured to determine a target input mode based on a preset input mode switching strategy in response to the environmental brightness being less than a preset brightness threshold.
[0028] A mode switching module, configured to control the input mode of the head-mounted device to switch from a palm input mode to the target input mode.
[0029] In a third aspect, an embodiment of the present invention further provides a head-mounted device, which includes a processor, a memory, a computer program stored on the memory and executable by the processor, and a data bus for realizing connection communication between the processor and the memory. When the computer program is executed by the processor, the switching method of the input mode as described in the first aspect is implemented.
[0030] In a fourth aspect, an embodiment of the present invention further provides a storage medium for computer-readable storage. The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the switching method of the input mode as described in the first aspect.
[0031] An embodiment of the present invention provides a method, device, head-mounted device and storage medium for switching an input mode. The technical solution provided by the embodiment of the present invention realizes
[0032] In an embodiment of the present application, when the current input mode of the head-mounted device is a palm input mode and the environmental brightness of the current environment is less than a preset brightness threshold, a target input mode is determined based on a preset input mode switching strategy, and the input mode is switched from the palm input mode to the target input mode. It can be understood that when the environmental brightness is relatively dim, that is, the environmental brightness is less than the preset brightness threshold, it is difficult for the head-mounted device to clearly recognize the information input by the user in the palm input mode, resulting in a low accuracy rate of the head-mounted device in recognizing the user input information. However, in this embodiment, when the environmental brightness is relatively dim, the head-mounted device will automatically determine the target input mode and switch from the palm input mode to the target input mode, thereby improving the accuracy rate of the head-mounted device in recognizing the information input by the user. Moreover, in this embodiment, the head-mounted device can automatically switch the input mode according to the current environmental brightness without the need for the user to manually switch the input mode, improving the intelligence of the input mode switching in the head-mounted device. Description of the Drawings
[0033] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0034] Figure 1 It is a schematic block diagram of a head-mounted device provided by an embodiment of the present invention;
[0035] Figure 2 It is a schematic flowchart of a method for switching input modes provided by an embodiment of the present invention;
[0036] Figure 3 It is a schematic block diagram of a device for switching input modes provided by an embodiment of the present invention. Detailed implementation manners
[0037] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
[0038] The flowcharts shown in the accompanying drawings are only illustrative examples, and do not necessarily include all the contents and operations / steps, nor do they necessarily need to be executed in the described order. For example, some operations / steps can also be decomposed, combined, or partially merged. Therefore, the actual execution order may be changed according to the actual situation.
[0039] It should be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in this specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an", and "the" are intended to include the plural forms.
[0040] With the continuous improvement of communication technologies, more and more intelligent devices have emerged, such as head-mounted devices like augmented reality devices and virtual reality devices. When a user uses a head-mounted device, the head-mounted device needs to be worn on the user's head. In related technologies, if a user wants to input relevant information in the head-mounted device during the process of wearing the head-mounted device, relevant information can be input through input modes such as the built-in input method, voice input, and cross-screen input in the head-mounted device. Among these input modes, how to switch input modes is an urgent problem to be solved.
[0041] Furthermore, the head-mounted device can also use the palm input mode for information input. However, when using the palm input mode, there are relatively high requirements for the ambient brightness. If the ambient brightness is too low, it will result in a low accuracy rate of recognizing the information input by the user in the palm input mode.
[0042] Based on the above related technologies, embodiments of the present invention provide a method and apparatus for switching input modes, a head-mounted device, and a storage medium. The technical solutions provided by the embodiments of the present invention.
[0043] In the embodiments of the present invention, the head-mounted device may be an AR (Augmented Reality) device, a VR (Virtual Reality) device, or the like.
[0044] The following will describe in detail some embodiments of the present invention with reference to the accompanying drawings. Without conflict, the embodiments and features in the following embodiments may be combined with each other.
[0045] Figure 1 is a schematic block diagram of a head-mounted device provided by an embodiment of the present invention.
[0046] As Figure 1 shown, the head-mounted device 100 includes a processor 101 and a memory 102. The processor 101 and the memory 102 are connected through a bus 103, and the bus may be, for example, an I2C (Inter-integrated Circuit) bus. The head-mounted device 100 may be a target head-mounted device, a first head-mounted device, and a second head-mounted device.
[0047] Specifically, the processor 101 is used to provide computing and control capabilities to support the operation of the entire head-mounted device 100. The processor 101 may be a central processing unit (CPU), and the processor 101 may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0048] Specifically, the memory 102 may be a Flash chip, a read-only memory (ROM), a magnetic disk, an optical disc, a USB flash drive, or a mobile hard disk, etc.
[0049] Those skilled in the art can understand that Figure 1The structure shown is only a block diagram of some structures related to the solution of the embodiments of the present invention, and does not constitute a limitation on the head-mounted device to which the solution of the embodiments of the present invention is applied. The specific head-mounted device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.
[0050] Wherein, the processor 101 is used to run a computer program stored in the memory 102, and the computer program can be set in the head-mounted device and implement any one of the input mode switching methods provided by the embodiments of the present invention when the computer program is executed.
[0051] In one embodiment, the processor is used to run a computer program stored in the memory and implement the following steps when the computer program is executed:
[0052] When the current input mode of the head-mounted device is the palm input mode, obtain the ambient brightness of the current environment of the head-mounted device;
[0053] In response to the ambient brightness being less than a preset brightness threshold, determine a target input mode based on a preset input mode switching strategy;
[0054] Control the input mode of the head-mounted device to switch from the palm input mode to the target input mode.
[0055] In one embodiment, the determining the target input mode based on a preset input mode switching strategy in response to the ambient brightness being less than a preset brightness threshold includes:
[0056] In response to the ambient brightness being less than a preset brightness threshold, obtain the current remaining power of the head-mounted device;
[0057] If the remaining power is less than a first preset power threshold, determine a target input mode based on a preset input mode switching strategy.
[0058] In one embodiment, when the processor executes the computer program, it is further used to implement the following steps:
[0059] If the remaining power is greater than or equal to the preset power threshold, control the head-mounted device to turn on the light to increase the ambient brightness.
[0060] In one embodiment, when the input mode switching strategy is a priority switching strategy, the determining the target input mode based on a preset input mode switching strategy in response to the ambient brightness being less than a preset brightness threshold includes:
[0061] In response to the ambient brightness being less than a preset brightness threshold, determine the input mode with the highest priority;
[0062] Determine a target input mode according to the input mode with the highest priority.
[0063] In one embodiment, determining the input mode with the highest priority as the target input mode includes:
[0064] In response to the input mode with the highest priority being a cross-screen input mode, determine whether the head-mounted device is connected to a terminal device;
[0065] If the head-mounted device is not connected to the terminal device, determine the input mode with the highest priority other than the palm input mode and the cross-screen input mode as the target input mode.
[0066] In one embodiment, after determining whether the head-mounted device is connected to the terminal device, when the processor executes the computer program, it is further configured to implement the following steps:
[0067] If the head-mounted device is connected to the terminal device, obtain the current battery level of the terminal device;
[0068] If the current battery level is less than a second preset battery level threshold, determine the input mode with the highest priority other than the palm input mode and the cross-screen input mode as the target input mode.
[0069] In one embodiment, when the input mode switching strategy is a sequential switching strategy, in response to the ambient brightness being less than a preset brightness threshold, determining the target input mode based on a preset input mode switching strategy includes:
[0070] In response to the ambient brightness being less than a preset brightness threshold, determine the next input mode corresponding to the palm input mode based on the sequential switching strategy;
[0071] Determine the next input mode as the target input mode.
[0072] It should be noted that those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the head-mounted device described above can refer to the corresponding process in the embodiment of the following input mode switching method, and will not be elaborated here.
[0073] Next, the input mode switching method provided by the embodiment of the present invention will be introduced in detail in combination with the head-mounted device in Figure 1 . It should be noted that the head-mounted device in Figure 1 is only used to explain the input mode switching method provided by the embodiment of the present invention, but does not limit the application scenario of the input mode switching method provided by the embodiment of the present invention.
[0074] Please refer to Figure 2 ,Figure 2 It is a schematic flowchart of a method for switching input modes provided by an embodiment of the present invention.
[0075] As Figure 2 shown, this method for switching input modes is applied to a head-mounted device, and the method for switching input modes includes steps S101 to S103.
[0076] Step S101: When the current input mode of the head-mounted device is the palm input mode, obtain the ambient brightness of the current environment of the head-mounted device;
[0077] In the embodiments of the present disclosure, multiple different input modes are set in the head-mounted device. The operating conditions of each input mode are different. Users can input the information they want to input in the head-mounted device through various different input modes. For example, they can start the corresponding input method through the input mode to reply to information, input relevant phone numbers to make calls, or input retrieval information on the retrieval website, etc. In the embodiments of the present disclosure, the input modes include but are not limited to the palm input mode, the cross-screen input mode, the voice input mode, and the default input mode. Among them, the palm input mode is a text input method in which the head-mounted device recognizes and tracks the palm center of the user through its camera, anchors its virtual keyboard interface on the palm center, and then the camera recognizes the user using the fingers of the other hand to tap the virtual keyboard anchored on the palm. The cross-screen input mode is that the head-mounted device establishes a communication connection with the terminal device, and then the head-mounted device recognizes and tracks the terminal device through its camera to anchor the terminal device. The user can input on the terminal device, and the head-mounted device can receive the information input by the user in the terminal device. The terminal device can be a mobile phone, a laptop computer, etc. The voice input mode is that the head-mounted device collects the user's audio and converts the user's audio into text and displays it on its display interface. The default input mode can be that a virtual keyboard is displayed on the display interface of the head-mounted device, and the user controls the virtual keyboard displayed on the display interface through the touch keys set on the head-mounted device, so as to achieve information input. In other embodiments, the default input mode can also be the head movement input mode. The head movement input mode is that a virtual keyboard is displayed on the display interface of the head-mounted device. When the head-mounted device is in a worn state, the head-mounted device obtains the head movement information of the user and controls the virtual keyboard through the head movement information, so as to achieve information input. In another embodiment, the default input mode can also be the manual input mode. The manual input mode is that a virtual keyboard is displayed on the display interface of the head-mounted device, and the head-mounted device has established a communication connection with a remote control device (such as a finger ring, a finger clip, etc.). The user can control the virtual keyboard through the remote control device, so as to achieve information input.
[0078] When the current input mode of the head-mounted device is the palm input mode, the head-mounted device obtains the ambient brightness of its current environment. In the embodiments of the present disclosure, the mode identifiers corresponding to different input modes are different, and different input modes can be identified through the mode identifier. Therefore, the head-mounted device can determine whether the current input mode is the palm input mode by obtaining the mode identifier corresponding to the input mode. In the head-mounted device, a brightness sensor for detecting brightness is provided, and the brightness sensor can detect the ambient brightness of the environment where the head-mounted device is currently located. When the head-mounted device is in a worn state, the brightness sensor can be activated, or the user can manually activate the brightness sensor when needed.
[0079] Step S102: In response to the ambient brightness being less than a preset brightness threshold, determine a target input mode based on a preset input mode switching strategy.
[0080] After the head-mounted device obtains the ambient brightness of the current environment, the head-mounted device determines whether the ambient brightness is less than a preset brightness threshold. The size of the preset brightness threshold can be set according to specific needs, and this embodiment does not make specific limitations on this. If the ambient brightness of the current environment is less than the preset brightness threshold, the head-mounted device determines the target input mode based on a preset input mode switching strategy. In the embodiments of the present disclosure, the input mode switching strategy includes, but is not limited to, a priority switching strategy and a sequential switching strategy. Among them, the priority switching strategy is to preferentially switch to the input mode with the highest priority, and the sequential switching strategy is to preset the order of operation of various input modes in advance. During the input mode switching process, the next input mode corresponding to the current input mode is determined as the target input mode.
[0081] In one embodiment, if the ambient brightness is greater than or equal to the preset brightness threshold, the head-mounted device continues to maintain the current input mode, that is, the user can continue to use the palm input mode for information input without switching the input mode.
[0082] In one embodiment, when the input mode switching strategy is the sequential switching strategy, step S102 further includes:
[0083] Step a: In response to the ambient brightness being less than the preset brightness threshold, determine the next input mode corresponding to the palm input mode based on the sequential switching strategy;
[0084] Step b: Determine the next input mode as the target input mode.
[0085] In one embodiment, if the current input mode switching strategy is a sequential switching strategy and the current ambient brightness is less than the preset brightness threshold, the head-mounted device determines the next input mode corresponding to the palm input mode based on the sequential switching strategy and determines the next input mode as the target input mode. For example, if the preset order of the input modes from front to back is: palm input mode, cross-screen input mode, voice input mode, and default input mode, the next input mode can be determined as the cross-screen input mode, that is, the cross-screen input mode is the target input mode; if the preset order of the input modes from front to back is: cross-screen input mode, palm input mode, voice input mode, and default input mode, the next input mode can be determined as the voice input mode, that is, the voice input mode is the target input mode.
[0086] Step S103: Control the input mode of the head-mounted device to switch from the palm input mode to the target input mode.
[0087] After the head-mounted device determines the target input mode, the head-mounted device switches its current input mode from the palm input mode to the target input mode. In another embodiment, in order to improve the success rate of input mode switching, after determining the target input mode, the head-mounted device determines whether the current conditions meet the operating conditions of the target input mode. If the operating conditions of the target input mode are not met, the target input mode is re-determined based on the preset input mode switching strategy; if the operating conditions of the target input mode are met, the input mode is switched from the palm input mode to the target input mode.
[0088] In this embodiment, when the current input mode of the head-mounted device is the palm input mode and the ambient brightness of the current environment is less than the preset brightness threshold, the target input mode is determined based on the preset input mode switching strategy, and the input mode is switched from the palm input mode to the target input mode. It can be understood that when the ambient brightness is relatively dim, that is, the ambient brightness is less than the preset brightness threshold, it is difficult for the head-mounted device to clearly recognize the information input by the user in the palm input mode, resulting in a low accuracy rate of the head-mounted device in recognizing the user input information. In this embodiment, when the ambient brightness is relatively dim, the head-mounted device automatically determines the target input mode and switches from the palm input mode to the target input mode, thereby improving the accuracy rate of the head-mounted device in recognizing the user input information. Moreover, in this embodiment, the head-mounted device can automatically switch the input mode according to the current ambient brightness without the need for the user to manually switch the input mode, improving the intelligence of the input mode switching in the head-mounted device.
[0089] In one embodiment, step S102 includes:
[0090] Step c: In response to the ambient brightness being less than the preset brightness threshold, obtain the current remaining power of the head-mounted device;
[0091] Step d, if the remaining power is less than the first preset power threshold, determine the target input mode based on a preset input mode switching strategy.
[0092] In one embodiment, the method further includes:
[0093] Step e, if the remaining power is greater than or equal to the preset power threshold, control the head-mounted device to turn on the light to increase the ambient brightness.
[0094] In another embodiment, if the head-mounted device determines that the current ambient brightness is less than the preset brightness threshold, the head-mounted device obtains its current remaining power and determines whether its current remaining power is less than the first preset power threshold. The first preset power threshold can be set according to specific needs, such as 30%, 20%, etc. If the current remaining power is less than the first preset power threshold, the head-mounted device determines the target input mode based on a preset input mode switching strategy. If the current remaining power is greater than or equal to the preset power threshold, the head-mounted device automatically triggers a light-on command to turn on the light through the light-on command to increase the ambient brightness around the palm where the virtual keyboard is located, so that the user can continue to use the palm input mode to input information in the head-mounted device. For example, when the head-mounted device is an AR glasses, an LED (light-emitting diode) light can be provided in the frame of the AR glasses. When the AR glasses trigger the light-on command, the LED light can be turned on through the light-on command to increase the ambient brightness around the palm where the virtual keyboard is located.
[0095] In another embodiment, before or after, or at the same time when the head-mounted device turns on the light, the head-mounted device can detect the distance between the palm where the virtual keyboard is located and itself. When the head-mounted device detects that the distance is greater than the preset distance, the head-mounted device can output a prompt message to prompt the user to adjust the distance between their palm and the head-mounted device through the prompt message, thereby improving the accuracy of the head-mounted device in recognizing the user's input information in the palm input mode; if the distance is less than or equal to the preset distance, the head-mounted device can not output the prompt message and continue to maintain the current distance. In this embodiment, the output manner of the prompt message is not limited. For example, the head-mounted device can output the prompt message in the form of voice or text.
[0096] In this embodiment, when the current ambient brightness is less than the preset brightness threshold and the remaining power of the head-mounted device is less than the first preset power threshold, the target input mode is determined based on the preset input mode switching strategy; if the current remaining power is greater than or equal to the first preset power threshold, the light is turned on to increase the ambient brightness, enabling the user to continue to input information in the head-mounted device through the palm input mode, thereby reducing the switching frequency of the input mode and avoiding frequent switching of the input mode during the process of the user inputting information in the head-mounted device.
[0097] In one embodiment, when the input mode switching strategy is the priority switching strategy, step S102 includes:
[0098] Step f, in response to the ambient brightness being less than the preset brightness threshold, determining the input mode with the highest priority in the input modes;
[0099] Step g, determining the target input mode according to the input mode with the highest priority.
[0100] In another embodiment, when the input mode switching strategy is the priority switching strategy, after the head-mounted device determines that the current ambient brightness is less than the preset brightness threshold, the head-mounted device determines the input mode with the highest priority in the input modes and determines the input mode with the highest priority as the target input mode. It can be understood that the input mode with the highest priority in the input modes does not include the currently running input mode, that is, it does not include the palm input mode.
[0101] For example, when the priorities of various input modes in the head-mounted device are from high to low as the cross-screen input mode, the palm input mode, the voice input mode, and the default input mode, at this time, the head-mounted device can determine that the input mode with the highest priority is the cross-screen input mode, and then determine the cross-screen input mode as the target input mode. It can be understood that the order of the priorities of various input modes can be set by the user or determined according to the frequency of the user using various input modes within a certain period of time, that is, the higher the frequency of the user using an input mode, the higher the priority of the input mode.
[0102] In one embodiment, the determining the input mode with the highest priority as the target input mode includes:
[0103] Step h, in response to the input mode with the highest priority being the cross-screen input mode, determining whether the head-mounted device is connected to the terminal device;
[0104] Step i, if the head-mounted device is not connected to the terminal device, determining the input mode with the highest priority except the palm input mode and the cross-screen input mode as the target input mode.
[0105] In one embodiment, if it is determined that the input mode with the highest priority is the cross-screen input mode, the head-mounted device determines whether it is currently connected to a terminal device. If the head-mounted device is not currently connected to a terminal device, the head-mounted device determines the input mode with the highest priority other than the palm input mode and the cross-screen input mode as the target input mode. If the head-mounted device is currently connected to a terminal device, the cross-screen input mode is determined as the target input mode. It can be understood that when the head-mounted device is not currently connected to a terminal device, it means that the current operating conditions for the cross-screen input mode are not met.
[0106] In another embodiment, if the head-mounted device is not currently connected to a terminal device, the head-mounted device detects whether there is a qualified terminal device to be connected within a preset distance range. It can be understood that the terminal device for cross-screen input and the head-mounted device most likely belong to the same user. Therefore, not all terminal devices that can be connected detected by the head-mounted device within the preset distance range are qualified terminal devices to be connected. In the embodiments of the present disclosure, if the head-mounted device detects that the user of the terminal device within the preset distance range and the user of the head-mounted device are the same person, and / or the head-mounted device has been connected to the terminal device before, it can be determined that the terminal device is a qualified terminal device to be connected. In the head-mounted device, the device identifier of the terminal device corresponding to its user can be pre-stored, so that it can be determined whether the user corresponding to the detected terminal device and the user of the head-mounted device are the same person through the device identifier. Among them, the preset distance range can be set according to the needs of the user. For example, if the distance between the terminal device and the head-mounted device worn by the user is A when the user normally holds the terminal device, the preset distance can be set to A or A + x, where x is the set error value and is a positive value to improve the accuracy of detecting the terminal device to be connected. It can be seen that when the distance between a certain terminal device and the head-mounted device is less than or equal to the preset distance, it can be determined that the head-mounted device detects the terminal device within the preset distance range.
[0107] If the head-mounted device detects that there is a qualified terminal device to be connected within the preset distance range, the head-mounted device can establish a communication connection with the qualified terminal device to be connected and start the cross-screen input mode through the terminal device to determine the cross-screen input mode as the target input mode; if the head-mounted device does not detect that there is a qualified terminal device to be connected within the preset distance range, the head-mounted device determines the input mode with the highest priority other than the palm input mode and the cross-screen input mode as the target input mode. If the currently highest-priority input mode in the head-mounted device is the cross-screen input mode, and the current head-mounted device is connected to a terminal device, or there is a qualified terminal device to be connected within the preset distance range, the head-mounted device determines the cross-screen input mode as the target input mode.
[0108] It can be understood that even though the head-mounted device can support multiple input modes, each input mode has its own operating conditions. For example, if the currently highest-priority input mode in the head-mounted device is the cross-screen input mode, but the head-mounted device is not currently connected to any terminal device, then the head-mounted device does not meet the operating conditions of the cross-screen input mode at this time. Therefore, the cross-screen input mode does not belong to the currently switchable input modes, and the head-mounted device needs to determine other switchable input modes.
[0109] In an embodiment of the present disclosure, when determining that the highest-priority input mode is the cross-screen input mode, first determine whether the head-mounted device is connected to a terminal device, that is, first determine whether the current conditions meet the operating conditions of the cross-screen input mode. If the head-mounted device is not connected to a terminal device, then do not determine the cross-screen input mode as the target input mode, and re-determine the target input mode, thereby improving the accuracy of input mode switching.
[0110] In one embodiment, after determining whether the head-mounted device is connected to a terminal device, it further includes:
[0111] Step j, if the head-mounted device is connected to a terminal device, then obtain the current power of the terminal device;
[0112] Step k, if the current power is less than a second preset power threshold, then determine the highest-priority input mode other than the palm input mode and the cross-screen input mode as the target input mode.
[0113] In one embodiment, if the head-mounted device determines that the currently highest-priority input mode is the cross-screen input mode and the head-mounted device is connected to a terminal device, the head-mounted device then obtains the current power of the terminal device and determines whether the current power is less than a second preset power threshold. The current power is the remaining power of the terminal device at present. Among them, the second preset power threshold may be equal to the first preset power threshold or may not be equal to the first preset power threshold. If the head-mounted device determines that the current power is less than the second preset power threshold, the head-mounted device then determines the highest-priority input mode other than the palm input mode and the cross-screen input mode as the target input mode. If the head-mounted device determines that the current power is greater than or equal to the second preset power threshold, the head-mounted device then determines the cross-screen input mode as the target input mode.
[0114] In this embodiment, when it is determined that the input mode with the highest priority is the cross-screen input mode, whether to determine the cross-screen input mode as the target input mode is determined according to the current battery level of the terminal device, so as to avoid starting the cross-screen input module through the terminal device when the battery level of the terminal device is low, resulting in the need to switch the input mode again soon after running the cross-screen input mode due to the low battery level of the terminal device. Therefore, this embodiment reduces the switching frequency of the input mode.
[0115] Please refer to Figure 3 , Figure 3 which is a schematic block diagram of the structure of a switching device for input modes provided by an embodiment of the present invention.
[0116] As Figure 3 shown, the input mode switching device 300 is applied to a head-mounted device. The input mode switching device 300 includes, among others:
[0117] A brightness acquisition module 310, configured to acquire the ambient brightness of the current environment of the head-mounted device when the current input mode of the head-mounted device is the palm input mode;
[0118] An input mode determination module 320, configured to determine a target input mode based on a preset input mode switching strategy in response to the ambient brightness being less than a preset brightness threshold;
[0119] A mode switching module 330, configured to control the input mode of the head-mounted device to switch from the palm input mode to the target input mode.
[0120] In one embodiment, the input mode determination module 320 includes:
[0121] A battery level acquisition unit, configured to acquire the remaining battery level of the head-mounted device in response to the ambient brightness being less than a preset brightness threshold;
[0122] A first input mode determination unit, configured to determine a target input mode based on a preset input mode switching strategy if the remaining battery level is less than a first preset battery level threshold.
[0123] In one embodiment, the input mode switching device 300 further includes:
[0124] A light turning-on module, configured to control the head-mounted device to turn on the light to increase the ambient brightness if the remaining battery level is greater than or equal to a preset battery level threshold.
[0125] In one embodiment, when the input mode switching strategy is a priority switching strategy, the input mode determination module 320 further includes:
[0126] A priority determination unit, configured to determine the input mode with the highest priority in the input modes in response to the environmental brightness being less than a preset brightness threshold;
[0127] A second input mode determination unit, configured to determine a target input mode according to the input mode with the highest priority.
[0128] In an embodiment, the second input mode determination unit is configured to, in response to the input mode with the highest priority being a cross-screen input mode, determine whether the head-mounted device is connected to a terminal device; if the head-mounted device is not connected to the terminal device, determine the input mode with the highest priority except the palm input mode and the cross-screen input mode as the target input mode.
[0129] In an embodiment, the second input mode determination unit is further configured to, if the head-mounted device is connected to the terminal device, obtain the current power of the terminal device; if the current power is less than a second preset power threshold, determine the input mode with the highest priority except the palm input mode and the cross-screen input mode as the target input mode.
[0130] In an embodiment, when the input mode switching strategy is a sequential switching strategy, the input mode determination module 320 is further configured to, in response to the environmental brightness being less than a preset brightness threshold, determine the next input mode corresponding to the palm input mode based on the sequential switching strategy; and determine the next input mode as the target input mode.
[0131] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described input mode switching device can refer to the corresponding process in the foregoing embodiments of the input mode switching method, and will not be described herein again.
[0132] An embodiment of the present invention further provides a storage medium for computer-readable storage. The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement any one of the input mode switching methods provided in the specification of the embodiments of the present invention.
[0133] Wherein, the storage medium may be an internal storage unit of the head-mounted device described in the foregoing embodiments, such as a hard disk or a memory of the head-mounted device. The storage medium may also be an external storage device of the head-mounted device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the head-mounted device.
[0134] Those of ordinary skill in the art will understand that all or some of the steps in the methods disclosed above, and the functional modules / units in systems and devices, can be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware embodiment, the division of functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, one physical component can have multiple functions, or one function or step can be executed by several physical components working together. Some or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cassettes, tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, a communication medium typically contains computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and can include any information delivery medium.
[0135] It should be understood that the term "and / or" as used in the specification and appended claims of the present invention refers to any combination and all possible combinations of one or more of the associated listed items, and includes such combinations. It should be noted that in this text, the term "comprises", "comprising", or any other variation thereof is intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a series of elements includes not only those elements but also other elements not expressly listed, or elements that are inherent to such process, method, article, or system. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, article, or system that comprises the element.
[0136] The serial numbers of the embodiments of the present invention above are only for description and do not represent the superiority or inferiority of the embodiments. The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention can easily think of various equivalent modifications or substitutions, and these modifications or substitutions should all be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims
1. A method for switching input modes, characterized in that, The method is applied to a head-mounted device, and the method includes: When the current input mode of the head-mounted device is the palm input mode, obtaining the ambient brightness of the current environment of the head-mounted device; In response to the ambient brightness being less than a preset brightness threshold, determining a target input mode based on a preset input mode switching strategy; Controlling the input mode of the head-mounted device to switch from the palm input mode to the target input mode.
2. The method for switching the input mode according to claim 1, wherein The step of "in response to the ambient brightness being less than a preset brightness threshold, determining a target input mode based on a preset input mode switching strategy" includes: In response to the ambient brightness being less than a preset brightness threshold, obtaining the remaining power of the head-mounted device; If the remaining power is less than a first preset power threshold, determining a target input mode based on a preset input mode switching strategy.
3. The method for switching the input mode according to claim 2, wherein The method further includes: If the remaining power is greater than or equal to the preset power threshold, controlling the head-mounted device to turn on the light to increase the ambient brightness.
4. The method for switching the input mode according to claim 1, characterized in that When the input mode switching strategy is a priority switching strategy, the step of "in response to the ambient brightness being less than a preset brightness threshold, determining a target input mode based on a preset input mode switching strategy" includes: In response to the ambient brightness being less than a preset brightness threshold, determining the input mode with the highest priority; Determining the target input mode according to the input mode with the highest priority.
5. The method for switching the input mode according to claim 4, wherein, The step of "determining the input mode with the highest priority as the target input mode" includes: In response to the input mode with the highest priority being the cross-screen input mode, determining whether the head-mounted device is connected to a terminal device; If the head-mounted device is not connected to the terminal device, determining the input mode with the highest priority other than the palm input mode and the cross-screen input mode as the target input mode.
6. The method for switching the input mode according to claim 5, characterized in that After determining whether the head-mounted device is connected to the terminal device, it further includes: If the head-mounted device is connected to the terminal device, obtaining the current power of the terminal device; If the current power is less than a second preset power threshold, determining the input mode with the highest priority other than the palm input mode and the cross-screen input mode as the target input mode.
7. The method for switching the input mode according to claim 1, wherein When the input mode switching strategy is a sequential switching strategy, the step of "in response to the ambient brightness being less than a preset brightness threshold, determining a target input mode based on a preset input mode switching strategy" includes: In response to the ambient brightness being less than a preset brightness threshold, determining the next input mode corresponding to the palm input mode based on the sequential switching strategy; Determining the next input mode as the target input mode.
8. A switching device for an input mode, characterized in that, The input mode switching device is applied to a head-mounted device, and the input mode switching device includes: A brightness acquisition module, configured to obtain the ambient brightness of the current environment of the head-mounted device when the current input mode of the head-mounted device is the palm input mode; An input mode determination module, configured to determine a target input mode based on a preset input mode switching strategy in response to the ambient brightness being less than a preset brightness threshold; A mode switching module, configured to control the input mode of the head-mounted device to switch from the palm input mode to the target input mode.
9. A head-mounted device, characterized in that, The head-mounted device includes a processor, a memory, a computer program stored on the memory and executable by the processor, and a data bus for implementing connection and communication between the processor and the memory. When the computer program is executed by the processor, it implements the input mode switching method according to any one of claims 1 to 7.
10. A storage medium for computer-readable storage, characterized in that, The storage medium stores one or more programs, and the one or more programs are executable by one or more processors to implement the input mode switching method according to any one of claims 1 to 7.