Electronic device operating method and electronic device
By obtaining and analyzing user's hand operation information and dynamically adjusting the status and input mode of the electronic device, the problem of single interaction mode in the prior art is solved, and better user interaction experience and operation efficiency are achieved.
Patent Information
- Application Number
- CN202111094171.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-17
- Publication Date
- 2025-08-22
- Estimated Expiration
- 2041-09-17
AI Technical Summary
The user interaction method of existing electronic devices is single, especially the system display area of dual-screen laptops is not fully used, so users need to manually switch the keyboard input mode to increase the operating burden.
By obtaining the user's manual operation information, determining the operation mode, and controlling the status of the electronic device according to the preset relationship, including playback, opening and closing, display status, etc., dynamically adjusting the keyboard layout and input mode, combining the acquisition and display area of the touchpad.
The various states of electronic devices are related to hand operation methods, providing a better interactive environment, reducing user operation burden, and improving interactive experience and efficiency.
Smart Images

Figure CN113791699B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of information processing technology, and in particular relates to an electronic device operating method and the electronic device. Background Art
[0002] Most existing electronic products, such as desktop computers and laptops, require users to operate them with their hands, such as pressing the keyboard with their fingers to perform input operations. However, the control of electronic devices by users through hand operations is relatively simple, and hand operations are not associated with the various functions and states of the electronic devices, thereby failing to provide users with a better interactive environment.
[0003] Especially in the laptop market, laptop keyboards currently come in two main types: physical keyboards and virtual keyboards. Virtual keyboards are commonly used in dual-screen laptops, where the system and display sides of a dual-screen laptop each have independent display areas, providing a better interactive environment for users. However, the system-side display area of dual-screen laptops is not well utilized, especially when users need to manually switch keyboard input modes. This is no different from the switching operation on single-screen laptops, requiring manual switching, which increases the user's operational burden. Summary of the Invention
[0004] In response to the above-mentioned technical problems existing in the prior art, the present disclosure provides an electronic device operation method and an electronic device, which can fully combine the user's hand operation information to control the electronic device, providing a better interactive environment for the user.
[0005] In a first aspect, an embodiment of the present invention provides a method for operating an electronic device, which is applied to the electronic device and includes:
[0006] Acquiring hand operation information at least related to the posture of the operating body;
[0007] determining an operation mode of the operating body based on the hand operation information;
[0008] According to the association between the operation mode and the preset operation function of the electronic device, the electronic device is controlled to a state corresponding to the operation mode.
[0009] In some embodiments, the method further comprises:
[0010] responding to a mode of operation associated with the press;
[0011] Control the electronic device to at least one or more of the following states corresponding to the operation mode:
[0012] The playing state, opening and closing state and display state of the electronic device.
[0013] In some embodiments, the method further comprises:
[0014] responding to sliding information in the hand operation information;
[0015] Determining that the operation mode is a sliding operation;
[0016] The electronic device is manipulated to an erasing state corresponding to the sliding operation, and content on a path of the sliding operation is erased.
[0017] In some embodiments, the method further comprises:
[0018] An operation interface in response to obtaining verification information for verifying the identity of a user;
[0019] The electronic device is controlled to a state of adjusting the input mode of the keyboard corresponding to the operation mode.
[0020] In some embodiments, the method further comprises:
[0021] responding to pressing information in the hand operation information;
[0022] The layout state of the keyboard of the electronic device is adjusted based on the association between the pressing information and the preset operation function to change the key positions of the keyboard, wherein the layout state is used to represent the positions of the various keys of the keyboard.
[0023] In some embodiments, the method further comprises:
[0024] determining an operation area corresponding to a touch panel of the electronic device according to the hand operation information;
[0025] The acquisition area and / or display area of the touch panel is dynamically adjusted based on the operation area.
[0026] In some embodiments, the state includes at least a first sub-input mode, a second sub-input mode, and a third sub-input mode corresponding to and different from a keyboard of the electronic device;
[0027] The method further comprises:
[0028] When determining that the operation mode is the single operator mode, switching the keyboard to the first sub-mode for inputting first-category characters;
[0029] When the operation mode is determined to be the dual-operator mode, switching the keyboard to the second sub-mode for inputting a second type of characters;
[0030] When it is determined that the operation mode is the no-operation-body mode, the keyboard is switched to the third sub-mode for inputting third-category characters.
[0031] In some embodiments, the method further comprises:
[0032] When it is determined that the operation mode is a single-operator mode or a no-operator mode, gesture information at least related to a finger is collected via a touch panel of the electronic device.
[0033] In some embodiments, the operating body is a palm, and obtaining hand operation information at least related to the posture of the operating body specifically includes:
[0034] collecting left palm information and right palm information through the touch panel of the electronic device;
[0035] The hand operation information is determined based on the left palm information and the right palm information.
[0036] In a second aspect, an embodiment of the present invention further provides an electronic device, the electronic device comprising:
[0037] Touch panel: configured to obtain hand operation information at least related to the posture of the operating body;
[0038] a processor configured to determine an operation mode of the operating body based on the hand operation information;
[0039] According to the association between the operation mode and the preset operation function of the electronic device, the electronic device is controlled to a state corresponding to the operation mode.
[0040] Compared with the prior art, the beneficial effect of the embodiments of the present disclosure is that: the present disclosure can control the electronic device to a state corresponding to the operation mode by obtaining hand operation information and determining the operation mode based on the hand operation information, thereby making full use of hand operation information to control the electronic device, and associating multiple states of the electronic device with different operation modes, thereby providing users with a better interactive environment and adding new interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] In the drawings, which are not necessarily drawn to scale, the same reference numerals may describe similar components in different views. The same reference numerals with letter suffixes or different letter suffixes may represent different instances of similar components. The accompanying drawings generally illustrate various embodiments by way of example and not limitation, and together with the description and claims, serve to illustrate the disclosed embodiments. Where appropriate, the same reference numerals are used throughout the drawings to refer to the same or similar parts. Such embodiments are illustrative and are not intended to be exhaustive or exclusive of the embodiments of the present apparatus or method.
[0042] Figure 1 A flowchart of a method for operating an electronic device according to an embodiment of the present invention;
[0043] Figure 2 This is a first operation display diagram of the method for operating an electronic device according to an embodiment of the present invention;
[0044] Figure 3 This is a second operation display diagram of the method for operating an electronic device according to an embodiment of the present invention;
[0045] Figure 4 This is a third operation display diagram of the method for operating an electronic device according to an embodiment of the present invention;
[0046] Figure 5 This is a fourth operation diagram illustrating the method for operating an electronic device according to an embodiment of the present invention;
[0047] Figure 6 This is a fifth operation diagram illustrating the method for operating an electronic device according to an embodiment of the present invention;
[0048] Figure 7 This is a sixth operation diagram illustrating the method for operating an electronic device according to an embodiment of the present invention;
[0049] Figure 8 FIG7 is a seventh operation display diagram of the method for operating an electronic device according to an embodiment of the present invention;
[0050] Figure 9 2 is a structural block diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0051] Various aspects and features of the present invention are described herein with reference to the accompanying drawings.
[0052] It should be understood that various modifications may be made to the embodiments of the invention herein. Therefore, the above description should not be considered as limiting, but merely as an example of an embodiment. Other modifications within the scope and spirit of the invention will occur to those skilled in the art.
[0053] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the general description of the invention given above and the detailed description of the embodiments given below, serve to explain the principles of the invention.
[0054] These and other characteristics of the invention will become apparent from the following description of a preferred form of embodiment given as a non-limiting example with reference to the accompanying drawings.
[0055] It should also be understood that although the invention has been described with reference to certain specific embodiments, those skilled in the art will readily be able to implement many other equivalent forms of the invention.
[0056] The above and other aspects, features and advantages of the present invention will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.
[0057] Specific embodiments of the present invention will be described hereinafter with reference to the accompanying drawings; however, it should be understood that the embodiments described are merely examples of the present invention, which may be implemented in a variety of ways. Well-known and / or repetitive functions and structures are not described in detail to avoid obscuring the present invention with unnecessary or redundant detail. Therefore, the specific structural and functional details disclosed herein are not intended to be limiting, but rather to serve as a basis and representative basis for the claims to teach those skilled in the art to variously employ the present invention with virtually any suitable detailed structure.
[0058] This specification may use the phrases "in one embodiment," "in another embodiment," "in a further embodiment," or "in other embodiments," each of which may refer to one or more of the same or different embodiments according to the present invention.
[0059] In the first aspect, an embodiment of the present invention provides a method for operating an electronic device, which is applied to an electronic device. The electronic device can refer to different electronic devices such as a mobile phone, a PAD (tablet computer), a laptop computer, a PC (Personal Computer), etc. The present invention does not limit the specific type of electronic device, as long as the electronic device can collect hand operation information.
[0060] like Figure 1 As shown, the electronic device operating method includes steps S101 to S103.
[0061] Step S101: Acquire hand operation information at least related to the posture of the operating body.
[0062] Specifically, the electronic device may include a display terminal and a system terminal. The system terminal is provided with a keyboard and a touchpad. The touchpad may be located closer to the user than the keyboard or located on opposite sides of the keyboard. The touchpad may be used to collect the hand operation information. The touchpad may also be provided with a display area that can be linked with the display terminal to provide a dual-screen display experience for the user.
[0063] Specifically, the above-mentioned operating body can be understood as a body capable of manipulating an electronic device, such as a user's hand, a manipulator manipulating an electronic device, or other body manipulating an electronic device, and this application does not impose specific limitations on this. The following description will be specifically described using the user's hand as an example of the operating body manipulating an electronic device.
[0064] Specifically, the gesture of the operating body may include at least one or more of the following gestures: a lifting gesture, a pressing gesture, a sliding gesture, a single-handed gesture, a two-handed gesture, and a hands-free gesture, etc. The lifting gesture and the pressing gesture may be understood as the gesture of the user's hand lifting or pressing on the touchpad of the electronic device.
[0065] Specifically, the electronic device may collect the posture of the operating body through one or more of a touch panel, an infrared sensor, and a camera recognition device, thereby obtaining hand operation information, which is not specifically limited in this application.
[0066] Step S102: determining the operation mode of the operating body based on the hand operation information.
[0067] Specifically, the above-mentioned operation mode may include at least one or more of the following modes: lifting operation, pressing operation, sliding operation, single-hand operation, two-hand operation and hand-free operation, etc.
[0068] Of course, the above operation mode can also be a combination of multiple modes, such as two-hand lift operation, two-hand press operation, one-hand press operation, one-hand lift operation, slide press operation, etc. Figures 2 to 4 As shown, Figure 2 The operation method shown in the figure is to press with both hands. Figure 3 The operation mode shown in the figure is a one-handed pressing operation. Figure 4 The operation method shown in FIG is a one-hand lift operation.
[0069] Step S103: According to the association relationship between the operation mode and the preset operation function of the electronic device, the electronic device is controlled to a state corresponding to the operation mode.
[0070] Specifically, the electronic device may store a first association table between operating modes and electronic device states, wherein different operating modes correspond to electronic device states. The first association table may be set by the user based on operating habits or may be set when the electronic device leaves the factory, and this application does not specifically limit this.
[0071] Specifically, the state of the electronic device may be understood as an input mode, a keyboard layout state, etc. The input mode may be related to input characters, the language of input text, and the case of the input text.
[0072] For example, when the aforementioned operation mode is a sliding press operation, the electronic device can switch from the current state to the erase state corresponding to the sliding press operation; when the aforementioned operation mode is a single-handed press operation, the electronic device can switch from the current keyboard layout state to the keyboard layout state corresponding to the single-handed press operation, and the keyboard layout state can be related to the user's input operation habits. Of course, when the aforementioned operation mode is different modes such as two-handed operation and single-handed operation, different electronic device states corresponding to the operation mode can be set, so that the user can achieve multi-angle control of the state of the electronic device through only hand movements, thereby optimizing the user experience.
[0073] Specifically, the target state to be switched to by manipulating the electronic device can be determined in combination with the current state of the electronic device. For example, if the current state is that the electronic device is in the audio-on state, if an operation method related to manipulating the audio on and off of the electronic device is received, based on the electronic device currently being in the audio-on state, the electronic device is switched to the audio-off state; if the current state is that the electronic device is in the audio-off state, if an operation method related to manipulating the audio on and off of the electronic device is received, based on the electronic device currently being in the audio-off state, the electronic device is switched to the audio-on state. The above-mentioned operation methods related to manipulating the audio on and off of the electronic device received can be the same or different. Therefore, when the received operation methods are the same, the present application can switch the function corresponding to the target state between on and off.
[0074] The present disclosure obtains hand operation information and determines the operation mode according to the hand operation information, so as to control the electronic device to a state corresponding to the operation mode, thereby making full use of the hand operation information to control the electronic device and associating various states of the electronic device with different operation modes, thereby providing users with a better interactive environment and adding new interactive experience.
[0075] In some embodiments, the method further comprises:
[0076] responding to a mode of operation associated with the press;
[0077] The electronic device is controlled to at least one or more of the following states corresponding to the operation mode: a play state, an on / off state, and a display state of the electronic device.
[0078] Specifically, the touchpad of the electronic device can collect the pressing operation of the user's hand and further determine whether the operation mode is a single-hand pressing operation or a double-hand pressing operation. In the first association table, the single-hand pressing operation and the double-hand pressing operation can correspond to different electronic device states.
[0079] Specifically, the above-mentioned playback status may at least include a playback on status and a playback off status, the above-mentioned on / off status may at least include an on status and a off status of the electronic device, and the above-mentioned display status may at least include a locked display interface status and an unlocked display interface status.
[0080] Specifically, when an operation method related to pressing is received, the target state to be switched to by the electronic device can be determined in combination with the current state of the electronic device. For example, when the current state is the play-on state, the electronic device can be switched to the play-off state based on the operation method related to pressing; when the current state is the play-off state, the electronic device can be switched to the play-on state based on the operation method related to pressing. In other words, the operation method related to pressing is related to the play state, and can switch the play state of the electronic device to a state different from the current state.
[0081] Specifically, the above-mentioned operation mode may correspond not only to the state of one electronic device, but also to multiple states. For example, after determining the operation mode, both the playback state and the display state of the electronic device may be controlled to further improve the convenience of controlling the electronic device and simplify user operations.
[0082] In some embodiments, the method further includes steps S201 to S203.
[0083] Step S201: responding to the sliding information in the hand operation information.
[0084] Step S202: Determine whether the operation mode is a sliding operation.
[0085] Specifically, the sliding operation can be understood as the operation of sliding the user's hand a certain distance on the touch pad of the electronic device. The sliding operation can be performed by the user's fingers or the user's palm. In short, it is related to the sliding operation of the user's hand.
[0086] Step S203: operating the electronic device to an erasing state corresponding to the sliding operation, and erasing the content on the path of the sliding operation.
[0087] Specifically, the objects of the above-mentioned erasing processing may be pictures, texts, applications or other objects that can be selected by sliding. For example, when the current state of the electronic device is input mode, the user can select multiple texts at a time through a sliding operation, and erase the multiple texts on the path of the sliding operation; or the current state of the electronic device is a picture processing state, the user can select multiple pictures at a time through a sliding operation, and erase the multiple pictures on the path of the sliding operation; or the current state of the electronic device is a desktop display state, the user can select multiple applications at a time through a sliding operation, and uninstall multiple applications on the path of the sliding operation from the electronic device.
[0088] In this way, the user can realize the synchronous manipulation of multiple objects by a single operation through the sliding operation, thereby improving the user's processing efficiency of the electronic device.
[0089] In some embodiments, the method further comprises:
[0090] An operation interface in response to obtaining verification information for verifying the identity of a user;
[0091] The electronic device is controlled to a state of adjusting the input mode of the keyboard corresponding to the operation mode.
[0092] Specifically, the above-mentioned verification information can be understood as information sent by any client on the electronic device or the electronic device itself to verify the user's identity, such as the verification information for password input when unlocking the electronic device, or the verification information for operating on the client that requires verification of the user name and password.
[0093] Specifically, the state of the input mode corresponding to the verification information can be different from the state of the default input mode of the electronic device. For example, if the default input mode of the electronic device is the Chinese input mode, after the verification information is presented on the electronic device, based on the operation method corresponding to the user's hand operation information, the keyboard input mode can be adjusted to the English input mode in the scenario of verifying the user's identity information. In this way, the user does not need to manually press the keyboard to switch the input mode, thereby improving input efficiency.
[0094] For example, when verification information for verifying the user's identity is presented on the operating interface of an electronic device, if a two-handed operation is detected, the input mode of the keyboard can be adjusted to an uppercase letter input mode, and an input mode in which numbers can be output on the function keys; if a one-handed operation is detected, the input mode of the keyboard can be adjusted to a lowercase letter input mode, and an input mode in which symbols can be output on the function keys.
[0095] Specifically, there may be a second association relationship table different from the first association relationship table among the information presented on the operation interface of the electronic device, the above-mentioned operation method, and the state of the electronic device. In the second association relationship table, the information presented on the operation interface of the electronic device, the operation method, and the state of the electronic device have a mapping relationship. When the information presented on the operation interface of the electronic device and the operation method meet the mapping relationship in the second association relationship table, the state of the electronic device is manipulated to the corresponding state in the second association relationship table.
[0096] Furthermore, the priority of the second association table is higher than that of the first association table. It can be understood that when the mapping relationship between the information presented on the operation interface of the electronic device and the operation method in the second association table is satisfied, the state of the electronic device is manipulated to the corresponding state in the second association table; when the mapping relationship between the information presented on the operation interface of the electronic device and the operation method does not satisfy the second association table, the first association table will be called to manipulate the state of the electronic device to the state corresponding to the operation method in the first association table.
[0097] Specifically, the above-mentioned second association table can also be used to characterize the mapping relationship between the playback status, operation mode and working status of the electronic device. For example, when the electronic device is in the playback state, the operation mode is obtained at this time. After determining that the operation mode and the above-mentioned playback state meet the mapping relationship in the second association table, the state of the electronic device can be adjusted to the corresponding state in the second association table.
[0098] For example, in the second association table, the state of the electronic device corresponding to the electronic device being in the playback state and the two-hand operation is fast-forward playback, and the state of the electronic device corresponding to the electronic device being in the playback state and the one-hand operation is increased volume playback. When the user's operation mode is obtained as two-hand operation in the playback state, the state of the electronic device is controlled to fast-forward playback; when the user's operation mode is obtained as one-hand operation in the playback state, the state of the electronic device is controlled to increase volume playback. The above is only an exemplary description. This application does not limit the specific mapping relationship between the playback state, operation mode and working state of the electronic device in the second association table, as long as it meets the user's operating habits and needs. In one embodiment, the specific mapping relationship between the playback state, operation mode and working state of the electronic device in the second association table can be user-defined to meet the user's personalized needs. For example, in the playback state, the user can configure: left-hand pressing corresponds to fast rewind, right-hand pressing corresponds to fast forward, both-hand pressing corresponds to pause, etc.
[0099] In some embodiments, the method further includes: adjusting a layout state of a keyboard of the electronic device according to the operation mode to change key positions of the keyboard, wherein the layout state is used to characterize the positions of the various keys of the keyboard.
[0100] Specifically, when the keyboard of the electronic device is a virtual keyboard, the positions of each key of the keyboard can be dynamically adjusted according to the operation mode. For example, when the user's operation mode is obtained as two-handed operation, the layout state of the keyboard can be adjusted to the default layout state; when the user's operation mode is obtained as one-handed operation, the keyboard can be adjusted from the default layout state to a preset layout state. The preset layout state can be customized by the user to adapt to the user's own habits, and the change of the key position of the key can improve the security of the input.
[0101] In some embodiments, the method further comprises:
[0102] responding to pressing information in the hand operation information;
[0103] The layout state of the keyboard of the electronic device is adjusted based on the association between the pressing information and the preset operation function to change the key positions of the keyboard, wherein the layout state is used to represent the positions of the various keys of the keyboard.
[0104] Specifically, when the hand operation information includes pressing information, the corresponding operation mode may be a single-hand pressing operation or a double-hand pressing operation. Figure 5 As shown, when the operation mode is one-hand lift operation, the layout state of the keyboard can be adjusted to the default layout state; Figure 6 As shown, when the operation mode is a one-handed press operation, the keyboard layout state can be adjusted from the default layout state to a preset layout state, and the preset layout state can be customized by the user. Of course, the keyboard layout state can also be adjusted to the default layout state when the operation mode is any of the two-handed press, two-handed lift, and one-hand lift operation modes. This application does not limit the specific operation mode for adjusting the keyboard layout state, and users can adjust the settings according to their usage habits.
[0105] In some embodiments, the method further comprises:
[0106] determining an operation area corresponding to a touch panel of the electronic device according to the hand operation information;
[0107] The acquisition area and / or display area of the touch panel is dynamically adjusted based on the operation area.
[0108] Specifically, the touchpad of the electronic device may have a collection area and / or a display area. The collection area is used to collect user hand operation information, and the display area is used to display or assist in displaying information in conjunction with the electronic device's display screen. The operation area corresponding to the hand operation information can be understood as the area corresponding to the user's palm. This operation area is obscured by the palm. Therefore, arranging the collection area and / or display area away from the operation area can avoid accidental touches and palm obstruction of the display.
[0109] Combine Figure 7 and Figure 8 , Figure 7 The operation mode shown in the figure is a one-handed operation. In this case, the acquisition area and / or display area of the touch panel can be adjusted according to the operation area corresponding to the one-handed operation. Figure 8 The operation mode shown in the figure is two-hand operation. At this time, the acquisition area and / or display area of the touchpad can be appropriately adjusted according to the operation area corresponding to the two-hand operation. In this way, when the operation area changes with the position of the hand, the above-mentioned acquisition area and / or display area are dynamically adjusted with the operation area, thereby realizing flexible adjustment of the touchpad.
[0110] In some embodiments, the state includes at least a first sub-input mode, a second sub-input mode, and a third sub-input mode that correspond to and are different from a keyboard of the electronic device.
[0111] The method further includes: when determining that the operation mode is a single operator mode, switching the keyboard to the first sub-mode for inputting first-category characters;
[0112] When the operation mode is determined to be the dual-operator mode, switching the keyboard to the second sub-mode for inputting a second type of characters;
[0113] When it is determined that the operation mode is the no-operation-body mode, the keyboard is switched to the third sub-mode for inputting third-category characters.
[0114] Specifically, the default input mode of the electronic device can be understood as the Chinese input mode, and the characters input at this time are all Chinese. The above-mentioned first sub-input mode can be understood as the English input mode, and the first type of characters are English, and the above-mentioned operating body can be understood as a hand, which can be the left hand, the right hand, or both hands. When the operation mode collected is a single operating body, that is, a one-handed operation, the input mode of the keyboard can be switched from the Chinese input mode to the English input mode. At this time, further judgment can be made based on whether the operation is left-handed or right-handed. In the case of left-handed single-handed operation, the input mode of the keyboard can be switched from the Chinese input mode to the English input mode; in the case of right-handed single-handed operation, the input mode of the keyboard can be switched from the Chinese input mode to the French input mode. The above is only an exemplary description of the specific operation mode and the corresponding input mode status. This application does not specifically limit the operation mode and the corresponding specific input mode status, which can be customized by the user's habits.
[0115] Specifically, the above-mentioned second sub-mode can be understood as the default Chinese input mode, and the second type of characters can be understood as Chinese. When it is determined that the operation mode is two-handed operation, the current input mode of the electronic device is switched to the Chinese input mode. At this time, the current input mode of the electronic device can be judged before switching. When it is confirmed that the current input mode is the Chinese input mode, the current input mode can be kept unchanged.
[0116] Specifically, the third sub-mode can be understood as a symbol input mode. The third type of characters are symbols. The user raises the palms of both hands away from the touchpad, so that the touchpad cannot collect hand operation information. That is, it is determined that there is no operating body mode at this time, and the keyboard input mode can be switched to symbol input mode.
[0117] The above description of the first sub-mode, the second sub-mode and the third sub-mode is only an exemplary expression and does not specifically limit the first sub-mode, the second sub-mode and the third sub-mode. The first sub-mode can also be a Chinese input mode or a symbol input mode, etc. The state of the input mode corresponding to the operation mode in this application can be adjusted by the user.
[0118] In some embodiments, the method further comprises:
[0119] When it is determined that the operation mode is a single-operator mode or a no-operator mode, gesture information at least related to a finger is collected via a touch panel of the electronic device.
[0120] Specifically, in the case of one-handed operation or hand-free operation, at least one hand of the user is not pressing the keyboard. At this time, the fingers that are not pressing the keyboard can perform operations on the touchpad, such as sliding operations, selection operations, etc. By collecting the gesture information of the fingers through the touchpad, the electronic device can be controlled in many aspects by combining the gesture information and the input information of the keyboard, which can further improve the user experience.
[0121] In some embodiments, the operating body is a palm, and obtaining hand operation information at least related to the posture of the operating body specifically includes:
[0122] collecting left palm information and right palm information through the touch panel of the electronic device;
[0123] The hand operation information is determined based on the left palm information and the right palm information.
[0124] Specifically, the keyboard of the electronic device is far away from the user relative to the touchpad. When the user is operating, the fingers of the hand can be used to control the keyboard. At this time, the palm corresponds to the touchpad. The touchpad collects left palm information and right palm information to realize keyboard input while also controlling the input mode of the keyboard, thereby improving the convenience and safety of input.
[0125] In a second aspect, an embodiment of the present invention further provides an electronic device 110, such as Figure 9 As shown, the electronic device 110 includes:
[0126] Touch panel 101: configured to obtain hand operation information at least related to the posture of the operating body;
[0127] a processor 102 configured to determine an operation mode of the operating body based on the hand operation information;
[0128] According to the association relationship between the operation mode and the preset operation function of the electronic device 110, the electronic device 110 is controlled to a state corresponding to the operation mode.
[0129] The present disclosure obtains hand operation information and determines the operation mode according to the hand operation information, so as to control the electronic device 110 to a state corresponding to the operation mode, thereby making full use of the hand operation information to control the electronic device 110, and associating various states of the electronic device 110 with different operation modes, thereby providing users with a better interactive environment and adding a new interactive experience.
[0130] In some embodiments, the processor 102 is further configured to:
[0131] responding to a mode of operation associated with the press;
[0132] The electronic device 110 is controlled to at least one or more of the following states corresponding to the operation mode:
[0133] The playing state, opening and closing state, and display state of the electronic device 110.
[0134] In some embodiments, the processor 102 is further configured to:
[0135] responding to sliding information in the hand operation information;
[0136] Determining that the operation mode is a sliding operation;
[0137] The electronic device 110 is manipulated to an erasing state corresponding to the sliding operation, and the content on the path of the sliding operation is erased.
[0138] In some embodiments, the processor 102 is further configured to:
[0139] An operation interface in response to obtaining verification information for verifying the identity of a user;
[0140] The electronic device 110 is controlled to a state of adjusting the keyboard input mode corresponding to the operation mode.
[0141] In some embodiments, the processor 102 is further configured to:
[0142] responding to pressing information in the hand operation information;
[0143] The layout state of the keyboard of the electronic device 110 is adjusted based on the association between the pressing information and the preset operation function to change the key positions of the keyboard, wherein the layout state is used to represent the positions of the various keys of the keyboard.
[0144] In some embodiments, the processor 102 is further configured to:
[0145] determining an operation area corresponding to the touch panel 101 of the electronic device 110 according to the hand operation information;
[0146] The acquisition area and / or display area of the touch panel 101 is dynamically adjusted based on the operation area.
[0147] In some embodiments, the state includes at least a first sub-input mode, a second sub-input mode, and a third sub-input mode corresponding to and different from the keyboard of the electronic device 110. The processor 102 is further configured to: when determining that the operation mode is a single operator mode, switch the keyboard to the first sub-mode for inputting the first category of characters;
[0148] When the operation mode is determined to be the dual-operator mode, switching the keyboard to the second sub-mode for inputting a second type of characters;
[0149] When it is determined that the operation mode is the no-operation-body mode, the keyboard is switched to the third sub-mode for inputting third-category characters.
[0150] In some embodiments, the processor 102 is further configured to:
[0151] When it is determined that the operation mode is the single-operator mode or the no-operator mode, gesture information at least related to a finger is collected via the touch panel 101 of the electronic device 110 .
[0152] In some embodiments, the operating body is a palm, and the processor 102 is further configured to:
[0153] Collecting left palm information and right palm information through the touch panel of the electronic device 110;
[0154] The hand operation information is determined based on the left palm information and the right palm information.
[0155] In a third aspect, an embodiment of the present invention further provides a storage medium storing a computer program, which implements the steps of the above-mentioned method for operating the electronic device 110 when executed by a processor.
[0156] Note that the various units in the various embodiments of the present application can be implemented as computer-executable instructions stored on a memory, which can implement the corresponding steps when executed by a processor; they can also be implemented as hardware with corresponding logical computing capabilities; or they can be implemented as a combination of software and hardware (firmware). In some embodiments, the processor can be implemented as any one of an FPGA, an ASIC, a DSP chip, a SOC (system on a chip), an MPU (for example, but not limited to Cortex), etc. The processor can be communicatively coupled to the memory and configured to execute the computer-executable instructions stored therein. The memory can include read-only memory (ROM), flash memory, random access memory (RAM), dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM) or Rambus DRAM, static memory (for example, flash memory, static random access memory), etc., on which computer-executable instructions are stored in any format. The computer-executable instructions can be accessed by the processor, read from the ROM or any other suitable storage location, and loaded into the RAM for execution by the processor to implement the wireless communication method according to the various embodiments of the present application.
[0157] It should be noted that, among the various components of the system of the present application, the components are logically divided according to the functions to be implemented, but the present application is not limited to this, and the various components can be re-divided or combined as needed. For example, some components can be combined into a single component, or some components can be further decomposed into more sub-components.
[0158] The various component embodiments of the present application can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that in practice, a microprocessor or digital signal processor (DSP) can be used to implement some or all of the functions of some or all of the components in the system according to the embodiments of the present application. The present application can also be implemented as an apparatus or device program (e.g., a computer program and a computer program product) for performing part or all of the methods described herein. Such a program implementing the present application can be stored on a computer-readable medium or can be in the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form. In addition, the present application can be implemented with the aid of hardware comprising several different elements and with the aid of a suitably programmed computer. In a unit claim that lists several means, several of these means can be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.
[0159] In addition, although exemplary embodiments have been described herein, the scope includes any and all embodiments based on the present application with equivalent elements, modifications, omissions, combinations (e.g., solutions that intersect various embodiments), adaptations, or changes. The elements in the claims are to be interpreted broadly based on the language employed in the claims and are not limited to the examples described in this specification or during the prosecution of this application, which examples are to be interpreted as non-exclusive. Therefore, this specification and examples are intended to be considered as examples only, with the true scope and spirit being indicated by the following claims and the full scope of their equivalents.
[0160] The above description is intended to be illustrative rather than restrictive. For example, the above examples (or one or more of their solutions) can be used in combination with each other. For example, a person of ordinary skill in the art may use other embodiments when reading the above description. In addition, in the above-mentioned specific embodiments, various features can be grouped together to simplify the application. This should not be interpreted as an intention that a disclosed feature that is not required to be protected is necessary for any claim. On the contrary, the subject matter of the present application may be less than all the features of a specific disclosed embodiment. Thus, the following claims are incorporated into the specific embodiments as examples or embodiments, wherein each claim is independently a separate embodiment, and it is considered that these embodiments can be combined with each other in various combinations or arrangements. The scope of this application should be determined with reference to the appended claims and the full scope of equivalents to which these claims are entitled.
[0161] The above embodiments are merely exemplary embodiments of the present application and are not intended to limit the scope of the present application. The scope of protection of the present application is defined by the claims. Those skilled in the art may make various modifications or equivalent substitutions to the present application within the essence and scope of protection of the present application, and such modifications or equivalent substitutions shall also be deemed to fall within the scope of protection of the present application.
Claims
1. A method for operating an electronic device, applied to an electronic device, comprising: Acquiring hand operation information at least related to the posture of the operating body; determining an operation mode of the operating body based on the hand operation information; According to the association between the operation mode and the preset operation function of the electronic device, the electronic device is controlled to a state corresponding to the operation mode; wherein, The states include at least a first sub-input mode, a second sub-input mode, and a third sub-input mode corresponding to and different from a keyboard of the electronic device; The method further comprises: When determining that the operation mode is the single operator mode, switching the keyboard to the first sub-input mode for inputting first-category characters; When the operation mode is determined to be the dual-operator mode, switching the keyboard to the second sub-input mode for inputting a second type of characters; When the operation mode is determined to be the no-operation-body mode, the keyboard is switched to the third sub-input mode for inputting the third type of characters; wherein, The single-operator mode is a single-handed operation mode, the dual-operator mode is a two-handed operation mode, and the no-operator mode is a mode in which both hands are away from the touch panel of the electronic device.
2. The electronic device operating method according to claim 1, further comprising: responding to a mode of operation associated with the press; Control the electronic device to at least one or more of the following states corresponding to the operation mode: The playing state, opening and closing state and display state of the electronic device.
3. The electronic device operating method according to claim 1, further comprising: responding to sliding information in the hand operation information; Determining that the operation mode is a sliding operation; The electronic device is manipulated to an erasing state corresponding to the sliding operation, and content on a path of the sliding operation is erased.
4. The electronic device operating method according to claim 1, further comprising: An operation interface in response to obtaining verification information for verifying the identity of a user; The electronic device is controlled to a state of adjusting the input mode of the keyboard corresponding to the operation mode.
5. The electronic device operating method according to claim 1, further comprising: responding to pressing information in the hand operation information; The layout state of the keyboard of the electronic device is adjusted based on the association between the pressing information and the preset operation function to change the key positions of the keyboard, wherein the layout state is used to represent the positions of the various keys of the keyboard.
6. The electronic device operating method according to claim 1, further comprising: determining an operation area corresponding to a touch panel of the electronic device according to the hand operation information; The acquisition area and / or display area of the touch panel is dynamically adjusted based on the operation area.
7. The electronic device operating method according to claim 1, further comprising: When it is determined that the operation mode is a single-operator mode or a no-operator mode, gesture information at least related to a finger is collected via a touch panel of the electronic device.
8. The electronic device operating method according to any one of claims 1 to 7, wherein the operating body is a palm, and obtaining hand operation information at least related to the posture of the operating body specifically comprises: collecting left palm information and right palm information through the touch panel of the electronic device; The hand operation information is determined based on the left palm information and the right palm information.
9. An electronic device comprising: Touch panel: configured to obtain hand operation information at least related to the posture of the operating body; a processor configured to determine an operation mode of the operating body based on the hand operation information; According to the association between the operation mode and the preset operation function of the electronic device, the electronic device is controlled to a state corresponding to the operation mode; wherein, The states include at least a first sub-input mode, a second sub-input mode, and a third sub-input mode corresponding to and different from a keyboard of the electronic device; The processor is further configured to: when determining that the operation mode is a single-operator mode, switch the keyboard to the first sub-input mode for inputting a first type of character; when determining that the operation mode is a dual-operator mode, switch the keyboard to the second sub-input mode for inputting a second type of character; when determining that the operation mode is a no-operator mode, switch the keyboard to the third sub-input mode for inputting a third type of character; wherein, The single-operator mode is a single-handed operation mode, the dual-operator mode is a two-handed operation mode, and the no-operator mode is a mode in which both hands are away from the touch panel of the electronic device.
Citation Information
Patent Citations
Method and system for inputting multi-contact characters
CN101655771A
Virtual keyboard adjusting method and device
CN103488420A
Gesture-initiated keyboard functions
CN104641324A
Keyboard input mode switching apparatus, systems, and methods
US20180032247A1