A method for processing an application interface and related equipment

Abstract

The present invention relates to the field of human-computer interaction. In an embodiment, a method for processing an application interface is provided. The method is applied to an electronic device, and the electronic device includes a first display screen and a second display screen. The method includes: displaying a first application interface through the first display screen; in response to a detected first operation, converting the mode type corresponding to the first application interface to handwriting input; in response to the input mode of the handwriting input, triggering the display of the first application interface on the second display screen to obtain handwritten content for the first application interface through the second display screen. If the user places the second display screen in a direction that is convenient for writing, the user does not need to perform any operation, and the electronic device can automatically display the application interface that requires handwriting input on the second display screen that is convenient for writing, which not only improves the efficiency of the entire input process, but also avoids redundant steps. The operation is simple and is conducive to improving user stickiness.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method for processing an application interface and related equipment. Background Art

[0002] Many computers and tablets are now equipped with electronic pens to meet users' needs for direct content creation, such as annotation, note-taking, and drawing. Currently, users can input with an electronic pen on one display and then copy the input to another display, thus realizing the function of inputting with an electronic pen.

[0003] However, the user needs to perform the copy and paste steps after inputting to complete the input of the content, and the operation steps are cumbersome. Summary of the Invention

[0004] An embodiment of the present application provides a method for processing an application interface and related equipment. If the user places the second display screen in a direction that is convenient for writing, the user does not need to perform any operation. The electronic device can automatically display the application interface that requires writing input on the second display screen that is convenient for writing. This not only improves the efficiency of the entire input process, but also avoids redundant steps. The operation is simple, which is conducive to improving user stickiness.

[0005] To solve the above technical problems, the embodiments of the present application provide the following technical solutions:

[0006] In the first aspect, an embodiment of the present application provides a feedback method that can be used in the field of virtual keyboards. The method is applied to an electronic device, the electronic device is configured with a touch screen, and the touch screen is configured with multiple vibration feedback elements. The method includes: the electronic device detects a first contact operation acting on the touch screen, and in response to the first contact operation, obtains first position information of a first contact point corresponding to the first contact operation, and the first position information corresponds to a first virtual key on the virtual keyboard. In the case where the first virtual key is an anchor point key, the electronic device obtains one or more first vibration feedback elements from multiple vibration feedback elements; wherein the first vibration feedback element is a vibration feedback element that matches the first virtual key, and the vibration feedback elements that match different virtual keys are not exactly the same; the virtual keyboard can be any type of keyboard. As an example, the virtual keyboard can be a full keyboard, a numeric keyboard, a function keyboard, etc., or the virtual keyboard can also be a general term for all operation keys on the touch screen. The meaning of an anchor point key is not the same as a positioning key. That is, an anchor point key refers to a key used to provide a prompt effect to the user. After determining the currently displayed virtual keyboard, which virtual keys are anchor point keys can be pre-configured in the electronic device, that is, which virtual keys are anchor point keys can be pre-fixed; or they can be customized by the user, that is, the user can define which virtual keys are anchor point keys through the "Settings" interface of the electronic device. Further, with respect to the process of determining whether a first virtual key is an anchor point key based on first position information, in one implementation, the electronic device obtains the first virtual key corresponding to the first contact point based on the first position information, and then determines whether the first virtual key is an anchor point key. In another implementation, the electronic device can pre-store which position areas on the touch screen are anchor point key position areas and which position areas on the touch screen are non-anchor point key position areas. The electronic device directly determines whether the position of the first contact point is within the anchor point key position area based on the first position information to determine whether the first virtual key corresponding to the first position information is an anchor point key. The electronic device instructs all first vibration feedback elements matched with the first virtual key to emit vibration waves to perform a first feedback operation, where the first feedback operation is used to prompt that the first virtual key is an anchor point key.

[0007] In this implementation, when the user touches an anchor point key on a virtual key, a first feedback operation is performed via the touch screen to prompt the user that the anchor point key is currently being touched. This allows the user to perceive the location of the anchor point key, thereby reducing the difficulty of blind typing on the touch screen. Furthermore, the touch screen is configured with multiple vibration feedback elements. When the first virtual key is determined to be the anchor point key, at least one first vibration feedback element that matches the first virtual key is obtained from the multiple vibration feedback elements and instructed to emit a vibration wave. This can achieve the effect of generating vibration feedback only around the first virtual key, i.e., not vibrating the entire screen. Since all fingers are placed on the touch screen when typing, if vibration were applied to the entire screen, all fingers would feel the vibration, which could easily confuse the user. However, generating vibration feedback only around the first virtual key reduces user confusion and more easily helps the user form muscle memory in their fingers, thereby assisting the user in blind typing on the touch screen.

[0008] In one possible implementation of the first aspect, after the electronic device obtains first position information of the first contact point corresponding to the first contact operation, the method further includes: the electronic device obtaining, based on the first position information, a first virtual key corresponding to the first contact point. In this implementation, the first virtual key corresponding to the first contact point can be obtained in real time based on the first position information, making this solution compatible not only with fixed-position virtual keyboards but also with movable virtual keyboards, thereby expanding the application scenarios of this solution.

[0009] In a possible implementation of the first aspect, a first mapping relationship is configured in the electronic device, and the first mapping relationship indicates the correspondence between the virtual key and the vibration feedback element. The electronic device obtains the first vibration feedback element from the multiple vibration feedback elements, including: the electronic device obtains the first vibration feedback element that matches the first virtual key according to the first mapping relationship and the first virtual key. Optionally, if the electronic device is pre-configured with multiple mapping relationships corresponding to multiple virtual keyboards, each mapping relationship includes the correspondence between multiple virtual keys and multiple first vibration feedback elements. Before the electronic device obtains the first vibration feedback element that matches the first virtual key according to the first mapping relationship and the first virtual key, it is necessary to first obtain the first mapping relationship that matches the type of the currently displayed virtual keyboard from the multiple mapping relationships.

[0010] In this implementation, a first mapping relationship is pre-configured, so that after obtaining the first virtual key, the first mapping relationship can be used to obtain at least one first vibration feedback element matching the first virtual key, which is convenient and quick, and is conducive to improving the efficiency of the matching process of the vibration feedback element; the step of determining the vibration feedback element is split, so that when a fault occurs, it is conducive to accurately locating the fault position.

[0011] In a possible implementation of the first aspect, a first mapping relationship is configured in the electronic device, and the first mapping relationship indicates a correspondence between position information and a vibration feedback element. The electronic device obtains a first vibration feedback element from a plurality of vibration feedback elements, including: the electronic device obtains a first vibration feedback element that matches the first position information based on the first mapping relationship and the first position information, and since the first position information corresponds to the first virtual key on the virtual keyboard, the first vibration feedback element corresponding to the first virtual key is obtained. In this implementation, at least one first vibration feedback element that matches the first virtual key can be obtained based on the first position information and the first mapping relationship, which is convenient and fast, and is conducive to improving the efficiency of the vibration feedback element matching process; and the first mapping relationship can indicate the correspondence between the first position information and an indication of a first vibration feedback element, which is compatible not only with virtual keyboards with fixed positions, but also with virtual keyboards with movable positions, ensuring that vibration feedback can be provided in various scenarios.

[0012] In a possible implementation of the first aspect, before the electronic device emits a vibration wave via a first vibration feedback element, the method further includes: the electronic device obtaining a vibration intensity of the vibration wave corresponding to each of the at least one first vibration feedback element, the vibration intensity of the vibration wave of each of the at least one first vibration feedback element being related to any one or more of the following factors: a first quantity, a distance between each first vibration feedback unit and a center point of the first virtual key, a type of the vibration wave, whether the virtual key is an anchor point key or a location type of the first location information, and the first quantity being the number of first vibration feedback elements. The electronic device emitting a vibration wave via the first vibration feedback element includes: the electronic device emitting a vibration wave via the at least one first vibration feedback element based on the vibration intensity of the vibration wave corresponding to each of the first vibration feedback elements, such that a difference between an intensity of the vibration feedback corresponding to the first virtual key and an intensity of the vibration feedback corresponding to the second virtual key is within a preset intensity range, and the second virtual key and the first virtual key are different virtual keys; the preset intensity range can be an intensity difference within 2%, an intensity difference within 3%, an intensity difference within 4%, or an intensity difference within 5%. Furthermore, in the process of measuring the intensity of the touch screen surface, the probe of the vibration measuring instrument can be attached to the surface of a virtual key (i.e., a detection point) on the touch screen to collect vibration waves from the aforementioned detection point, and then obtain a waveform curve of the collected vibration waves. The aforementioned waveform curve is used to indicate the intensity of the vibration feedback corresponding to the detection point. Furthermore, the difference between the intensity of the vibration feedback corresponding to the first virtual key and the intensity of the vibration feedback corresponding to the second virtual key can be obtained by comparing the difference between the waveform curve measured at the detection point of the first virtual key and the waveform curve of the two areas at the detection point of the second virtual key.

[0013] In this implementation, since the number of vibration feedback elements corresponding to different virtual keys may be different, the strength of each vibration feedback element is determined according to the number of matching vibration feedback elements, so that the difference in vibration feedback strength of each virtual key is within a preset range. Since the force feedback given by different keys is basically the same when the user uses the physical keys, the difference between the virtual keyboard and the physical keyboard can be reduced, thereby increasing user stickiness.

[0014] In one possible implementation of the first aspect, the first vibration feedback element is any one of the following: a piezoelectric ceramic, a linear motor, or a piezoelectric film. In this implementation, multiple specific forms of the vibration feedback element are provided, thereby increasing the implementation flexibility of this solution.

[0015] In one possible implementation of the first aspect, the first contact point is a newly added contact point on the touch screen. In the embodiment of the present application, since users often focus on the actual keys they touch when using a physical keyboard, this solution only generates feedback for the newly added contact points, which can better simulate the user's input experience when using a physical keyboard. Generating feedback only for the newly added contact points also makes it easier to establish a memory relationship between the user and the newly added contact points, further reducing the difficulty of training blind typing on a touch screen.

[0016] In a possible implementation of the first aspect, the method further includes: when the first virtual key is a non-anchor point key, the electronic device performs a second feedback operation, the second feedback operation is used to prompt that the first virtual key is a non-anchor point key, and the first feedback operation and the second feedback operation are different feedback operations. In this implementation, the feedback operation is performed not only when the first virtual key is an anchor point key, but also when the first virtual key is a non-anchor point key. The first feedback operation and the second feedback operation are different feedback operations. Since each key will give the user feedback when the user uses a physical keyboard, the similarity between the virtual keyboard and the physical keyboard can be increased through the aforementioned method, and different feedback operations are given to anchor point keys and non-anchor point keys, which can also help users remember different types of keys to assist users in blind typing on the virtual keyboard.

[0017] In one possible implementation of the first aspect, the first feedback operation is to emit a first type of vibration wave through the touch screen, and the second feedback operation is to emit a second type of vibration wave through the touch screen, where the first type of vibration wave and the second type of vibration wave are different types of vibration waves. If the vibration wave emitted by the electronic device through the vibration feedback element is continuous, the difference between the different types of vibration waves includes any one or more of the following characteristics: vibration amplitude, vibration frequency, vibration duration, or vibration waveform. If the vibration wave emitted by the electronic device through the vibration feedback element is pulsed, the difference between the different types of vibration waves includes any one or more of the following characteristics: vibration amplitude, vibration frequency, vibration duration, vibration waveform, or the frequency of the pulsed vibration wave emitted by the electronic device.

[0018] In a possible implementation of the first aspect, before the electronic device performs the first feedback operation, the method also includes: the electronic device obtains a position type corresponding to the first contact point based on the first position information, the position type including the first contact point being located in a first position area of the first virtual key (also referred to as the characteristic area of the anchor point key) and the first contact point being located in a second position area of the first virtual key (also referred to as the edge area of the anchor point key), and the first position area and the second position area are different; the electronic device performs the first feedback operation, including: the electronic device performs the first feedback operation through the touch screen based on the position type corresponding to the first contact point, and the feedback operation corresponding to the first position area is different from the feedback operation corresponding to the second position area.

[0019] In this implementation, all position areas of anchor point keys and / or non-anchor point keys are divided into a first position area and a second position area. In the case where the first contact point is located in the first position area and in the case where the first contact point is located in the second position area, the types of vibration waves emitted by the electronic device through at least one first vibration feedback element are different, which is conducive to helping users remember the boundaries of virtual keys, that is, it is conducive to assisting users to establish muscle memory for different areas of virtual keys, so as to further reduce the difficulty of blind typing on the touch screen.

[0020] In a possible implementation of the first aspect, the feedback operation corresponding to the first position area of the anchor point key is the same as the feedback operation corresponding to the first position area of the non-anchor point key, and the feedback operation corresponding to the second position area of the anchor point key is different from the feedback operation corresponding to the second position area of the non-anchor point key; or, the feedback operation corresponding to the first position area of the anchor point key is different from the feedback operation corresponding to the first position area of the non-anchor point key, and the feedback operation corresponding to the second position area of the anchor point key is the same as the feedback operation corresponding to the second position area of the non-anchor point key; or, the feedback operation corresponding to the first position area of the anchor point key is different from the feedback operation corresponding to the first position area of the non-anchor point key, and the feedback operation corresponding to the second position area of the anchor point key is different from the feedback operation corresponding to the second position area of the non-anchor point key.

[0021] In a possible implementation of the first aspect, the first contact operation is a pressing operation, and the method also includes: the electronic device detects a second contact operation acting on the touch screen, and obtains second position information of a second contact point corresponding to the second contact operation, where the second contact operation is a touch operation; the electronic device changes the tactile characteristics of the second contact point on the touch screen in response to the second contact operation, and the tactile characteristics include any one or more of the following characteristics: sliding friction coefficient, stickiness, and temperature.

[0022] In a possible implementation of the first aspect, before the electronic device detects the first contact operation on the touch screen, the method further includes: the electronic device detects the first gesture operation on the touch screen; in response to the first gesture operation, the electronic device selects a first type of virtual keyboard corresponding to the first gesture operation from multiple types of virtual keyboards, wherein different types of virtual keyboards in the multiple types of virtual keyboards include different virtual keys; the electronic device displays the first type of virtual keyboard through the touch screen, and during the display of the first type of virtual keyboard, the position of the first type of virtual keyboard on the touch screen is fixed; the electronic device detects the first contact operation on the touch screen, including: during the display of the first type of virtual keyboard, the electronic device detects the first contact operation on the touch screen. The meaning of each noun in this implementation, the specific implementation steps and the beneficial effects brought about will be described in the subsequent seventh aspect and will not be introduced here for the time being.

[0023] In a second aspect, an embodiment of the present application provides an electronic device that can be used in the field of virtual keyboards. The electronic device is configured with a touch screen, and the touch screen includes a contact sensing module and a vibration feedback module, and the vibration feedback module includes multiple vibration feedback elements. The contact sensing module is used to obtain the first position information of the first contact point on the touch screen. The contact sensing module can be specifically expressed as a contact sensing film, and the contact sensing film can be specifically a capacitive contact sensing film, a pressure contact sensing film, a temperature contact sensing film, or other types of films. The first vibration feedback element is used to emit a vibration wave when the first virtual key corresponding to the first contact point is an anchor point key. The vibration wave is used to prompt that the first virtual key is an anchor point key. The first vibration feedback element is any one of the following: a piezoelectric ceramic, a linear motor, or a piezoelectric film; wherein the first virtual key is a virtual key in the virtual keyboard, and the first vibration feedback element is a vibration feedback element that matches the first virtual key among the multiple vibration feedback elements.

[0024] In one possible implementation of the second aspect, the first contact point is obtained based on a pressing operation on the touch screen, and the touch screen further includes a cover plate and an ultrasonic module, the ultrasonic module being configured to emit ultrasonic waves to change the tactile properties of the cover plate. Specifically, the contact sensing module is further configured to obtain second position information of a second contact point on the touch screen. The ultrasonic module is specifically configured to emit ultrasonic waves to change the tactile properties of the cover plate when the second contact point is obtained based on a touch operation on the touch screen. Alternatively, the touch screen further includes a cover plate and an electrostatic module, the electrostatic module being configured to generate an electrical signal to change the tactile properties of the cover plate. Specifically, the contact sensing module is further configured to obtain second position information of a second contact point on the touch screen. The electrostatic module is specifically configured to generate an electrical signal to change the tactile properties of the cover plate when the second contact point is obtained based on a touch operation on the touch screen. The tactile properties include any one or more of the following: sliding friction coefficient, stick-slip properties, and temperature.

[0025] In this implementation, the touch screen can also change the tactile characteristics of the cover by setting an ultrasonic module or an electrostatic module, so as to provide richer tactile feedback, and then use the richer tactile feedback to train users to achieve blind typing on the touch screen, so as to further reduce the difficulty of blind typing on the touch screen.

[0026] In a possible implementation of the second aspect, the touch screen further includes a pressure sensing module, the pressure sensing module and the vibration feedback module are integrated into one, and the vibration feedback element is a piezoelectric ceramic, a piezoelectric polymer or a piezoelectric composite material. The pressure sensing module is used to collect the pressure value corresponding to the first contact operation to determine whether the first contact operation is a pressing operation or a touch operation. Specifically, in one case, the multiple vibration feedback elements included in the vibration feedback module (also referred to as the pressure sensing module) can be divided, and the second vibration feedback element among the multiple vibration feedback elements is used to collect the pressure value, and the third vibration feedback element among the multiple vibration feedback elements is used to emit a vibration wave for vibration feedback. Wherein, the second vibration feedback element and the third vibration feedback element are different vibration feedback elements. In another case, the multiple vibration feedback elements in the vibration feedback module (also referred to as the pressure sensing module) are used to collect the pressure value in a first time period and to emit a vibration wave in a second time period, and the first time period and the second time period are different.

[0027] In this implementation, the touch screen is also configured with a pressure sensing module for collecting pressure values, so that not only the position information of the contact point can be obtained, but also the pressure value of the contact point can be obtained, so as to further manage the contact operation obtained through the touch screen in detail; and the pressure sensing module and the vibration feedback module are integrated into one, which is conducive to reducing the thickness of the touch screen and thus improving the convenience of the electronic device.

[0028] For the concepts of nouns in the second aspect of the embodiment of the present application and some possible implementation methods of the second aspect and the beneficial effects brought about by the specific implementation steps, you can refer to the description of the various possible implementation methods in the first aspect, and will not be repeated here one by one.

[0029] In a third aspect, an embodiment of the present application provides an electronic device that can be used in the field of virtual keyboards. The electronic device includes a touch screen, a memory, one or more processors, and one or more programs, wherein the touch screen is configured with multiple vibration feedback elements, the one or more programs are stored in the memory, and when the one or more processors execute the one or more programs, the electronic device performs the following steps: detecting a first contact operation on the touch screen; in response to the first contact operation, obtaining first position information of a first contact point corresponding to the first contact operation, the first position information corresponding to a first virtual key on the virtual keyboard; when the first virtual key is an anchor point key, obtaining a first vibration feedback element from multiple vibration feedback elements, the first vibration feedback element being a vibration feedback element that matches the first virtual key; and instructing the first vibration feedback element to emit a vibration wave to perform a first feedback operation, the first feedback operation being used to indicate that the first virtual key is an anchor point key.

[0030] In the third aspect of the embodiment of the present application, the electronic device can also be used to implement the steps performed by the electronic device in the various possible implementation methods of the first aspect. For the specific implementation methods of the third aspect of the embodiment of the present application and certain steps in the various possible implementation methods of the third aspect, as well as the beneficial effects brought about by each possible implementation method, you can refer to the description of the various possible implementation methods in the first aspect, and will not go into details here.

[0031] In a fourth aspect, an embodiment of the present application provides a computer program, which, when executed on a computer, enables the computer to execute the feedback method described in the first aspect above.

[0032] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising a processor, which is coupled to the memory; the memory is used to store programs; and the processor is used to execute the programs in the memory, so that the execution device executes the feedback method described in the first aspect above.

[0033] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the feedback method described in the first aspect above.

[0034] In a seventh aspect, an embodiment of the present application provides a chip system, which includes a processor for supporting the implementation of the functions involved in the first aspect above, for example, sending or processing the data and / or information involved in the above method. In one possible design, the chip system also includes a memory, which is used to store program instructions and data necessary for the server or communication device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0035] In an eighth aspect, embodiments of the present application provide a method for processing a virtual keyboard, which can be used in the field of human-computer interaction. The method is applied to an electronic device, wherein the electronic device is configured with a display screen. The method includes: the electronic device detecting a first gesture operation applied to the display screen, and in response to the detected first gesture operation, selecting a first type of virtual keyboard corresponding to the first gesture operation from multiple types of virtual keyboards, wherein different types of virtual keyboards in the multiple types of virtual keyboards include different virtual keys; and the electronic device displaying the first type of virtual keyboard through the display screen.

[0036] In this implementation, the electronic device is configured with multiple virtual keyboards of different types. The virtual keys included in different types of virtual keyboards are not exactly the same. The user can call up different types of virtual keyboards through different gesture operations. That is, the virtual keyboard is no longer limited to displaying only 26 letters, but more virtual keys are provided to the user through different types of virtual keyboards. This not only improves the user's flexibility in calling up the virtual keyboard, but also facilitates the provision of richer virtual keys, thereby eliminating the need to provide an additional physical keyboard.

[0037] In a possible implementation of the eighth aspect, the electronic device selects a first type of virtual keyboard corresponding to a first gesture operation from multiple types of virtual keyboards, including: the electronic device selects the first type of virtual keyboard corresponding to the first gesture operation from multiple types of virtual keyboards according to a first rule, the first rule indicating the correspondence between multiple types of gesture operations and multiple types of virtual keyboards. In this implementation, the electronic device is pre-configured with a first rule, the first rule indicating the correspondence between multiple types of gesture operations and the multiple types of virtual keyboards. After detecting the first gesture operation acting on the display screen, the first type of virtual keyboard corresponding to the specific first gesture operation can be obtained according to the first rule, thereby improving the efficiency of the virtual keyboard matching process.

[0038] In a possible implementation of the eighth aspect, in one case, the first rule directly includes a correspondence between multiple types of gesture operations and multiple types of virtual keyboards; the first rule includes a correspondence between multiple first identification information and multiple second identification information, the first identification information is used to uniquely point to the first identification information corresponding to one type of gesture operation, and the second identification information is used to uniquely point to one type of virtual keyboard. In another case, the first rule includes a correspondence between multiple groups of conditions and multiple types of virtual keyboards, each group of conditions in the multiple groups of conditions corresponds to one type of gesture operation, that is, each group of conditions in the multiple groups of conditions is a limiting condition for gesture parameters corresponding to a gesture operation, and each group of conditions corresponds to one type of gesture operation.

[0039] In a possible implementation of the eighth aspect, before the electronic device selects the first type of virtual keyboard corresponding to the first gesture operation from multiple types of virtual keyboards, the method also includes: the electronic device obtains a first gesture parameter corresponding to the first gesture operation, wherein the first gesture parameter includes any one or more of the following parameters: position information of the contact point corresponding to the first gesture operation, number information of the contact points corresponding to the first gesture operation, area information of the contact point corresponding to the first gesture operation, relative angle information of the hand corresponding to the first gesture operation, position information of the hand corresponding to the first gesture operation, number information of the hands corresponding to the first gesture operation, and shape information of the hand corresponding to the first gesture operation; the electronic device selects the first type of virtual keyboard corresponding to the first gesture operation from multiple types of virtual keyboards, including: the electronic device selects the first type of virtual keyboard from multiple types of virtual keyboards according to the first gesture parameter.

[0040] In this implementation, the first gesture parameters include not only the position information of each contact point and the number information of multiple contact points, but also the area information of each contact point. The area information of the contact point can distinguish the contact point triggered by the palm from multiple contact points, which is conducive to accurately estimating the type of the first gesture operation and avoiding displaying the wrong virtual keyboard, so as to improve the accuracy of the virtual keyboard display process; after secondary processing of the acquired first gesture parameters, information such as the relative angle information of the hand, the position information of the hand, the number information of the hand or the shape information of the hand can be obtained, that is, based on the first gesture parameters, more abundant information about the first gesture operation can be obtained, thereby increasing the flexibility of the virtual keyboard matching process.

[0041] In a possible implementation of the eighth aspect, the method further includes: the electronic device obtaining a first angle in response to a first gesture operation, the first angle indicating the relative angle between the hand corresponding to the first gesture operation and the edge of the display screen, or the first angle indicating the relative angle between the hand corresponding to the first gesture operation and the centerline of the display screen. The electronic device presenting a first type of virtual keyboard through the display screen includes: the electronic device obtaining a first display angle of the first type of virtual keyboard based on the first angle, and presenting the first type of virtual keyboard through the display screen at the first display angle; the first display angle indicating the relative angle between the edge of the first type of virtual keyboard and the edge of the display screen, or the first display angle indicating the relative angle between the edge of the first type of virtual keyboard and the centerline of the display screen.

[0042] In this implementation, the relative angle (i.e., the first angle) between the user's hand and the edge or center line of the display interface is obtained, and the display angle of the virtual keyboard is determined based on the first angle, so that the display angle of the keyboard is more in line with the placement angle of the user's hand, making the process of user input using the virtual keyboard more comfortable and convenient.

[0043] In a possible implementation of the eighth aspect, if the first type of virtual keyboard is a full keyboard, the full keyboard is split into a first sub-keyboard and a second sub-keyboard, the first angle includes the relative angle of the left hand and the relative angle of the right hand, the first sub-keyboard and the second sub-keyboard include different virtual keys in the full keyboard, and the first display angle includes the display angle of the first sub-keyboard and the display angle of the second sub-keyboard. If the first angle indicates the relative angle between the hand and the edge of the display screen in the first gesture corresponding to the first gesture operation, the display angle of the first sub-keyboard indicates the relative angle between the edge of the first sub-keyboard and the edge of the display screen, and the display angle of the second sub-keyboard indicates the relative angle between the edge of the second sub-keyboard and the edge of the display screen; if the first angle indicates the relative angle between the hand and the edge of the display screen in the first gesture corresponding to the first gesture operation, the display angle of the first sub-keyboard indicates the relative angle between the edge of the first sub-keyboard and the center line of the display screen, and the display angle of the second sub-keyboard indicates the relative angle between the edge of the second sub-keyboard and the center line of the display screen.

[0044] In a possible implementation of the eighth aspect, in one case, the electronic device determines whether the first angle is greater than or equal to a preset angle threshold. If it is greater than or equal to the preset angle threshold, the electronic device obtains a first display angle and displays a first type of virtual keyboard at the first display angle through the display screen, wherein the value of the preset angle threshold can be 25 degrees, 28 degrees, 30 degrees, 32 degrees, 35 degrees or other values, etc., which are not limited here. In another case, after obtaining the first angle, the electronic device determines the first display angle of the first type of virtual keyboard as the first angle, and displays the first type of virtual keyboard at the first angle through the display screen.

[0045] In one possible implementation of the eighth aspect, different types of virtual keyboards have different functions. The different-function virtual keyboards include a combination of any two or more of the following virtual keyboards: a numeric keypad, a function key keyboard, a full keyboard, and a custom keyboard, where the function key keyboard is composed of function keys. In this implementation, the different types of virtual keyboards have different functions, thereby providing users with a variety of virtual keyboards with different functions, increasing user flexibility in using the virtual keyboards and thereby improving user engagement with this solution.

[0046] In a possible implementation of the eighth aspect, when the first gesture operation is a one-handed operation, the first type of virtual keyboard is any one of the following virtual keyboards: a mini keyboard, a numeric keyboard, a functional keyboard, a function key keyboard, a circular keyboard, a curved keyboard, and a custom keyboard, wherein the mini keyboard includes 26 letter keys, the functional keyboard is displayed in an application, and the virtual keys included in the functional keyboard correspond to the functions of the application. It should be noted that the same electronic device does not need to be configured with a mini keyboard, a numeric keyboard, a functional keyboard, a function key keyboard, a circular keyboard, a curved keyboard, and a custom keyboard at the same time. The examples here are only used to prove that a one-handed operation in an electronic device can trigger any one of the virtual keyboards among the mini keyboard, the numeric keyboard, the functional keyboard, the function key keyboard, the circular keyboard, the curved keyboard, and the custom keyboard. In this implementation, a variety of specific expressions of the virtual keyboard displayed on the display screen are provided in the two cases where the first gesture operation is a one-handed operation and a two-handed operation, which improves the implementation flexibility of this solution and expands the application scenarios of this solution.

[0047] In a possible implementation of the eighth aspect, when the first gesture operation is a two-handed operation, the first type of virtual keyboard is a full keyboard, the full keyboard includes at least 26 letter keys, and the size of the full keyboard is larger than the mini keyboard. The electronic device displays the first type of virtual keyboard through a display screen, including: when the distance between the two hands is less than or equal to a first distance threshold, the electronic device displays the full keyboard in an integrated manner through the display screen; when the distance between the two hands is greater than the first distance threshold, the electronic device displays the first sub-keyboard through a second area of the display screen and displays the second sub-keyboard through a third area of the display screen, wherein the second area and the third area are different areas in the display screen, and the first sub-keyboard and the second sub-keyboard include different virtual keys in the full keyboard; the value of the first distance threshold can be 70 mm, 75 mm, 80 mm, etc., which is not limited here.

[0048] In this implementation, whether to display the virtual keyboard in an integrated manner or in a separated manner can be decided based on the distance between the user's two hands, which further improves the flexibility of the virtual keyboard display process, makes the displayed virtual keyboard more convenient for users to use, and further improves the user stickiness of this solution.

[0049] In a possible implementation of the eighth aspect, when the first gesture operation is a first one-handed operation, the first type of virtual keyboard is a mini keyboard. In this implementation, when the first gesture operation is a one-handed operation, the first type of virtual keyboard is a mini keyboard, which helps to improve the flexibility of the user in inputting letters.

[0050] In a possible implementation of the eighth aspect, the one-handed operation includes left-handed operation and right-handed operation; when the first gesture operation is a right-handed operation, the first type of virtual keyboard is a numeric keyboard; when the first gesture operation is a left-handed operation, the first type of virtual keyboard is a functional keyboard, and the virtual keys included in the functional keyboard correspond to the functions of the application. For example, if the first gesture operation is obtained in a gaming application, the functional keyboard may be a gaming keyboard configured with commonly used gaming keys. For another example, if the first gesture operation is obtained in a drawing application, the functional keyboard may be commonly used keys in the drawing software, etc.

[0051] In this implementation, when the first gesture operation is a right-handed single-handed operation, the first type of virtual keyboard is a numeric keyboard; when the first gesture operation is a left-handed single-handed operation, the first type of virtual keyboard is a functional keyboard, which is more in line with the user's usage habits of the physical keyboard, thereby reducing the difference between the virtual keyboard and the physical keyboard, which is conducive to enhancing user stickiness.

[0052] In a possible implementation of the eighth aspect, when the first gesture operation is a one-handed operation located in a first area of the display screen, the first type of virtual keyboard is a function key keyboard, and the first area is located in the lower left or lower right of the display screen. In this implementation, since the function keys are located in the lower left or lower right of a physical keyboard, and the first type of virtual keyboard is a function key keyboard when the first gesture operation is a one-handed operation located in the first area of the display screen, since the triggering gesture is the same as the user's habit of using a physical keyboard, it is easier for the user to remember the triggering gesture, reducing the implementation difficulty of this solution and helping to enhance user stickiness.

[0053] In a possible implementation of the eighth aspect, the method further includes: the electronic device obtains a touch operation on a first virtual key in a function key keyboard. As an example, the first virtual key may be a Ctrl key, or may include a Ctrl key and a Shift key, etc. The electronic device highlights a second virtual key on a display screen in response to the touch operation on the first virtual key in the function key keyboard. The second virtual key is a key other than the first virtual key in a combination of shortcut keys. The highlighted display includes but is not limited to a highlighted display, a bold display, or a flashing display, which is not limited here. As an example, in a drawing application, for example, the combination of the Ctrl key + the Shift key + the I key can provide a function of displaying the currently processed image in reverse. The first virtual key includes the Ctrl key and the Shift key, and the second virtual key is the virtual key I.

[0054] In an embodiment of the present application, during the process of displaying a function key keyboard on a display screen, a touch operation on a first virtual key in the function key keyboard is obtained, and in response to the touch operation, a second virtual key is highlighted on the display screen. The second virtual key is a key in the combination type of shortcut key other than the first virtual key. Since the function key keyboard occupies a small area, the area required to display the virtual keyboard is reduced. When the user performs a touch operation on the first virtual key in the function key keyboard, the second virtual key in the combination type of shortcut key can be automatically displayed, thereby ensuring the user's demand for shortcut keys and avoiding a waste of the display area of the display screen.

[0055] In one possible implementation of the eighth aspect, the first gesture operation is a contact operation acquired via a display screen, and the first gesture parameter includes information about the number of contact points corresponding to the first gesture operation; when the first gesture operation is a single-handed operation with fewer than three contact points, the first type of virtual keyboard is a circular keyboard or a curved keyboard. In this implementation, when the first gesture operation is a single-handed operation with fewer than three contact points, a circular keyboard or a curved keyboard can also be provided. This not only provides keyboards that exist in a physical keyboard, but also keyboards that do not exist in a physical keyboard, thereby enriching the types of keyboards, providing users with more choices, and further enhancing the user's flexibility in selection.

[0056] In one possible implementation of the eighth aspect, the first rule includes a first sub-rule, where the first sub-rule is derived based on a customization performed on at least one type of gesture operation and / or at least one type of virtual keyboard. In this implementation, the user can customize the triggering gesture and / or the type of virtual keyboard to better meet user expectations for the virtual keyboard display process, thereby further improving user engagement of this solution.

[0057] In a possible implementation of the eighth aspect, a display screen is configured with multiple vibration feedback elements. During the display of a first type of virtual keyboard, the position of the first type of virtual keyboard on the display screen is fixed. After the first type of virtual keyboard is displayed on the display screen, the method further includes: the electronic device detecting a first contact operation on the display screen, and in response to the first contact operation, obtaining first position information of a first contact point corresponding to the first contact operation, wherein the first position information corresponds to a first virtual key on the virtual keyboard. When the first virtual key is an anchor point key, the electronic device obtains a first vibration feedback element from the multiple vibration feedback elements, wherein the first vibration feedback element is a vibration feedback element that matches the first virtual key; and instructs the first vibration feedback element to emit a vibration wave to perform a first feedback operation, wherein the first feedback operation is used to indicate that the first virtual key is an anchor point key. For the meanings of the terms such as the first contact operation, the first contact point, the first position information, the first virtual key, and the first vibration feedback element in this implementation, as well as the specific implementation steps and beneficial effects thereof, please refer to the descriptions of the various possible implementations of the first aspect and will not be introduced here.

[0058] In the eighth aspect of the embodiment of the present application, the electronic device can also be used to implement the steps performed by the electronic device in the various possible implementation methods of the first aspect. For the specific implementation methods of the eighth aspect of the embodiment of the present application and the various possible implementation methods of the eighth aspect, as well as the beneficial effects brought about by each possible implementation method, you can refer to the description of the various possible implementation methods in the first aspect, and will not go into details here.

[0059] In a ninth aspect, an embodiment of the present application provides an electronic device that can be used in the field of human-computer interaction. The electronic device includes a display screen, a memory, one or more processors, and one or more programs, wherein the one or more programs are stored in the memory, and when the one or more processors execute the one or more programs, the electronic device performs the following steps: in response to a detected first gesture operation, selecting a first type of virtual keyboard corresponding to the first gesture operation from multiple types of virtual keyboards, wherein different types of virtual keyboards in the multiple types of virtual keyboards include different virtual keys; and displaying the first type of virtual keyboard through the display screen.

[0060] In the ninth aspect of the embodiment of the present application, the electronic device can also be used to implement the steps performed by the electronic device in the various possible implementation methods of the eighth aspect. For the specific implementation methods of the ninth aspect of the embodiment of the present application and the various possible implementation methods of the ninth aspect, as well as the beneficial effects brought about by each possible implementation method, you can refer to the description of the various possible implementation methods in the eighth aspect, and will not go into details here.

[0061] In a tenth aspect, an embodiment of the present application provides a computer program, which, when executed on a computer, enables the computer to execute the virtual keyboard processing method described in the eighth aspect above.

[0062] In the eleventh aspect, an embodiment of the present application provides an electronic device, comprising a processor, which is coupled to the memory; the memory is used to store programs; and the processor is used to execute the programs in the memory, so that the electronic device executes the virtual keyboard processing method described in the eighth aspect above.

[0063] In the twelfth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the virtual keyboard processing method described in the eighth aspect above.

[0064] In a thirteenth aspect, an embodiment of the present application provides a chip system, which includes a processor for supporting the implementation of the functions involved in the above aspects, for example, sending or processing the data and / or information involved in the above methods. In one possible design, the chip system also includes a memory, which is used to store program instructions and data necessary for the server or communication device. The chip system can be composed of a chip or can include a chip and other discrete devices.

[0065] In the fourteenth aspect, an embodiment of the present application provides a method for processing an application interface, which can be used in the field of human-computer interaction. The method is applied to an electronic device, and the electronic device includes a first display screen and a second display screen, and the method includes: the electronic device displays a first application interface through the first display screen; the electronic device changes the mode type corresponding to the first application interface to handwriting input in response to the detected first operation; in response to the input mode of the handwriting input, triggers the display of the first application interface on the second display screen to obtain the handwritten content for the first application interface through the second display screen. Specifically, an operating system is running on the electronic device, and the electronic device can display the first application interface on the second display screen by calling the move to function in the operating system, or the electronic device can also call the Set Window Position function in the operating system, or the electronic device can also call the Set Window Placement function in the operating system.

[0066] In this implementation, the electronic device displays the first application interface on the first display screen. When it detects that the mode type corresponding to the first application interface is handwriting input, it will trigger the display of the first application interface on the second display screen, and then directly input through the first application interface displayed on the second display screen; through the aforementioned method, if the user places the second display screen in a direction convenient for writing, the user does not need to perform any operation, and the electronic device can automatically display the application interface that requires writing input on the second display screen that is convenient for writing, which not only improves the efficiency of the entire input process, but also avoids redundant steps. The operation is simple and is conducive to improving user stickiness.

[0067] In a possible implementation of the fourteenth aspect, after the electronic device triggers display of the first application interface on the second display screen in response to the input mode of handwriting input, the method further includes: upon detecting that the mode type corresponding to the first application interface has changed to keyboard input, the electronic device triggers display of the first application interface on the first display screen in response to the input mode of keyboard input, and displays a virtual keyboard on the second display screen, so as to obtain input content for the first application interface through the virtual keyboard on the second display screen. Alternatively, upon detecting that the mode type corresponding to the first application interface has changed to keyboard input, the electronic device triggers display of the first application interface on the first display screen in response to the input mode of keyboard input, and displays a virtual keyboard and application control bar on the second display screen.

[0068] In this implementation, in the process of displaying the application interface, not only can the layout of the application interface on different display screens of the electronic device be automatically adjusted when the application interface is changed from other mode types to handwriting input, but also when the mode type of the application interface is changed to keyboard input, the layout of the application interface on different display screens can be automatically adjusted, and a virtual keyboard can be automatically displayed. Therefore, when the mode type of the application interface is changed to keyboard input, the user no longer needs to manually adjust the layout of the application interface on different display screens, but can directly perform keyboard input. The steps are simple, which further improves the user stickiness of this solution.

[0069] In one possible implementation of the fourteenth aspect, the method may further include: the electronic device detecting a second operation applied to the second display screen; and in response to the second operation, changing the first display area of the application control bar to the second display area, and changing the first control key group included in the application control bar to the second control key group, where both the first control key group and the second control key group are control key sets corresponding to the target application. The specific meanings of the terms in the aforementioned steps and the specific implementations of the aforementioned steps will be described in the subsequent twentieth aspect and are not described in detail here.

[0070] In a possible implementation of the fourteenth aspect, the first application interface includes a first control key, and the method may further include: the electronic device detecting a second operation on the first target application interface; and in response to the second operation, displaying the first control key in the application control bar and hiding the first control key in the first application interface. The specific meanings of the terms in the aforementioned steps and the specific implementation methods of the aforementioned steps will be described in the subsequent twenty-first aspect and are not described in detail here.

[0071] In a possible implementation of the fourteenth aspect, displaying a virtual keyboard on the second display screen includes: displaying a second type of virtual keyboard on the second display screen; the method also includes: the electronic device detects a first gesture operation acting on the second display screen, and in response to the first gesture operation, selects a first type of virtual keyboard corresponding to the first gesture operation from multiple types of virtual keyboards, wherein the virtual keys included in different types of virtual keyboards in the multiple types of virtual keyboards are not exactly the same; the first type of virtual keyboard is displayed through the second display screen, and the first type of virtual keyboard and the second type of virtual keyboard are different types of virtual keyboards in the multiple types of virtual keyboards. For the specific meaning of each noun in the aforementioned steps and the specific implementation of the aforementioned steps, please refer to the description of the eighth aspect above. In the fourteenth aspect of the embodiment of the present application, the electronic device can also execute the steps executed by the electronic device in various possible implementations of the eighth aspect. For the specific implementation of certain steps in the fourteenth aspect of the embodiment of the present application and the various possible implementations of the fourteenth aspect, as well as the beneficial effects brought about by each possible implementation, please refer to the description in the various possible implementations of the eighth aspect, and will not be repeated here.

[0072] In a possible implementation of the fourteenth aspect, after the electronic device triggers the display of the first application interface on the second display screen in response to the input mode of handwriting input, the method further includes: when the electronic device detects that the mode type corresponding to the first application interface has changed to browsing mode, in response to the browsing mode, triggering the display of the first application interface on the first display screen, and stopping the display of the first application interface on the second display screen. In this implementation, when the mode type of the application interface is changed to browsing mode, the layout of the application interface on different display screens can also be automatically adjusted, so that when the mode type of the application interface is changed to browsing mode, the user no longer needs to manually adjust the layout of the application interface on different display screens, that is, in a variety of different application scenarios, the operation steps can be simplified, further improving the user stickiness of this solution.

[0073] In a possible implementation of the fourteenth aspect, the electronic device detects that the first operation includes any one or more of the following five items: the electronic device determines that the first operation is detected when it detects that the holding posture of the electronic pen meets the first preset condition, and the holding posture includes any one or more of the following: holding position, holding strength, and holding angle. The first preset condition includes any one or more of the following: the holding position is within a first position range, the holding strength is within a first strength range, and the holding angle is within a first angle range; or, the electronic device obtains a trigger instruction for handwriting input through a first icon, and the first icon is displayed on a first application interface; or, the electronic device detects a preset click. In the case of a single-click operation or a preset trajectory operation, it is determined that the first operation is detected, the preset click operation can be a single-click operation, a double-click operation, a triple-click operation or a long press operation, and the preset trajectory operation can be a "Z"-shaped trajectory operation, a sliding operation, a "check mark"-shaped trajectory operation or a "circle"-shaped trajectory operation; or, in the case of detecting that the electronic pen is within a preset range of the second display screen, it is determined that the first operation is detected; or, in the case of detecting that the electronic pen changes from a first preset state to a second preset state, it is determined that the first operation is detected, wherein the change of the electronic pen from the first preset state to the second preset state can be the change of the electronic pen from a stationary state to a moving state, the change of the electronic pen from a non-held state to a held state, etc.

[0074] In this implementation, multiple methods for determining the mode type corresponding to the first application interface are provided, which improves the implementation flexibility of this solution and expands the application scenarios of this solution; further, the mode type corresponding to the first application interface is determined according to the holding posture of the electronic pen, and the user can change the mode type of the first application interface without performing other operations. In addition, the mode type corresponding to the first application interface is determined according to the user's holding posture of the electronic pen, which can reduce the error rate of the judgment process of the mode type corresponding to the first application interface, thereby reducing the probability of incorrect placement of the first application interface, avoiding waste of computer resources, and helping to improve user stickiness.

[0075] In a possible implementation of the fourteenth aspect, the first operation is to obtain a sliding operation in a first direction through the second display screen, and the sliding operation in the first direction is a sliding operation from the upper edge of the second display screen to the lower edge of the second display screen, and the distance between the upper edge of the second display screen and the first display screen is closer than the distance between the lower edge of the second display screen and the first display screen. Specifically, the electronic device obtains the sliding operation in the first direction through the second display screen, and in response to the sliding operation in the first direction, the virtual keyboard displayed on the second display screen moves along the first direction toward the lower edge of the second display screen, and when the upper edge of the virtual keyboard reaches the lower edge of the second display screen, it is confirmed that the mode type corresponding to the first application interface is changed to handwriting input. In this implementation, the virtual keyboard displayed on the second display screen can accompany the user's downward sliding operation, and when the upper edge of the virtual keyboard reaches the lower edge of the second display screen, the electronic device confirms that the mode type corresponding to the first application interface is changed to handwriting input, which increases the fun of the process of keyboard input to handwriting input and helps to improve user stickiness.

[0076] In a possible implementation of the fourteenth aspect, after the electronic device triggers the display of the first application interface on the second display screen, the method also includes: the electronic device obtains a startup operation for the second application interface, and based on the startup operation, determines the mode type corresponding to the second application interface, the second application interface and the first application interface are different application interfaces; when the mode type corresponding to the second application interface is handwriting input, the electronic device responds to the input mode of handwriting input and triggers the display of the second application interface on the second display screen; or, when the mode type corresponding to the second application interface is keyboard input, the electronic device responds to the input mode of keyboard input and triggers the display of the second application interface on the first display screen, and displays a virtual keyboard on the second display screen; or, when the mode type corresponding to the second application interface is browsing mode, the electronic device responds to the browsing mode and triggers the display of the second application interface on the first display screen.

[0077] In this implementation, not only can the mode type corresponding to the application interface be automatically detected during the user's use of the application interface, and the display position of the application interface be adjusted according to the mode type corresponding to the application interface, but also when the application interface is opened, the mode type corresponding to the application interface can be determined based on the startup operation, and the display position of the application interface can be determined, so that the user can use it directly after performing the startup operation on the application interface without having to move the application interface, which further improves the convenience of this solution and increases the user stickiness of this solution.

[0078] In a possible implementation of the fourteenth aspect, the electronic device determines the mode type corresponding to the second application interface based on the startup operation, including: when the startup operation is obtained through the first display screen, the electronic device determines that the mode type corresponding to the second application interface is keyboard input or browsing mode; when the startup operation is obtained through the second display screen, the electronic device determines that the mode type corresponding to the second application interface is handwriting input.

[0079] In a possible implementation of the fourteenth aspect, the electronic device determines the mode type corresponding to the second application interface based on the startup operation, including: when the startup operation is obtained through an electronic pen, the electronic device determines that the mode type corresponding to the second application interface is handwriting input; when the startup operation is obtained through a mouse or finger, the electronic device determines that the mode type corresponding to the second application interface is keyboard input or browsing mode.

[0080] In the fifteenth aspect, an embodiment of the present application provides an electronic device that can be used in the field of human-computer interaction. The electronic device includes a first display screen, a second display screen, a memory, one or more processors and one or more programs; the one or more programs are stored in the memory, and when the one or more processors execute the one or more programs, the electronic device performs the following steps: displaying a first application interface through the first display screen; in response to a detected first operation, converting the mode type corresponding to the first application interface to handwriting input; in response to the input mode of the handwriting input, triggering the display of the first application interface on the second display screen to obtain handwritten content for the first application interface through the second display screen. For the concepts of nouns in the second aspect of the embodiment of the present application and some possible implementation methods of the second aspect, the specific implementation steps and the beneficial effects brought about by each possible implementation method, you can refer to the description of the various possible implementation methods in the first aspect, and will not repeat them one by one here.

[0081] In the fifteenth aspect of the embodiment of the present application, the electronic device can also be used to implement the steps performed by the electronic device in the various possible implementation methods of the fourteenth aspect. For the specific implementation methods of the fifteenth aspect of the embodiment of the present application and the various possible implementation methods of the fifteenth aspect, as well as the beneficial effects brought about by each possible implementation method, you can refer to the description of the various possible implementation methods in the fourteenth aspect, and will not go into details here.

[0082] In the sixteenth aspect, an embodiment of the present application provides a computer program, which, when running on a computer, enables the computer to execute the application interface processing method described in the fourteenth aspect above.

[0083] In the seventeenth aspect, an embodiment of the present application provides an electronic device, including a processor, which is coupled to the memory; the memory is used to store programs; the processor is used to execute the programs in the memory, so that the electronic device executes the application interface processing method described in the above fourteenth aspect.

[0084] In the eighteenth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer-readable storage medium is run on a computer, it enables the computer to execute the application interface processing method described in the above fourteenth aspect.

[0085] In a nineteenth aspect, an embodiment of the present application provides a chip system, which includes a processor for supporting the implementation of the functions involved in the above aspects, such as sending or processing the data and / or information involved in the above methods. In one possible design, the chip system also includes a memory, which is used to store program instructions and data necessary for the server or communication device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0086] According to a twentieth aspect of an embodiment of the present invention, a screen display method is provided, which is applied to an electronic device including a first display screen and a second display screen. The screen display method includes:

[0087] Displaying the interface of the target application on the first display screen;

[0088] Displaying an application control bar on the second display;

[0089] In response to the received first operation, changing the first display area of the application control bar to a second display area;

[0090] When the display area of the application control bar is the first display area, the application control bar includes a first control key group;

[0091] When the display area of the application control bar is the second display area, the application control bar includes a second control key group;

[0092] The first control key group and the second control key group are both control key sets for controlling the target application, and the control keys included in the first control key group and the second control key group are not completely the same.

[0093] The electronic device may be an electronic device having two display screens connected together (for example, by a shaft connection, etc.), wherein the two display screens may be two independent display screens or two display screens divided by a flexible folding screen or a curved screen, and may be used to perform different functions. The electronic device may be an electronic device that works independently as a whole, such as a personal notebook, or it may be an electronic device formed by interconnecting two independently working electronic devices to work together, such as a dual-screen electronic device formed by splicing two mobile phones or two tablet computers.

[0094] The first operation may be an operation that directly acts on the application control bar, for example, the first operation may be changing the display area of the application control bar through a touch screen gesture; or the first operation may be changing the display area of the application control bar by clicking (finger click or mouse click, etc.) the zoom in or zoom out button of the application control bar; or the first operation may be changing the display area of the application control bar by dragging the border of the application control bar with a mouse. The first operation may also be an operation that indirectly acts on the application control bar, for example, the first operation may directly act on the control area through the three methods described above, changing the display area of the application control bar by changing the display area of the control area; or the first operation may directly act on other application display interfaces or input modules (such as a virtual keyboard or handwriting input area) on the second display screen through the three methods described above, changing the display area of other display modules on the second display screen; or the first operation may be an operation of the user on the target application on the first display screen, for example, when the number of control keys displayed in the application control bar corresponding to the user's first operation is different from the number of control keys displayed in the application control bar before the first operation, the display area of the application control bar may be adaptively adjusted so that the control keys corresponding to the first operation are better displayed.

[0095] According to the user's operations and / or needs, the display area and control keys of the application control bar can be flexibly changed, so that the application control bar can be flexibly adjusted according to the user's operations or needs, and the control keys associated with the user's current operations are always displayed in the application control bar, providing users with more convenient input operations and improving user experience.

[0096] In conjunction with the 20th aspect, in a first possible implementation of the 20th aspect:

[0097] Before the first display area of the application control bar changes to the second display area, a virtual keyboard is displayed on the second display screen;

[0098] After the first display area of the application control bar is changed to the second display area, the display layout of the virtual keyboard is changed.

[0099] Specifically, when the second display area is larger than the first display area, the display area of the virtual keyboard is correspondingly reduced, and the layout of the keys in the virtual keyboard is also changed with the change in display area. For example, all or some keys may be reduced, some keys may be reduced, or the spacing between keys may be compressed. When the second display area is smaller than the first display area, the display area of the virtual keyboard is correspondingly increased, and the layout of the keys in the virtual keyboard is also changed with the change in display area. For example, all or some keys may be enlarged, some keys may be added, or the spacing between keys may be increased. Other functional modules such as a touchpad may also be added to the virtual keyboard.

[0100] Since the application control bar is usually displayed on the second display screen at the same time as other display modules (applications or input modules, etc.) in the second display screen, when the display area of the application control bar changes, the display layout of other display modules is adaptively adjusted, so that there is no non-displayed part or folded display part in the second display screen, thereby optimizing the display layout on the second display screen and improving the user experience.

[0101] In combination with the twentieth aspect or the first possible implementation of the twentieth aspect, in the second possible implementation of the twentieth aspect:

[0102] Before the first display area of the application control bar changes to the second display area, the interface of the target application includes a third control key group;

[0103] The second display area is larger than the first display area;

[0104] The second control key group includes the first control key group and the third control key group;

[0105] After the first display area of the application control bar is changed to the second display area, the interface of the target application includes the third control key group.

[0106] When the user needs to display more control keys in the application control bar, or the number of control keys corresponding to the user's current operation is large, increasing the display area of the application control area and increasing the number of control keys displayed in the application control area can provide users with more control keys and provide users with a more convenient input method. In addition, when the display area of the application control bar is increased, the control keys in the first display screen are transferred to the application control bar in the second display screen for display, which can save display space on the first display screen and make the display content of the first display screen more concise and refreshing. In addition, after removing the control keys displayed in the application control bar from the first display screen, the size of the content originally displayed on the first display screen can be increased, or new display content can be added based on the original display content to provide users with more convenient operations and enhance user experience.

[0107] In conjunction with the second possible implementation of the 20th aspect, in a third possible implementation of the 20th aspect:

[0108] The third control key group is determined according to the second display area and the priority order of the control keys to be displayed in the control key set to be displayed of the target application.

[0109] Specifically, the target application's set of control keys to be displayed can be a set of control keys provided by the application and displayed in the application control bar. The priority order of the control keys to be displayed in the set can be specified by the application or determined by the operating system based on factors such as the function of the control keys to be displayed or the frequency of user use.

[0110] The application provides a set of control keys to be displayed, the application or operating system specifies the priority order of the control keys to be displayed, and the operating system determines the control keys added to the application control bar when the display area of the application control bar increases. The control keys displayed in the application control bar can be determined under various display areas of the application control bar, making the setting of the application control bar more flexible and supporting users' diverse operating methods and needs.

[0111] When increasing the display area of the application control bar, the display keys added to the application control area are determined according to the priority order of the control keys to be displayed. When the display area of the application control bar is limited, the control keys with higher priority (more important, or frequently used by users) can be displayed in the application control bar first, which can provide users with more convenient operations and improve user experience.

[0112] In combination with the second possible implementation manner of the 20th aspect or the third possible implementation manner of the 20th aspect, in the fourth possible implementation manner of the 20th aspect:

[0113] The third control key group is displayed at a position closer to the first display screen than the first control key group.

[0114] Under the above settings, the first control key group is displayed closer to the user's hands than the third control key group. That is, each time the application control bar is expanded, the newly added control keys are always displayed closer to the first display screen, and the control keys originally displayed in the application control bar are displayed closer to the user's hands, making it easier for the user to operate. Because the priority of the newly added control keys is often lower than that of the control keys originally displayed in the application control bar when the display area of the application control bar is expanded, the higher-priority control keys can always be displayed closer to the user's hands, providing users with more convenient operation and improving the user experience.

[0115] In combination with the twentieth aspect or the first possible implementation of the twentieth aspect, in a fifth possible implementation of the twentieth aspect:

[0116] Before the first display area of the application control bar is changed to the second display area, the interface of the target application does not include the fourth control key group, which is a set of control keys for controlling the target application;

[0117] The second display area is smaller than the first display area;

[0118] The second control key group is to reduce the fourth control key group in the first control key group;

[0119] After the first display area of the application control bar is changed to the second display area, the interface of the target application includes part or all of the fourth control key group.

[0120] When the user wants to display fewer control keys in the application control bar, or the number of control keys corresponding to the user's current operation is small, or the user needs to enlarge the display area of other display modules on the second display screen, reducing the display area of the application control area and reducing the control keys displayed in the application control area can save display controls on the second display screen, reduce interference with the user's vision, and facilitate users to quickly locate the required control keys. In addition, after reducing the fourth control key group in the application control bar, part or all of the control key groups in the fourth control key group are displayed on the first display screen, so that when the user needs to use this part of the control keys, they can still operate through the first display screen, compensating for the impact of reducing the application control bar on user operations and improving the user experience.

[0121] In conjunction with the fifth possible implementation of the 20th aspect, in a sixth possible implementation of the 20th aspect:

[0122] The fourth control key group is determined according to the second display area and the priority order of the control keys in the first control key group or the position relationship of the control keys in the first control key group.

[0123] Among them, the priority order of the control keys in the first control key group can be specified by the application or by the system. According to the priority order of the control keys, it is determined which control keys in the application control bar to remove when reducing the display area of the application control bar, so that the control keys with higher priority can be retained in the application control bar, thereby improving the user's operating experience. When the user performs the operation of reducing the display area of the application control bar, it is to hide the display of a specific area of the application control bar. For example, by dragging to hide part of the displayed content, it can be determined which control keys to hide based on the position of the control keys to achieve the user's operating purpose.

[0124] In combination with the twentieth aspect, or any one of the first two possible implementations of the twentieth aspect, or the fifth possible implementation of the twentieth aspect, in the seventh possible implementation of the twentieth aspect:

[0125] The second control key group is a control key group corresponding to the second display area of the application control bar.

[0126] The control key group corresponding to the second display area of the application control bar may be provided by the application. For example, the application may define corresponding control key groups for several fixed-size display areas of the application control bar. When the display area of the application control bar corresponds to a display area of a certain fixed size, the control key group corresponding to the display area is displayed in the application control bar. Alternatively, the application may define corresponding control key groups for several size ranges of the display area of the application control bar. When the actual display area of the application control bar falls within a certain size range, the control key group corresponding to the size range is displayed in the application control bar.

[0127] Determining the control keys displayed in the application control bar in the above manner can greatly reduce the amount of calculation of the operating system, shorten the reaction time of the operating system when executing the first operation, and improve operating efficiency.

[0128] In combination with the twentieth aspect, or any one of the first seven possible implementations of the twentieth aspect, in an eighth possible implementation of the twentieth aspect:

[0129] The first operation is gesture operation;

[0130] In response to the received first operation, the first display area of the application control bar is changed to the second display area, specifically:

[0131] In response to the gesture operation, selecting a first type of virtual keyboard corresponding to the gesture operation from a plurality of types of virtual keyboards, wherein different types of virtual keyboards in the plurality of types of virtual keyboards include different virtual keys;

[0132] displaying a first type of virtual keyboard via a second display screen;

[0133] The second display area is determined according to the display area of the first type of virtual keyboard.

[0134] The second display screen may display input methods such as the application control bar and the virtual keyboard at the same time. Different gestures can open different gesture virtual keyboards. When the gesture virtual keyboard is opened through a gesture, the display area and / or display area of the application control bar can be determined according to the display area of the gesture virtual keyboard (display area and display position, etc.), so that the application control bar can flexibly adapt to the gesture virtual keyboard, making the display on the second display screen more reasonable, neat and beautiful, thereby improving the user experience.

[0135] In combination with the 20th aspect, or any one of the first eight possible implementations of the 20th aspect, in a ninth possible implementation of the 20th aspect:

[0136] In response to the received second operation, the interface of the target application is displayed on the second display screen to obtain handwritten content of the interface of the target application through the second display screen, and the second operation indicates to start the handwriting input mode of the target application;

[0137] After the interface of the target application is displayed on the second display screen, the second display screen does not include an application control bar.

[0138] When it is detected that the user has activated the handwriting input mode through the second operation, the target application interface can be displayed on the second display screen, so that the handwritten content of the target application interface can be obtained through the second display screen. At this time, since the entire target application interface has been copied to the second display screen, the application control bar on the second display screen can be hidden, saving display controls on the second display screen, making the display content on the second display screen more concise and refreshing, and avoiding interference of the application control bar on the handwriting input user.

[0139] In combination with the twentieth aspect, or any one of the first nine possible implementations of the twentieth aspect, in a tenth possible implementation of the twentieth aspect:

[0140] The first operation is used to switch the input mode to the handwriting input mode;

[0141] In response to the received first operation, displaying a handwriting input area and / or a control key group associated with a handwriting input mode in the application control bar;

[0142] When the user switches the input mode to handwriting input mode, the handwriting input area can be displayed in the application control bar, which can make it easier for the user to perform handwriting input operations through the application control bar, thereby improving operational efficiency. The application control bar can also display a group of control keys associated with the handwriting input mode, such as pen, eraser, color, font, etc., so that the user can operate the handwriting input mode through the application control bar, providing users with more convenient operations. The handwriting input area and the group of control keys associated with the handwriting input mode can also be displayed simultaneously in the application control bar to achieve the above-mentioned beneficial effects.

[0143] In combination with the twentieth aspect, or any one of the first ten possible implementations of the twentieth aspect, in an eleventh possible implementation of the twentieth aspect, the method further includes:

[0144] Get the touch operation acting on the application control bar;

[0145] In response to the contact operation, obtaining a first control key corresponding to the contact operation, where the first control key is located in the application control bar;

[0146] Obtaining at least one first vibration feedback element matching the first control key from the plurality of vibration feedback elements;

[0147] At least one first vibration feedback element is instructed to emit a vibration wave to perform a first feedback operation, where the first feedback operation is used to prompt that the first control key is a key of the application control bar.

[0148] The control area displayed in the second display screen may include a system control bar and an application control bar. When the user touches a control key in the application control bar, a feedback operation is provided, which enables the user to locate the position of the application control bar and the control keys in the application control bar in the control area without moving the line of sight to the second display screen, helping the user to quickly locate the control key they want to locate during the change of the display area of the application control bar and the control keys, thereby greatly improving operational efficiency. Conversely, according to the user's usage habits, feedback operations can also be set for the control keys in the system control bar in the control area, enabling the user to locate the position of the system control bar and the control keys in the system control bar in the control area without moving the line of sight to the second display screen, thereby greatly improving operational efficiency. In addition, feedback operations can also be set for control keys in the application control bar that have more important functions or are used more frequently by users, thereby helping the user to quickly locate the control key they want to locate during the change of the display area of the application control bar and the control keys, thereby greatly improving operational efficiency.

[0149] In combination with the twentieth aspect, or any one of the first eleven possible implementations of the twentieth aspect, in a twelfth possible implementation of the twentieth aspect, the application control bar may be closed in any of the following ways:

[0150] closing the application control bar based on the received instruction to close the virtual keyboard;

[0151] Close the application control bar based on the key commands of the virtual keyboard;

[0152] Close the app control bar based on gesture commands; and

[0153] Based on the received instruction to close the full screen mode of the application, the application control bar is closed.

[0154] In combination with the twentieth aspect, or any one of the first twelve possible implementations of the twentieth aspect, in a thirteenth possible implementation of the twentieth aspect, the application control bar may be opened in any of the following ways:

[0155] activating the application control bar based on the received instruction to activate the virtual keyboard;

[0156] Activate the application control bar based on the key commands of the virtual keyboard;

[0157] Activate the application control bar based on gesture commands; and

[0158] Based on the received instruction to start the full screen mode of the application, the application control bar is activated.

[0159] The above-mentioned method of opening and closing the application control bar is merely exemplary. The above-mentioned design enables the user to flexibly activate or close the application control area when displaying any content on the second display screen, thereby providing the user with more convenient operation and improving the user experience.

[0160] According to a twenty-first aspect of an embodiment of the present invention, a screen display method is provided. The screen display method is applied to an electronic device including a first display screen and a second display screen. The screen display method includes:

[0161] Displaying an interface of a target application on the first display screen, where the interface of the target application includes a fifth control key group;

[0162] Displaying an application control bar on the second display;

[0163] In response to a third operation on the interface of the target application, a fifth control key group is displayed in the application control bar, and the fifth control key group in the interface of the target application is hidden.

[0164] According to the user's operation on the target application interface, the control keys corresponding to the user's operation are displayed in the application control bar. The shortcut operation control keys corresponding to the user's current operation can always be displayed in the application control bar, providing users with more convenient operations and improving user operation efficiency. In addition, after the control keys are displayed in the application control bar, the display of these control keys on the first display screen is removed, which can save the display area of the first display screen and make the display content of the first display screen more concise and refreshing. In addition, after removing the control keys displayed in the application control bar from the first display screen, the size of the content originally displayed on the first display screen can be increased, or new display content can be added on the basis of the original display content, providing users with more convenient operations and improving user experience.

[0165] In conjunction with the twenty-first aspect, in a first possible implementation of the twenty-first aspect, the screen display method further includes:

[0166] Corresponding to the third operation on the interface of the target application, the display area of the application control bar is changed.

[0167] After the fifth control key group is displayed in the application control bar, the number of control keys in the application control bar may change. At this time, the display area of the application control bar can be adaptively adjusted to optimize the display of the control keys in the application control bar, so that the display of the control keys in the application control bar is more in line with the user's usage habits and improve the user experience.

[0168] In combination with the twenty-first aspect or the first possible implementation of the twenty-first aspect, in a second possible implementation of the twenty-first aspect, before the fifth control key group is displayed in the application control bar, the screen display method further includes:

[0169] The application control bar includes a sixth control key group, which is a set of initial control keys for controlling a target application.

[0170] When the user opens the target application, the initial control key group for controlling the target application can be displayed in the application control bar. When the user performs an operation on the target application, a fifth control key group corresponding to the user's current operation can be added to the initial control key group, or the initial control key group can be partially or completely replaced with the fifth control key group corresponding to the user's current operation. This allows the application control bar to always display the control keys most relevant to the user's current operation, providing the user with more convenient operations and improving the user's operating efficiency. In addition, after the initial control key group is displayed in the application control bar, this part of the control keys in the interface of the target application can be removed to save the display area of the first display screen, making the display content of the first display screen more concise and refreshing.

[0171] In combination with the twenty-first aspect or the first possible implementation manner of the twenty-first aspect, in a third possible implementation manner of the twenty-first aspect, after the fifth control key group is displayed in the application control bar, the screen display method further includes:

[0172] In response to a fourth operation on the interface of the target application, a seventh control key group is displayed in the application control bar, and the seventh control key group in the interface of the target application is hidden.

[0173] Specifically, after the user has performed the third operation on the interface of the target application, the user can continue to perform the fourth operation on the interface of the same target application. When the user performs the fourth operation on the target application, the seventh control key group corresponding to the user's fourth operation can be added to the fifth control key group in the application control bar, or some or all of the control keys in the fifth control key group in the application control bar can be replaced with the seventh control key group corresponding to the user's fourth operation. In addition, the fourth operation can also be to display a new target application on the first display screen. The fourth operation can be achieved by opening a new target application, or the target application can be originally running in the background and its interface is displayed on the first display screen through the fourth operation. When the interface of the new target application is displayed on the first display screen, the interface of the original target application in the first display screen can be hidden. In this case, the fifth control key group can be replaced by the seventh control key group. Alternatively, the interfaces of two target applications can be displayed simultaneously on the first display screen (for example, dual-screen display). In this case, the fifth control key group can be added to the seventh control key group, that is, the seventh control key group and the fifth control key group are displayed together in the application control bar.

[0174] According to the changes in user operations, the control keys in the application control bar can be flexibly changed, so that the control keys most closely related to the user operations can always be displayed in the application control bar, providing users with more convenient operations and improving operational efficiency.

[0175] In combination with the twenty-first aspect, or any one of the first three possible implementations of the twenty-first aspect, in a fourth possible implementation of the twenty-first aspect:

[0176] The third operation is to select a target object in the interface of the target application;

[0177] The fifth control key group is a control key for operating a target object.

[0178] Among them, the third operation can be to select the target object in the interface of the target application, for example, the shading of the target object is deepened to indicate that it is selected, or the third operation can be to select the target object by moving the cursor over the target object. Specifically, the target object selected by the third operation can be a picture or text, and the fifth control key group can include control keys related to text or picture editing, so that users can edit text or pictures through the control keys in the application control bar. The target object selected by the third operation can be audio and video, and the fifth control key group can include a control key group related to audio and video control, so that users can control audio and video through the control keys in the application control bar.

[0179] In combination with the twenty-first aspect, or any one of the first three possible implementations of the twenty-first aspect, in a fifth possible implementation of the twenty-first aspect:

[0180] The third operation is to move the cursor to a target position in the interface of the target application;

[0181] The fifth control key group is the control keys in the menu bar that is displayed when you right-click the mouse at the target location.

[0182] When the user moves the cursor to the target position of the target application's interface, the control keys in the menu bar that are displayed when the right mouse button is clicked at the cursor location are displayed in the application control bar. The control keys in the right-click menu bar are designed according to the user's intention and are likely to meet the user's current operation needs. Directly using the control keys in the right-click menu bar can avoid secondary development for developers and shorten the development cycle.

[0183] In combination with the twenty-first aspect, or any one of the first three possible implementations of the twenty-first aspect, in a sixth possible implementation of the twenty-first aspect:

[0184] The third operation is browsing the content in the target area of the interface of the target application by sliding gestures or rolling the mouse wheel;

[0185] The fifth control key group is a thumbnail of the target area and a positioning frame for quickly locating the target object in the thumbnail.

[0186] Through the above settings, users can quickly locate the target content they need through the thumbnail of the target area in the application control bar and the positioning box of the target object in the thumbnail, thereby improving user operation efficiency.

[0187] According to a twenty-second aspect of the embodiments of the present invention, an electronic device is provided, including:

[0188] A first display screen, a second display screen, a memory, one or more processors, and one or more programs; wherein the one or more programs are stored in the memory; wherein the one or more processors, when executing the one or more programs, cause the electronic device to perform the following steps:

[0189] Displaying the interface of the target application on the first display screen;

[0190] Displaying an application control bar on the second display;

[0191] In response to the received first operation, changing the first display area of the application control bar to a second display area;

[0192] When the display area of the application control bar is the first display area, the application control bar includes a first control key group;

[0193] When the display area of the application control bar is the second display area, the application control bar includes a second control key group;

[0194] The first control key group and the second control key group are both control key sets for controlling the target application, and the control keys included in the first control key group and the second control key group are not completely the same.

[0195] In conjunction with the twenty-second aspect, in a first possible implementation manner of the twenty-second aspect, when one or more processors execute one or more programs, the electronic device performs the following steps:

[0196] Before the first display area of the application control bar changes to the second display area, a virtual keyboard is displayed on the second display screen;

[0197] After the first display area of the application control bar is changed to the second display area, the display layout of the virtual keyboard is changed.

[0198] In combination with the twenty-second aspect or the first possible implementation manner of the twenty-second aspect, in a second possible implementation manner of the twenty-second aspect, when one or more processors execute one or more programs, the electronic device performs the following steps:

[0199] Before the first display area of the application control bar is changed to the second display area, the interface of the target application includes a third control key group;

[0200] The second display area is larger than the first display area;

[0201] The second control key group includes the first control key group and the third control key group;

[0202] After the first display area of the application control bar is changed to the second display area, the interface of the target application includes the third control key group.

[0203] In conjunction with the second possible implementation manner of the twenty-second aspect, in a third possible implementation manner of the twenty-second aspect, when one or more processors execute one or more programs, the electronic device performs the following steps:

[0204] The third control key group is determined according to the second display area and the priority order of the control keys to be displayed in the control key set to be displayed of the target application.

[0205] In combination with the twenty-second aspect or the first possible implementation manner of the twenty-second aspect, in a fourth possible implementation manner of the twenty-second aspect, when one or more processors execute one or more programs, the electronic device performs the following steps:

[0206] Before the first display area of the application control bar is changed to the second display area, the interface of the target application does not include the fourth control key group, which is a set of control keys for controlling the target application;

[0207] The second display area is smaller than the first display area;

[0208] The second control key group is to reduce the fourth control key group in the first control key group;

[0209] After the first display area of the application control bar is changed to the second display area, the interface of the target application includes part or all of the fourth control key group.

[0210] In conjunction with the fourth possible implementation manner of the twenty-second aspect, in a fifth possible implementation manner of the twenty-second aspect, when one or more processors execute one or more programs, the electronic device performs the following steps:

[0211] The fourth control key group is determined according to the second display area and the priority order of the control keys in the first control key group or the position relationship of the control keys in the first control key group.

[0212] In combination with the twenty-second aspect, or any one of the first five possible implementations of the twenty-second aspect, in a sixth possible implementation of the twenty-second aspect, when one or more processors execute one or more programs, the electronic device performs the following steps:

[0213] The first operation is gesture operation;

[0214] In response to the received first operation, the first display area of the application control bar is changed to the second display area, specifically:

[0215] In response to the gesture operation, selecting a first type of virtual keyboard corresponding to the gesture operation from a plurality of types of virtual keyboards, wherein different types of virtual keyboards in the plurality of types of virtual keyboards include different virtual keys;

[0216] displaying a first type of virtual keyboard via a second display screen;

[0217] The second display area is determined according to the display area of the first type of virtual keyboard.

[0218] In combination with the twenty-second aspect, or any one of the first six possible implementations of the twenty-second aspect, in a seventh possible implementation of the twenty-second aspect, when one or more processors execute one or more programs, the electronic device performs the following steps:

[0219] In response to the received second operation, displaying the interface of the target application on the second display screen to obtain handwritten content of the interface of the target application through the second display screen, wherein the second operation indicates turning on a handwriting input mode for the target application;

[0220] After the interface of the target application is displayed on the second display screen, the second display screen does not include an application control bar.

[0221] The electronic device provided in the twenty-second aspect of the embodiment of the present invention can implement various possible implementation methods described in the twentieth aspect of the embodiment of the present invention and achieve all beneficial effects.

[0222] According to a twenty-third aspect of the embodiments of the present invention, an electronic device is provided, including:

[0223] A first display screen, a second display screen, a memory, one or more processors, and one or more programs; wherein the one or more programs are stored in the memory; wherein the one or more processors, when executing the one or more programs, cause the electronic device to perform the following steps:

[0224] Displaying an interface of a target application on the first display screen, where the interface of the target application includes a fifth control key group;

[0225] Displaying an application control bar on the second display;

[0226] In response to a third operation on the interface of the target application, a fifth control key group is displayed in the application control bar, and the fifth control key group in the interface of the target application is hidden.

[0227] In conjunction with the twenty-third aspect, in a first possible implementation of the twenty-third aspect, when one or more processors execute one or more programs, the electronic device performs the following steps before displaying the fifth control key group in the application control bar:

[0228] The application control bar includes a sixth control key group, which is a set of initial control keys for controlling the target application;

[0229] The interface of the target application does not include the sixth control key group.

[0230] In combination with the twenty-third aspect or the first possible implementation manner of the twenty-third aspect, in a second possible implementation manner of the twenty-third aspect, when one or more processors execute one or more programs, the electronic device displays the fifth control key group in the application control bar and then performs the following steps:

[0231] In response to a fourth operation on the interface of the target application, displaying a seventh control key group in the application control bar;

[0232] The target application interface does not include the seventh control key.

[0233] In combination with the twenty-third aspect or any one of the first two possible implementations of the twenty-third aspect, in a third possible implementation of the twenty-third aspect:

[0234] The third operation is to select a target object in the interface of the target application;

[0235] The fifth control key group is a control key for operating a target object.

[0236] In combination with the twenty-third aspect or any one of the first two possible implementations of the twenty-third aspect, in a fourth possible implementation of the twenty-third aspect:

[0237] The third operation is to move the cursor to a target position in the interface of the target application;

[0238] The fifth control key group is the control keys in the menu bar that is displayed when you right-click the mouse at the target location.

[0239] In combination with the twenty-third aspect or any one of the first two possible implementations of the twenty-third aspect, in a fifth possible implementation of the twenty-third aspect:

[0240] The third operation is browsing the content in the target area of the interface of the target application by sliding gestures or rolling the mouse wheel;

[0241] The fifth control key group is a thumbnail of the target area and a positioning frame for quickly locating the target object in the thumbnail.

[0242] The electronic device provided in the twenty-third aspect of the embodiment of the present invention can implement various possible implementation methods described in the twenty-first aspect of the embodiment of the present invention and achieve all beneficial effects.

[0243] The twenty-fourth aspect of the embodiments of the present invention provides a computer storage medium, which stores a program. When the computer storage medium is run on a computer, it enables the computer to implement the screen display method described in the twentieth aspect or any one of the first eleven possible implementation methods of the twentieth aspect, or implement the screen display method described in the twenty-first aspect or any one of the sixth possible implementation methods of the twenty-first aspect, and achieve all the above-mentioned beneficial effects.

[0244] The twenty-fifth aspect of the embodiments of the present invention provides a computer program product, which, when running on a computer, enables the computer to implement the screen display method described in the twentieth aspect or any one of the first eleven possible implementation methods of the twentieth aspect, or to implement the screen display method described in the twenty-first aspect or any one of the sixth possible implementation methods of the twenty-first aspect, and achieve all the above-mentioned beneficial effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0245] Figure 1 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0246] Figure 2 Another structural diagram of an electronic device provided in an embodiment of the present application;

[0247] Figure 3 A schematic diagram of the structure of a touch screen provided in an embodiment of the present application;

[0248] Figure 4 Schematic diagrams of two arrangements of multiple vibration feedback units in an electronic device provided in an embodiment of the present application;

[0249] Figure 5 A schematic cross-sectional view of a touch screen provided in an embodiment of the present application;

[0250] Figure 6 A schematic diagram of an arrangement layout of multiple vibration feedback units included in the vibration feedback module provided in an embodiment of the present application;

[0251] Figure 7 Another structural diagram of a touch screen provided in an embodiment of the present application;

[0252] Figure 8 A schematic diagram of another structure of the touch screen provided in an embodiment of the present application;

[0253] Figure 9 A schematic diagram of a flow chart of a feedback method provided in an embodiment of the present application;

[0254] Figure 10 Two schematic diagrams of a virtual keyboard in the feedback method provided in an embodiment of the present application;

[0255] Figure 11 Two schematic diagrams of the first location area and the second location area in the feedback method provided in an embodiment of the present application;

[0256] Figure 12 Another schematic diagram of the first location area and the second location area in the feedback method provided in an embodiment of the present application;

[0257] Figure 13 Another schematic diagram of the first location area and the second location area in the feedback method provided in an embodiment of the present application;

[0258] Figure 14 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0259] Figure 15 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0260] Figure 16 A schematic diagram of an electronic device provided in an embodiment of the present application;

[0261] Figure 17 A flowchart of a method for processing a virtual keyboard provided in an embodiment of the present application;

[0262] Figure 18 A schematic diagram of a first gesture parameter in the virtual keyboard processing method provided in an embodiment of the present application;

[0263] Figure 19 A schematic diagram of relative angle information in the method for processing a virtual keyboard provided in an embodiment of the present application;

[0264] Figure 20 Two schematic diagrams of the first area in the virtual keyboard processing method provided in an embodiment of the present application;

[0265] Figure 21 A schematic diagram of a first gesture operation in the virtual keyboard processing method provided in an embodiment of the present application;

[0266] Figure 22 Another schematic diagram of the first gesture operation in the virtual keyboard processing method provided in an embodiment of the present application;

[0267] Figure 23 A schematic diagram of a first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application;

[0268] Figure 24 Another schematic diagram of the first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application;

[0269] Figure 25 Another schematic diagram of the first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application;

[0270] Figure 26 Another schematic diagram of the first type of virtual keyboard in the virtual keyboard processing method provided in the embodiment of the present application;

[0271] Figure 27 Another schematic diagram of the first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application;

[0272] Figure 28 Another schematic diagram of the first type of virtual keyboard in the virtual keyboard processing method provided in the embodiment of the present application;

[0273] Figure 29 Another schematic diagram of the first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application;

[0274] Figure 30 A schematic diagram of a first setting interface in the virtual keyboard processing method provided in an embodiment of the present application;

[0275] Figure 31Another schematic diagram of the first setting interface in the virtual keyboard processing method provided in an embodiment of the present application;

[0276] Figure 32 A schematic diagram of a customized gesture operation in the virtual keyboard processing method provided in an embodiment of the present application;

[0277] Figure 33 Another schematic diagram of the first type of virtual keyboard in the virtual keyboard processing method provided in the embodiment of the present application;

[0278] Figure 34 Another schematic diagram of the first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application;

[0279] Figure 35 Another schematic diagram of the first type of virtual keyboard in the virtual keyboard processing method provided in the embodiment of the present application;

[0280] Figure 36 A schematic diagram of a second virtual key in the virtual keyboard processing method provided in an embodiment of the present application;

[0281] Figure 37 Another schematic diagram of a second virtual key in the virtual keyboard processing method provided in an embodiment of the present application;

[0282] Figure 38 Another flowchart of the method for processing a virtual keyboard provided in an embodiment of the present application;

[0283] Figure 39 This is a structural diagram of an electronic device provided in an embodiment of the present application;

[0284] Figure 40 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0285] Figure 41 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0286] Figure 42 A flowchart of a method for processing an application interface provided in an embodiment of the present application;

[0287] Figure 43 A schematic diagram of an interface display of a second display screen in the method for processing an application interface provided in an embodiment of the present application;

[0288] Figure 44 A schematic diagram of a process flow in a method for processing an application interface provided in an embodiment of the present application;

[0289] Figure 45Another flowchart of the method for processing an application interface provided in an embodiment of the present application;

[0290] Figure 46 A schematic diagram of various holding postures in the application interface processing method provided in an embodiment of the present application;

[0291] Figure 47 This is a schematic diagram of an interface of a first application interface in the application interface processing method provided in an embodiment of the present application;

[0292] Figure 48 Schematic diagrams of two interfaces of the first application interface in the application interface processing method provided in an embodiment of the present application;

[0293] Figure 49 A schematic diagram of a first contact operation in the method for processing an application interface provided in an embodiment of the present application;

[0294] Figure 50 A schematic diagram of a display interface of a first application interface in the application interface processing method provided in an embodiment of the present application;

[0295] Figure 51 A schematic diagram of a process flow in a method for processing an application interface provided in an embodiment of the present application;

[0296] Figure 52 A schematic diagram of a process flow in a method for processing an application interface provided in an embodiment of the present application;

[0297] Figure 53 A flowchart of a method for processing an application interface provided in an embodiment of the present application;

[0298] Figure 54 A schematic diagram of a display interface of a first application interface in the application interface processing method provided in an embodiment of the present application;

[0299] Figure 55 A schematic diagram of a display interface of a first application interface in the application interface processing method provided in an embodiment of the present application;

[0300] Figure 56 A schematic diagram of a display interface of a first application interface in the application interface processing method provided in an embodiment of the present application;

[0301] Figure 57 A schematic diagram of a display interface of a first application interface in the application interface processing method provided in an embodiment of the present application;

[0302] Figure 58 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0303] Figure 59 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0304] Figure 60 This is a dual-screen electronic device provided by an embodiment of the present invention;

[0305] Figure 61 This is an application scenario provided by an embodiment of the present invention;

[0306] Figure 62 This is a screen display method provided by an embodiment of the present invention;

[0307] Figure 63A This is a display method of a control area provided by an embodiment of the present invention;

[0308] Figure 63B This is another display method of the control area provided by an embodiment of the present invention;

[0309] Figure 63C This is another display method of the control area provided by an embodiment of the present invention;

[0310] Figure 64A A method for activating a control area provided by an embodiment of the present invention;

[0311] Figure 64B This is another method for activating a control area provided by an embodiment of the present invention;

[0312] Figure 64C This is another method for activating a control area provided by an embodiment of the present invention;

[0313] Figure 64D This is another method for activating a control area provided by an embodiment of the present invention;

[0314] Figure 65A This is a correspondence method between user operations and control key groups provided by an embodiment of the present invention;

[0315] Figure 65B This is another correspondence method between user operations and control key groups provided by an embodiment of the present invention;

[0316] Figure 65C This is another correspondence method between user operations and control key groups provided by an embodiment of the present invention;

[0317] Figure 65D This is another correspondence method between user operations and control key groups provided by an embodiment of the present invention;

[0318] Figure 65E This is another correspondence method between user operations and control key groups provided by an embodiment of the present invention;

[0319] Figure 65F This is another correspondence method between user operations and control key groups provided by an embodiment of the present invention;

[0320] Figure 66A This is a display method of a control area provided by an embodiment of the present invention;

[0321] Figure 66B This is another display method of the control area provided by an embodiment of the present invention;

[0322] Figure 67 This is a layout method for displaying content in a control area provided by an embodiment of the present invention;

[0323] Figure 68 This is a priority setting method provided by an embodiment of the present invention;

[0324] Figure 69 This is another priority setting method provided by an embodiment of the present invention;

[0325] Figure 70A A method for closing a control area provided by an embodiment of the present invention;

[0326] Figure 70B This is another method for closing a control area provided by an embodiment of the present invention;

[0327] Figure 70C This is another method for closing a control area provided by an embodiment of the present invention;

[0328] Figure 70D This is another method for closing a control area provided by an embodiment of the present invention;

[0329] Figure 71 This is another screen display method provided by an embodiment of the present invention;

[0330] Figure 72 This is another screen display method provided by an embodiment of the present invention;

[0331] Figure 73A A method for changing the display area of an application control bar provided by an embodiment of the present invention;

[0332] Figure 73B A method for increasing the display area of an application control bar provided by an embodiment of the present invention;

[0333] Figure 73C A method for increasing the display area of an application control bar provided by an embodiment of the present invention;

[0334] Figure 74A This is another method for changing the display area of the application control bar provided by an embodiment of the present invention;

[0335] Figure 74B This is another method for increasing the display area of the application control bar provided by an embodiment of the present invention;

[0336] Figure 74C This is another method for increasing the display area of the application control bar provided by an embodiment of the present invention;

[0337] Figure 75A This is another method for changing the display area of the application control bar provided by an embodiment of the present invention;

[0338] Figure 75B This is another method for increasing the display area of the application control bar provided by an embodiment of the present invention;

[0339] Figure 75C This is another method for increasing the display area of the application control bar provided by an embodiment of the present invention;

[0340] Figure 76A A method for changing the display area and control keys of an application control bar according to user operations is provided in an embodiment of the present invention;

[0341] Figure 76B Another method for changing the display area and control keys of an application control bar according to user operations provided by an embodiment of the present invention;

[0342] Figure 77A This is a gesture control method provided by an embodiment of the present invention;

[0343] Figure 77B This is another gesture control method provided by an embodiment of the present invention;

[0344] Figure 77C This is another gesture control method provided by an embodiment of the present invention;

[0345] Figure 77D This is another gesture control method provided by an embodiment of the present invention;

[0346] Figure 78A This is another gesture control method provided by an embodiment of the present invention;

[0347] Figure 78B This is another gesture control method provided by an embodiment of the present invention;

[0348] Figure 79 This is another gesture control method provided by an embodiment of the present invention;

[0349] Figure 80A This is a specific implementation of a screen display method provided by an embodiment of the present invention;

[0350] Figure 80BThis is a specific implementation of another screen display method provided by an embodiment of the present invention;

[0351] Figure 80C This is a specific implementation of another screen display method provided by an embodiment of the present invention;

[0352] Figure 80D This is a specific implementation of another screen display method provided by an embodiment of the present invention;

[0353] Figure 80E This is a specific implementation of another screen display method provided by an embodiment of the present invention;

[0354] Figure 80F This is a specific implementation of another screen display method provided by an embodiment of the present invention;

[0355] Figure 80G This is a specific implementation of another screen display method provided by an embodiment of the present invention;

[0356] Figure 81 This is an electronic device provided by an embodiment of the present invention;

[0357] Figure 82 This is another electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0358] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged under appropriate circumstances. This is merely a way of distinguishing when describing objects with the same properties in the embodiments of the present application. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, so that a process, method, system, product or apparatus that includes a series of units is not necessarily limited to those units, but may include other units not expressly listed or inherent to these processes, methods, products or apparatuses.

[0359] The embodiments of the present application are described below in conjunction with the accompanying drawings. Those skilled in the art will appreciate that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0360] Example 1:

[0361] The embodiments of the present application can be applied to various application scenarios where input is performed using a virtual keyboard. For example, when a user is using a text entry application, creating a PowerPoint presentation, browsing the web, playing a video, playing music, or using a navigation application, a virtual keyboard can be used for input. In these scenarios, blind typing on a touch screen is a relatively difficult task.

[0362] In order to solve the above problems, an embodiment of the present application provides a feedback method, which is applied to an electronic device equipped with a touch screen. The electronic device obtains first position information of a first contact point on the touch screen, and obtains a first virtual key corresponding to the first contact point based on the first position information. When the first virtual key is an anchor point key, a first feedback operation is performed to prompt that the first virtual key is an anchor point key, thereby facilitating the cultivation of the user's muscle memory for the anchor point key, and performing blind typing training with the help of the muscle memory of the anchor point key to reduce the difficulty of blind typing on the touch screen.

[0363] The feedback method provided in the embodiment of the present application can be used for Figure 1 For electronic devices shown, see Figure 1 and Figure 2 , Figure 1 and Figure 2 Two structural diagrams of electronic devices provided in the embodiments of the present application. Figure 1 The electronic device 1 includes a processor 10 and a touch screen 20. The touch screen 10 includes a contact sensing module 100 and a vibration feedback module 200. The vibration feedback module 200 includes multiple vibration feedback elements.

[0364] Specifically, the processor 10 obtains the first position information of the first contact point on the touch screen through the contact sensing module 100. When the processor 10 determines that the first virtual key corresponding to the first contact point is an anchor point key, the processor 10 obtains a vibration feedback element that matches the first virtual keyboard from the multiple vibration feedback elements included in the vibration feedback module 200, and emits a vibration wave through the vibration feedback element that matches the first virtual key to emit vibration feedback at the first contact point through the touch screen (that is, within a preset range around the first contact point on the touch screen) to prompt the user that the first virtual key touched is an anchor point key. It should be noted that the aforementioned vibration feedback is not a full-screen vibration feedback, but a vibration feedback for the first contact point, and the vibration feedback intensity at the first contact point is the greatest.

[0365] In some application scenarios, see Figure 2The electronic device 1 includes a display 30 and a touch screen 20. A virtual keyboard is displayed on the touch screen 20, and the virtual keyboard has anchor point buttons. That is, the touch screen 20 needs to have the functions of displaying the virtual keyboard and providing vibration feedback. Therefore, a display module is also required in the touch screen 20. In other application scenarios, the electronic device 1 may also be a virtual reality (VR) device, an augmented reality (AR) device, or a mixed reality (MR) device. That is, the touch screen 20 may not need to display the virtual keyboard and only needs to provide vibration feedback. In this case, a display module is not required in the touch screen 20. It should be understood that the subsequent embodiments will only be described by taking the touch screen 20 provided with a display module as an example.

[0366] Further, see Figure 3 , Figure 3 A schematic diagram of the structure of a touch screen provided in an embodiment of the present application. The touch screen 20 may further include a cover plate 300 and a display module 400. Figure 3 In the embodiment, the cover plate 300 and the contact sensing module 100 are integrated into one body. However, the cover plate 300 and the contact sensing module 100 may also be separated from each other.

[0367] The cover plate 300 may be made of a glass-like transparent rigid material, a flexible transparent organic material, or other materials, and the touch sensing module 100 may be specifically a touch sensing film, which may be a capacitive touch sensing film, a pressure touch sensing film, a temperature touch sensing film, or other types of films. Furthermore, as an example, the touch sensing film may be made of an indium tin oxide (ITO) metal mesh, a carbon nanotube mesh with protrusions, or other materials, and the examples are not exhaustive. In the embodiments of the present application, a variety of specific forms of the vibration feedback element are provided, which increases the flexibility of the implementation of the present solution.

[0368] The display module 400 is used to display a virtual keyboard. The display module 400 and the contact sensing module 100 can be integrated into one body or separated from each other. Figure 3 In the example, the display module 400 and the touch sensing module 100 are separated from each other. The display module 400 can be specifically a display panel, which can be a liquid crystal display (LCD), an active matrix organic light emitting diode (AMOLED), or other types of display panels, etc., which are not exhaustive here.

[0369] In one implementation, Figure 3 As shown, the vibration feedback module 200 can be specifically expressed as a vibration feedback layer, which is located below the contact sensing module 100 , and can specifically be located above the display module 400 or below the display module 400 .

[0370] The vibration feedback module 200 is configured with multiple vibration feedback units 201. Figure 3 Each dark gray diamond in the figure represents a vibration feedback unit; a vibration feedback unit 201 may include one or more vibration feedback elements. In one embodiment, the vibration feedback layer may be a vibration feedback film, which is partitioned to form multiple vibration feedback elements. In another embodiment, the vibration feedback element may be a piezoelectric ceramic, a linear motor, or other types of electronic components, which are not exhaustive here.

[0371] Furthermore, the plurality of vibration feedback units 201 can be arranged in a variety of layouts. In one embodiment, see Figure 3 The layout of the virtual keyboard is completely consistent with that of the physical keyboard. The physical keyboard can be a 61-key keyboard, an 87-key keyboard, a 104-key keyboard, a 108-key keyboard, an ergonomic keyboard, or other types of physical keyboards. The specific design of the virtual keyboard can be flexibly set according to the actual application scenario. Multiple vibration feedback units 201 can be arranged in a one-to-one correspondence with multiple virtual keys, that is, each virtual key corresponds to a vibration feedback unit 201 in position.

[0372] In another case, see Figure 4 , Figure 4 Schematic diagrams of two arrangements of multiple vibration feedback units in an electronic device provided in an embodiment of the present application. Figure 4 Including (a) sub-schematic diagram and (b) sub-schematic diagram, please refer to Figure 4 In the sub-schematic diagram (a), multiple vibration feedback units 201 are arranged in a matrix. Figure 4 In the sub-schematic diagram (b), multiple vibration feedback units 201 are arranged in a chessboard-like manner. Figure 4 (a) Sub-diagram and Figure 4 Each gray square in the sub-schematic diagram (b) represents a vibration feedback unit 201.

[0373] In another implementation, Figure 5 and Figure 6 As shown, multiple vibration feedback units 201 (ie, multiple vibration feedback elements) can be located around the display module 400 . Figure 5 A cross-sectional schematic diagram of a touch screen provided in an embodiment of the present application, Figure 6A schematic diagram of an arrangement layout of multiple vibration feedback units included in the vibration feedback module provided in the embodiment of the present application. Figure 5 The touch screen 20 includes a cover plate 300, a contact sensing module 100, a display module 400, a vibration feedback element, a support structure of the vibration feedback element, other modules in the touch screen, and a bottom plate. Figure 5 In the example where the cover plate 300 and the contact sensing module 100 are integrated into one, multiple vibration feedback elements are parallel to the display module 400 and can directly support the cover plate 300. It should be noted that in other embodiments, the cover plate 300 and the contact sensing module 100 can also be independent, and multiple vibration feedback units can also be parallel to the contact sensing module 100. Figure 5 and Figure 6 It can be seen that the multiple vibration feedback units 201 are arranged in a surrounding manner, that is, the multiple vibration feedback units 201 surround the display module 400. Correspondingly, in other embodiments, the multiple vibration feedback units 201 can also surround the contact sensing module 100.

[0374] Furthermore, there may be a gap layer between the display module 400 and the cover plate 300, thereby providing a space margin for the vibration feedback element to emit vibration waves. The display module 400 and the cover plate 300 may also be bonded using a light-transmitting adhesive material. The support structure of the vibration feedback element and the base plate may be integrated into one body or may be separated from each other. In the embodiment of the present application, a variety of arrangement layouts of multiple vibration feedback units are provided, which increases the flexibility of the implementation of this solution.

[0375] It should be noted that the above enumeration of the arrangement and layout of multiple vibration feedback units is only for the convenience of understanding this solution. Multiple vibration feedback units can also adopt other layout methods. The specific implementation method should be determined in combination with the actual product form, and is not exhaustive here.

[0376] Optionally, the touch screen 20 may further include a pressure sensing module, which is used to detect pressure changes and positions on the touch screen.

[0377] In one implementation, the pressure sensing module and the vibration feedback module 200 can be two independent modules, and the pressure sensing module can be arranged above the vibration feedback module 200 or below the vibration feedback module 200. The pressure sensing module can be specifically manifested as a pressure sensing film, a distributed pressure sensor, or in other forms, which are not exhaustive here.

[0378] In another implementation, the pressure sensing module can also be integrated with the vibration feedback module 200, then the vibration feedback module 200 can also be called a pressure sensing module, and the vibration feedback element can also be called a pressure sensing element. In this implementation, the vibration feedback element can specifically adopt piezoelectric ceramics, piezoelectric polymers (such as piezoelectric films), piezoelectric composites or other types of elements, and the piezoelectric composites are also review materials obtained by using piezoelectric ceramics and piezoelectric polymers. Further, in one case, the multiple vibration feedback elements included in the vibration feedback module 200 (which can also be called the pressure sensing module) can be divided, and the second vibration feedback element in the multiple vibration feedback elements is used to collect pressure values, and the third vibration feedback element in the multiple vibration feedback elements is used to emit vibration waves for vibration feedback. Wherein, the second vibration feedback element and the third vibration feedback element are different vibration feedback elements. As an example, for example, a vibration feedback unit 201 includes two vibration feedback elements, and one vibration feedback element in the same vibration feedback unit 201 is used to collect pressure values, and the other vibration feedback element is used to emit vibration waves for vibration feedback.

[0379] In another case, the multiple vibration feedback elements in the vibration feedback module 200 (also referred to as the pressure sensing module) are used to collect pressure values in a first time period and to emit vibration waves in a second time period, where the first time period and the second time period are different. As an example, the multiple vibration feedback elements in the vibration feedback module 200 (also referred to as the pressure sensing module) can be used to collect pressure values in a default state, and when a first pressure value threshold is reached (i.e., when a press operation is confirmed), they are used to emit vibration waves for vibration feedback.

[0380] In an embodiment of the present application, the touch screen is also configured with a pressure sensing module for collecting pressure values, so that not only the position information of the contact point can be obtained, but also the pressure value of the contact point can be obtained, so as to further manage the contact operation obtained through the touch screen in detail; and the pressure sensing module and the vibration feedback module are integrated into one, which is conducive to reducing the thickness of the touch screen and thereby improving the convenience of the electronic device.

[0381] Optionally, the tactile properties of the cover plate 300 of the touch screen 20 are changeable. These tactile properties include any one or more of the following: sliding friction coefficient, stick-slip properties, temperature, or other tactile properties. Furthermore, stick-slip properties represent the speed at which the sliding friction coefficient changes. Furthermore, the tactile properties of the entire cover plate 300 can be changed, or only the tactile properties of contact points within the cover plate 300 can be changed.

[0382] Specifically, in one implementation, Figure 7 As shown, Figure 7A structural diagram of a touch screen provided in an embodiment of the present application. The touch screen 20 may also include an ultrasonic module 500, which is used to emit ultrasonic waves to change the tactile properties of the cover 300. Specifically, it can be implemented by an ultrasonic vibration film, a piezoelectric film, a speaker or other components, etc., which are not exhaustive here. Among them, the ultrasonic module 500 can be configured below the cover 300, specifically above the contact sensing module 100 or the display module 400, or below the contact sensing module 100 or the display module 400, Figure 7 In the example above the contact sensing module 100, it should be understood that Figure 7 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0383] In another implementation, Figure 8 As shown, Figure 8 This is a schematic diagram of the structure of a touch screen provided in an embodiment of the present application. The touch screen 20 also includes an electrostatic module 600, which is used to generate an electrical signal to change the tactile properties of the cover. The electrostatic module 600 can be specifically manifested as an electrostatic film layer, which can be configured below the cover 300, specifically above the contact sensing module 100 or the display module 400, or below the contact sensing module 100 or the display module 400. Figure 8 In the example above the contact sensing module 100, it should be understood that Figure 8 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0384] In an embodiment of the present application, the touch screen can also change the tactile characteristics of the cover by setting an ultrasonic module or an electrostatic module, so as to provide richer tactile feedback, and then use the richer tactile feedback to train users to achieve blind typing on the touch screen, so as to further reduce the difficulty of achieving blind typing on the touch screen.

[0385] Based on the above description, the present application embodiment provides a feedback method that can be applied to the above Figures 1 to 8 For details, please refer to Figure 9 , Figure 9 A schematic flow chart of a feedback method provided in an embodiment of the present application. The feedback method provided in an embodiment of the present application may include:

[0386] 901. The electronic device detects a first contact operation on a touch screen, and in response to the first contact operation, obtains first position information of a first contact point corresponding to the first contact operation.

[0387] In an embodiment of the present application, the electronic device can detect the first contact operation acting on the touch screen in real time. When the electronic device detects the first contact operation input by the user through the touch screen, it can respond to the first contact operation and obtain the number of at least one first contact point on the touch screen collected by the contact sensing module in the touch screen and the first position information of each first contact point. Among them, the at least one first contact point can only include newly added contact points on the touch screen, or can include all contact points on the touch screen. The first position information is established based on the touch screen coordinate system, and the center point of the touch screen, the vertex of the upper left corner, the vertex of the lower left corner, the vertex of the upper right corner, the vertex of the lower right corner, any position point in the touch screen, or other position point can be used as the origin of the coordinate system.

[0388] More specifically, if at least one first contact point can only include newly added contact points on the touch screen, then when the virtual keyboard in the electronic device is in an open state, the touch signal corresponding to each contact point on the touch screen will be continuously detected by the contact sensing module in the touch screen. When the contact signal of a new contact point on the touch screen is detected, the position information of the newly added at least one first contact point is promptly collected. As an example, when the user has just opened a text entry application and called up the virtual keyboard, from the time when the hands have not yet touched the touch screen to the time when the hands are placed in the standard finger position, multiple new first contact points on the touch screen can be obtained. As another example, when the user is typing on the keyboard, when a finger leaves the key position of a virtual key and falls or slides into the key position of another virtual key, multiple new first contact points will appear on the touch screen, and a new first contact point on the touch screen can be obtained. It should be understood that the examples here are only for the convenience of understanding this solution and are not used to limit this solution. Among them, the virtual keyboard in the embodiment of the present application can be expressed as any type of keyboard. As an example, the virtual keyboard can be a full keyboard, a numeric keyboard, a function keyboard, etc., or the virtual keyboard can also be a general term for all operation buttons on the touch screen.

[0389] It should be noted that anti-false touch processing is also required in step 901. Specifically, not only the user's fingers can generate contact points on the touch screen, but the user's palm, forearm, back of the hand or capacitive stylus can also generate contact points on the touch screen. That is, the electronic device can collect touch signals of contact points other than the user's fingers, such as the user's palm, forearm, back of the hand or capacitive stylus, through the contact sensing module of the touch screen. After the processor of the electronic device obtains the touch signals corresponding to each newly added contact point on the touch screen, it needs to perform filtering analysis and filter out the touch signals of the newly added contact points except the touch signals of the newly added contact points triggered by the fingers. That is, the first contact point only includes the newly added contact points triggered by the user's fingers.

[0390] In the embodiment of the present application, since users often focus on the actual keys that are newly touched when using a physical keyboard, this solution only generates feedback for the newly added contact points, which can better simulate the user's experience when using a physical keyboard for input. Since feedback is only generated for the newly added contact points, it is also easier to establish a memory relationship between the user and the newly added contact points, further reducing the difficulty of training blind typing on the touch screen.

[0391] Optionally, the touch screen can also be configured with a proximity sensing module. When the virtual keyboard in the electronic device is turned on, the electronic device senses the movement trajectory of the user's finger above the touch screen through the proximity sensing module in the touch screen and estimates the expected contact point between the finger and the touch screen.

[0392] Optionally, before step 901, the electronic device may further select, in response to the detected first gesture operation, a first type of virtual keyboard corresponding to the first gesture operation from multiple types of virtual keyboards, wherein different types of virtual keyboards in the multiple types of virtual keyboards include different virtual keys; display the first type of virtual keyboard via the touch screen, and during the display of the first type of virtual keyboard, the position of the first type of virtual keyboard on the touch screen is fixed; when the electronic device determines that the first type of virtual keyboard is a virtual keyboard with a fixed display position during the display process, the electronic device will obtain first position information of the first contact point on the touch screen in real time, thereby triggering the process of entering step 901. The concepts of the first gesture operation, multiple types of virtual keyboards, and the specific implementation of the aforementioned steps will be described in the subsequent embodiment 2 and will not be repeated here.

[0393] 902. The electronic device obtains a pressure value corresponding to the first contact point.

[0394] In some embodiments of the present application, when the electronic device receives a first contact operation input by a user via a touch screen, the pressure value corresponding to at least one first contact point on the touch screen may be collected by a pressure sensing module in the touch screen. The pressure value corresponding to the at least one first contact point on the touch screen may include the pressure value of each of the at least one first contact point, or may share a single pressure value for the at least one first contact point.

[0395] Specifically, in one case, if the pressure sensing module in the touch screen is independent, the pressure sensing module can directly collect the pressure value of each first contact point in the at least one first contact point.

[0396] In another case, if the pressure sensing module and the vibration feedback module are integrated into one, and each vibration feedback unit included in the vibration feedback module corresponds one-to-one to a virtual key in the virtual keyboard, the pressure sensing module can also directly collect the pressure value of each first contact point in at least one first contact point.

[0397] In another case, if the pressure sensing module and the vibration feedback module are integrated into one, and the vibration feedback unit and the virtual key are not in a one-to-one correspondence, as an example, for example, the arrangement layout of multiple vibration feedback units is as described above. Figures 4 to 6 The various arrangement layouts shown, that is, multiple vibration feedback units are arranged in a matrix, chess-like arrangement or surround arrangement. The electronic device can obtain the readings of all pressure sensing elements (also called vibration feedback elements) in the pressure sensing module. Furthermore, in one implementation, the electronic device can solve the pressure value of each first contact point (that is, each pressure center point) in at least one first contact point (that is, each pressure center point) according to the coordinate position of each pressure sensing element and the pressure value collected by each pressure sensing unit based on the principle of equal torque.

[0398] In another implementation, the electronic device may also calculate the pressure value of the entire touch screen based on the pressure values collected by all pressure sensing elements, and determine the pressure value of each first contact point in at least one contact point as the pressure value of the entire touch screen.

[0399] 903. The electronic device obtains a first virtual key corresponding to the first contact point according to the first position information of the first contact point.

[0400] In some embodiments of the present application, after obtaining the first position information of each first contact point in at least one first contact point, the electronic device can obtain the first virtual key corresponding to each first contact point one by one; the first virtual key is a virtual key in the virtual keyboard.

[0401] Specifically, the process of obtaining the first virtual key corresponding to the first contact point. Since the electronic device can display one or more types of virtual keyboards, the electronic device can store the position information of each virtual key in each virtual keyboard. The electronic device determines the currently displayed virtual keyboard from the multiple virtual keyboards, obtains the position information of each virtual key in the currently displayed virtual keyboard, and then matches the first position information of the first contact point with the position information of each virtual key in the currently displayed virtual keyboard, thereby determining the first virtual key corresponding to the first contact point. For a more intuitive understanding of this solution, please refer to Figure 10 , Figure 10 Two schematic diagrams of the virtual keyboard in the feedback method provided in the embodiments of the present application. Figure 10(a) shows the Figure 10 The sub-schematic diagram (b) shows two styles of virtual keyboards on the touch screen. Figure 10 The (a) sub-diagram shows a virtual keyboard corresponding to a physical keyboard with 74 keys. Figure 10 The schematic diagram (b) shows an ergonomic keyboard. It should be understood that Figure 10 The examples are only for facilitating understanding of the virtual keyboard in this solution and are not intended to limit this solution.

[0402] As an example, for example, the virtual keyboard currently displayed is an ergonomic keyboard. After the electronic device determines the first position information of the first contact point on the touch screen through the contact sensing module of the touch screen, the first position information is compared with the position information of each virtual key in the ergonomic keyboard, so as to determine that the first contact point is located in the position area of the virtual key K, and then the first virtual key corresponding to the first contact point is determined to be key K. It should be understood that the example here is only for the convenience of understanding this solution and is not used to limit this solution.

[0403] More specifically, in one implementation, since the first contact point can actually appear as a location area, the first location information can describe a location area. The electronic device can take the coordinates of the center point of the first location information, and match the coordinates of the center point of the first location information with the location information of each virtual key in the currently displayed virtual keyboard, thereby determining the first virtual key corresponding to the first contact point.

[0404] In another implementation, the electronic device may also directly match the first position information of the first contact point with the position information of each virtual key in the currently displayed virtual keyboard, and select the first virtual key whose position information has the most intersection with the first position information.

[0405] 904. The electronic device determines whether the contact operation corresponding to the first contact point is a pressing operation or a touch operation based on the pressure value corresponding to the first contact point. If it is a pressing operation, the electronic device proceeds to step 905; if it is a touch operation, the electronic device proceeds to step 908.

[0406] In some embodiments of the present application, the electronic device may be pre-set with a first pressure value threshold and a second pressure value threshold, the first pressure value threshold refers to the threshold for a press operation, and the second pressure value threshold is the threshold for a touch operation. For any one of the at least one first contact points, after obtaining the pressure value corresponding to the first contact point, the electronic device may determine whether the pressure value corresponding to the first contact point is greater than or equal to the first pressure value threshold. If the pressure value corresponding to the first contact point is greater than or equal to the first pressure value threshold, it is determined that the contact operation corresponding to the first contact point is a press operation; if the pressure value corresponding to the first contact point is greater than or equal to the second pressure value threshold and less than the first pressure value threshold, it is determined that the contact operation corresponding to the first contact point is a touch operation; if the pressure value corresponding to the first contact point is less than the second pressure value threshold, it is determined that the contact operation corresponding to the first contact point is an idle operation, and no feedback is given.

[0407] Among them, the value of the first pressure value threshold is greater than the value of the second pressure value threshold. As an example, the value range of the first pressure value threshold can be 50 grams-force to 60 grams-force. As an example, the value of the first pressure value threshold is 55 grams-force, 60 grams-force or other values, and the value range of the second pressure value threshold can be 0 grams-force to 30 grams-force. As an example, the value of the first pressure value threshold is 15 grams-force, 20 grams-force, etc., which is not limited here.

[0408] 905. The electronic device determines whether the first virtual key is an anchor point key. If the first virtual key is an anchor point key, the electronic device proceeds to step 906. If the first virtual key is not an anchor point key, the electronic device proceeds to step 908.

[0409] In an embodiment of the present application, in one case, during the display of the first type of virtual keyboard, the position of the displayed first type of virtual keyboard is fixed; in another case, during the display of the first type of virtual keyboard, the position of the displayed first type of virtual keyboard can be moved.

[0410] If the position of the displayed first type of virtual keyboard is fixed during the display process of the first type of virtual keyboard, then in one implementation, the electronic device may pre-store which keys are anchor point keys and which keys are non-anchor point keys, and step 903 is a required step. After the electronic device determines the first virtual key corresponding to the first contact point through step 903, it can determine whether the first virtual key is an anchor point key. In another implementation, the electronic device may pre-store which position areas on the touch screen are the position areas of the anchor point keys and which position areas on the touch screen are the position areas of the non-anchor point keys, and step 903 is an optional step. The electronic device directly determines whether the position of the first contact point is within the position area of the anchor point key based on the first position information of the first contact point obtained in step 901, that is, whether the first virtual key corresponding to the first position information is an anchor point key.

[0411] If the position of the displayed first type of virtual keyboard can be moved during the display of the first type of virtual keyboard, step 903 is a required step. The electronic device can store the position information of each virtual key in the first type of virtual keyboard. After obtaining the first position information of the first contact point, the first virtual key corresponding to the first contact point is obtained according to the first position information, and then it is determined whether the first virtual key is an anchor point key.

[0412] In an embodiment of the present application, the first virtual key corresponding to the first contact point can be obtained in real time based on the first position information, so that the present solution is not only compatible with virtual keyboards with fixed positions, but also compatible with virtual keyboards with movable positions, thereby expanding the application scenarios of the present solution.

[0413] It should be noted that the meaning of the anchor point key is not the same as the positioning key, that is, the anchor point key refers to the key used to provide a prompt effect to the user. After determining the currently displayed virtual keyboard, which virtual keys are anchor point keys can be pre-configured in the electronic device, that is, which virtual keys are anchor point keys can be pre-fixed; or they can be customized by the user, that is, the user can define which virtual keys are anchor point keys through the "Settings" interface of the electronic device. Furthermore, since the same electronic device can provide multiple different types of virtual keys, the anchor point keys of different types of virtual keys can also be different.

[0414] As an example, the anchor point keys may be the "F" key and the "J" key, or the anchor point keys may also include the space key; as another example, the anchor point keys may also include common function keys and numeric keys such as the ESC key, the Backspace key, the Enter key, and the Ctrl key; as another example, if the virtual keyboard adopts the "DVORAK" layout, the anchor point keys may include the eight standard finger position keys of "AOEUHTNS"; as another example, if the virtual keyboard adopts the "AZERTY" layout, the anchor point keys may also include the eight keys of "QSDFJKLM"; as another example, the anchor point keys may also include the six keys of "AZERTY", etc. The anchor point keys are not enumerated here.

[0415] 906. The electronic device performs a first feedback operation.

[0416] In an embodiment of the present application, when the contact operation corresponding to the first contact point is a pressing operation and the first virtual key is an anchor point key, the electronic device performs a first feedback operation, and the first feedback operation is used to prompt that the first virtual key is an anchor point key.

[0417] Specifically, in one implementation, the first feedback operation may be in the form of vibration feedback. Step 906 may include: the electronic device obtaining a first vibration feedback element from a plurality of vibration feedback elements, the first vibration feedback element being configured in the touch screen, the first vibration feedback element being a vibration feedback element that matches the first virtual key, and vibration feedback elements that match different virtual keys being different; and emitting a first type of vibration wave through the first vibration feedback element to perform the first feedback operation. The vibration wave emitted by the vibration feedback element is non-ultrasonic, and generally has a frequency less than or equal to 500 Hz.

[0418] More specifically, for the process of obtaining the first vibration feedback element that matches the first virtual key. Since the positions of the multiple vibration feedback elements included in the touch screen of the electronic device are fixed when the electronic device leaves the factory, the electronic device can be configured with a first mapping relationship when it leaves the factory. Wherein, in one implementation, the entire touch screen can be divided into multiple position areas, and the first mapping relationship stored in the electronic device includes the corresponding relationship between each position area in the multiple position areas in the touch screen and at least one vibration feedback element. Then, no matter whether the position of the first type of virtual keyboard displayed is fixed during the display process of the first type of virtual keyboard; or whether the position of the first type of virtual keyboard displayed can be moved during the display process of the first type of virtual keyboard, the electronic device can obtain at least one first vibration feedback element that matches the first virtual key (that is, matches the first position information) from the multiple vibration feedback elements according to the first position information and the first mapping relationship obtained in step 901. In the embodiment of the present application, at least one first vibration feedback element matching the first virtual key can be obtained based on the first position information and the first mapping relationship, which is convenient and quick, and is conducive to improving the efficiency of the matching process of the vibration feedback element; and the first mapping relationship can indicate the correspondence between the first position information and the indication of a first vibration feedback element, which is not only compatible with virtual keyboards with fixed positions, but also compatible with virtual keyboards with movable positions, ensuring that vibration feedback can be provided in various scenarios.

[0419] In another implementation, if the position of the displayed first type of virtual keyboard is fixed during the display of the first type of virtual keyboard, the electronic device may be pre-configured with multiple mapping relationships corresponding one-to-one to the multiple virtual keyboards, each mapping relationship including a correspondence between each virtual key in the multiple virtual keys and at least one vibration feedback element. The electronic device then first obtains a first mapping relationship that matches the currently displayed virtual keyboard from the multiple mapping relationships, the first mapping relationship including a correspondence between each virtual key in the currently displayed virtual keyboard and at least one first vibration feedback element. Based on the first mapping relationship and the first virtual key determined in step 903, the electronic device obtains one or more first vibration feedback elements that match the first virtual key.

[0420] In an embodiment of the present application, a first mapping relationship is pre-configured, so that after obtaining the first virtual key, the first mapping relationship can be used to obtain at least one first vibration feedback element matching the first virtual key, which is convenient and quick, and is conducive to improving the efficiency of the matching process of the vibration feedback element; the step of determining the vibration feedback element is split, so that when a fault occurs, it is conducive to accurately locating the fault position.

[0421] In another implementation, the electronic device is preconfigured with position information for each vibration feedback element. Based on the first position information of the first virtual key and the position information of each vibration feedback element in the vibration feedback module, the electronic device determines whether a vibration feedback element for generating a vibration wave is located below the first virtual key. If a vibration feedback element for generating a vibration wave is located below the first virtual key, the electronic device retrieves at least one vibration feedback element located below the first position information. The at least one vibration feedback element located below the first position information refers to a vibration feedback element whose location area intersects with the projection of the first virtual key on the vibration feedback module. If no vibration feedback element for generating a vibration wave is located below the first virtual key, the electronic device searches for a vibration feedback element for generating a vibration wave within a predetermined area, with the coordinates of the center point of the first position information of the first virtual key as the center point. The predetermined area can be circular, square, rectangular, etc., and the size of the predetermined area can be determined based on factors such as the arrangement and layout of the vibration feedback elements and the type of vibration feedback elements used, which are not limited herein.

[0422] Regarding the process of emitting a vibration wave through a first vibration feedback element to perform a first feedback operation, specifically, after the electronic device determines at least one first vibration feedback element that matches the virtual key, the electronic device emits a first type of vibration wave through the at least one first vibration feedback element.

[0423] Optionally, the electronic device may also obtain a position type corresponding to the first contact point based on the first position information of the first contact point. The position types include a first position area where the first contact point is located at the anchor point key and a second position area where the first contact point is located at the anchor point key, where the first position area and the second position area are different; that is, the entire position area of an anchor point key is further divided into a first position area (also referred to as a characteristic area of the anchor point key) and a second position area (also referred to as an edge area of the anchor point key). The division method of the first position area and the second position area may be different in different virtual keys.

[0424] For a more intuitive understanding of this solution, please refer to Figures 11 to 13 , Figures 11 to 13 Four schematic diagrams of the first location area and the second location area in the feedback method provided in an embodiment of the present application. Figure 11 Including four sub-schematic diagrams (a) and (b), Figure 11 The area within the dotted box in the sub-diagram (a) represents the first position area of the virtual key K (which can also be called the characteristic position area of the key K). Figure 11 The area outside the dotted box in the sub-schematic diagram (a) represents the second position area of the virtual key K (which can also be called the edge position area of the key K). Figure 11The area within the dotted box in the sub-schematic diagram (b) represents the first position area of the virtual key J. Figure 11 The area outside the dotted box in the sub-schematic diagram (b) represents the second position area of the virtual key J. Figure 11 The sub-schematic diagram (b) shows a division method of a first position area and a second position area in a virtual key corresponding to a key with a small protrusion in a physical keyboard.

[0425] Please continue reading Figure 12 , Figure 12 The area within the dotted box represents the first position area of the virtual key K. Figure 12 The area outside the dotted box represents the second position area of the virtual key K. Figure 12 and Figure 11 The sub-diagram (a) shows two different ways of dividing the area. Figure 12 The division method is to simulate the concave arc keycaps in a physical keyboard. Figure 13 , Figure 12 The area within the dotted box of the virtual key K represents the first position area of the virtual key K. Figure 12 The area between the two dotted boxes of the virtual key K in FIG. 1 represents the second position area of the virtual key K. Figure 13 and Figure 12 as well as Figure 11 The sub-diagram (a) shows different area division methods. When the virtual key is an anchor point key, the second position area of the virtual key K (also called the edge position area of the virtual key) is extended beyond the edge of the virtual key K, covering the key gap around the virtual key K. This can further enhance the tactile difference of the anchor point key. It should be understood that Figures 11 to 13 The division method of the first position area and the second position area shown in the figure is only for the convenience of understanding the concepts of the first position area and the second position area. In actual situations, the first position area and the second position area can be divided in combination with factors such as the actual application product form and user habits, and no limitation is made here.

[0426] The electronic device can determine the type of vibration wave emitted by the first vibration feedback element based on the position type corresponding to the first contact point. In the case where the first contact point is located in the first position area of the anchor point key, and in the case where the first contact point is located in the second position area of the anchor point key, the type of vibration wave emitted by the electronic device through at least one first vibration feedback element can be different. In the case where the vibration wave emitted by the electronic device through the vibration feedback element is a continuous vibration wave, the difference between the different types of vibration waves includes any one or more of the following characteristics: vibration amplitude, vibration frequency, vibration duration, vibration waveform, or the frequency of the vibration wave emitted by the electronic device in the form of a pulse through the vibration feedback element.

[0427] Furthermore, vibration waves of different vibration amplitudes can be achieved by different trigger voltages. For example, the vibration amplitude of the vibration wave generated when a 300V voltage is input to the vibration feedback element is different from the vibration amplitude of the vibration wave generated when a 400V voltage is input to the vibration feedback distance. The vibration frequency of the vibration wave emitted by the vibration feedback element corresponding to the anchor point button can be between 200 Hz and 400 Hz, such as 240 Hz, 260 Hz, 300 Hz, 350 Hz, 380 Hz or other values, etc., which are not exhaustive here. The vibration duration can be 10 milliseconds, 15 milliseconds, 20 milliseconds, 25 milliseconds, 30 milliseconds, etc. The vibration wave emitted by the vibration feedback element corresponding to the anchor point button can be a single basic waveform or a superposition of multiple different basic waveforms; the aforementioned basic waveform types include but are not limited to square waves, sine waves, sawtooth waves, triangle waves or other types of basic waveforms, etc. As an example, the vibration wave emitted by a first vibration feedback element can be a sine wave generated by a 350V voltage (which determines the vibration amplitude), with a vibration frequency of 290 Hz and a duration of 20 milliseconds. It should be understood that the various examples here are only for the convenience of understanding this solution and are not used to limit this solution.

[0428] Optionally, since there is at least one first vibration feedback element in the touch screen that matches the first virtual key, a second virtual key may also exist in the virtual keyboard. The number of vibration feedback elements corresponding to the second virtual key may be the same as or different from the number of vibration feedback elements corresponding to the first virtual key. In other words, the number of vibration feedback elements corresponding to different virtual keys may be the same or different. For example, the number of vibration feedback elements corresponding to virtual key K may be 3, and the number of vibration feedback elements corresponding to virtual key J may be 2.

[0429] To ensure that the difference between the intensity of the vibration feedback corresponding to the first virtual key and the intensity of the vibration feedback corresponding to the second virtual key is within a preset intensity range, that is, to ensure that the difference in the total intensity of the vibration feedback corresponding to different virtual keys (that is, the intensity of the vibration feedback that the user can perceive) is within a preset intensity range, the electronic device obtains the vibration intensity of the vibration wave corresponding to each first vibration feedback element in the at least one first vibration feedback element, where the vibration intensity of the vibration wave of each first vibration feedback element in the at least one first vibration feedback element is related to a first number, where the first number is the number of vibration feedback elements matched with the first virtual key. Then, based on the vibration intensity of the vibration wave corresponding to each first vibration feedback element, a first type of vibration wave is emitted by each first vibration feedback unit in the at least one first vibration feedback element. The preset intensity range can be an intensity difference within 2%, an intensity difference within 3%, an intensity difference within 4%, an intensity difference within 5%, or other intensity ranges, etc., which are not exhaustive here.

[0430] Specifically, in one implementation, after determining at least one first vibration feedback element matching the first virtual key, the electronic device may directly determine the vibration intensity of the vibration wave corresponding to each first vibration feedback element in the at least one first vibration feedback element based on the number of first vibration feedback elements matching the first virtual key; wherein the electronic device may determine the vibration intensity of the vibration wave of each first vibration feedback element based on a combination of any one or more of the following factors: the number of first vibration feedback elements matching the first virtual key, the distance between each first vibration feedback unit and the center point of the first virtual key, the type of the vibration wave, whether the virtual key is an anchor point key, the position type of the first position information, or other factors.

[0431] In another implementation, a second mapping relationship may be pre-stored in the electronic device. In one case, the second mapping relationship indicates the relationship between the vibration intensities of each first vibration feedback element corresponding to the first position information. The electronic device can then obtain the vibration intensities of each first vibration feedback element based on the first position information and the second mapping relationship obtained in step 901. In another case, the second mapping relationship indicates the relationship between the first virtual key and the vibration intensities of each first vibration feedback element. The electronic device can then obtain the vibration intensities of each first vibration feedback element based on the first virtual key obtained in step 903 and the second mapping relationship.

[0432] Furthermore, in the process of measuring the intensity of the touch screen surface, the probe of the vibration measuring instrument can be attached to the surface of a virtual key (i.e., a detection point) on the touch screen to collect vibration waves from the aforementioned detection point, and then obtain a waveform curve of the collected vibration waves. The aforementioned waveform curve is used to indicate the intensity of the vibration feedback corresponding to the detection point. Furthermore, the difference between the intensity of the vibration feedback corresponding to the first virtual key and the intensity of the vibration feedback corresponding to the second virtual key can be obtained by comparing the difference between the waveform curve measured at the detection point of the first virtual key and the waveform curve of the two areas at the detection point of the second virtual key.

[0433] In the embodiment of the present application, since the number of vibration feedback elements corresponding to different virtual keys may be different, the strength of each vibration feedback element is determined according to the number of matching vibration feedback elements, so that the difference in vibration feedback strength of each virtual key is within a preset range. Since the force feedback given by different keys is basically the same when the user uses the physical keys, the difference between the virtual keyboard and the physical keyboard can be reduced, thereby increasing user stickiness.

[0434] In another implementation, the first feedback operation may be in the form of sound feedback, and step 907 may include: the electronic device emits a first prompt sound, and the first prompt sound may be a sound such as "di beep", "beep", or "du du". The specific forms of the first prompt sound are not exhaustively listed here.

[0435] Optionally, the electronic device may further obtain a location type corresponding to the first contact point based on the first location information of the first contact point; and the electronic device may emit different prompt sounds when the first contact point is located in the first location area of the anchor point button and when the first contact point is located in the second location area of the anchor point button. For example, when the first contact point is located in the first location area of the anchor point button, the electronic device may emit a "beep" prompt sound, and when the first contact point is located in the second location area of the anchor point button, the electronic device may emit a "beep" prompt sound.

[0436] Electronic devices can also use other types of feedback methods in addition to sound feedback and vibration feedback. The specific type of feedback method to be used can be determined based on the actual product form and the actual application scenario of the product. This is not an exhaustive list.

[0437] 907. The electronic device performs a second feedback operation.

[0438] In some embodiments of the present application, when the contact operation corresponding to the first contact point is a press operation and the first virtual key is not an anchor point key, the electronic device can perform a second feedback operation, the second feedback operation is used to prompt that the first virtual key is a non-anchor point key, and the first feedback operation and the second feedback operation are different feedback operations. In the embodiments of the present application, the feedback operation is performed not only when the first virtual key is an anchor point key, but also when the first virtual key is a non-anchor point key. The first feedback operation and the second feedback operation are different feedback operations. Since when the user uses a physical keyboard, each key will give the user feedback, the aforementioned method can increase the similarity between the virtual keyboard and the physical keyboard, and different feedback operations are given to anchor point keys and non-anchor point keys, which can also help users remember different types of keys to assist users in blind typing on the virtual keyboard.

[0439] In one implementation, the second feedback operation may be in the form of vibration feedback, and step 907 may include: the electronic device obtains a first vibration feedback element that matches the first virtual key, and the first vibration feedback element is configured in the touch screen; and the second type of vibration wave is emitted by the first vibration feedback element to perform the second feedback operation. The difference between the first type of vibration wave and the second type of vibration wave includes any one or more of the following characteristics: vibration amplitude, vibration frequency, vibration duration, and vibration waveform. In an embodiment of the present application, a specific method for distinguishing different types of vibration waves is provided, and different types of vibration waves can be distinguished by aspects such as vibration amplitude, vibration frequency, vibration duration and / or vibration waveform, thereby improving the implementation flexibility of the present solution.

[0440] Specifically, the specific implementation method of the electronic device obtaining the first vibration feedback element matching the first virtual key can be found in the description of the above step 906, which is not repeated here.

[0441] Regarding the process of emitting a vibration wave through a first vibration feedback element to perform a second feedback operation, specifically, after the electronic device determines at least one first vibration feedback element that matches the virtual key, the electronic device emits a second type of vibration wave through the at least one first vibration feedback element.

[0442] Optionally, when the first virtual key is not an anchor point key, the electronic device may also obtain the position type corresponding to the first contact point based on the first position information of the first contact point, the position type including the first position area where the first contact point is located in the non-anchor point key and the second position area where the first contact point is located in the non-anchor point key, and the first position area and the second position area are different; that is, the entire position area of a non-anchor point key is further divided into a first position area (also called a characteristic area of the non-anchor point key) and a second position area (also called an edge area of the non-anchor point key), and the division method of the first position area and the second position area may be different in different virtual keys.

[0443] The electronic device may determine the type of vibration wave emitted by the first vibration feedback element based on the position type corresponding to the first contact point. When the first contact point is located in a first position area of a non-anchor point key, and when the first contact point is located in a second position area of a non-anchor point key, the type of vibration wave emitted by the electronic device through at least one first vibration feedback element may be different.

[0444] Further, in one case, the type of vibration wave corresponding to the first position area of the anchor point key is the same as the type of vibration wave corresponding to the first position area of the non-anchor point key, and the type of vibration wave corresponding to the second position area of the anchor point key is different from the type of vibration wave corresponding to the second position area of the non-anchor point key.

[0445] In another case, the type of vibration wave corresponding to the first position area of the anchor point key is different from the type of vibration wave corresponding to the first position area of the non-anchor point key, and the type of vibration wave corresponding to the second position area of the anchor point key is the same as the type of vibration wave corresponding to the second position area of the non-anchor point key.

[0446] In another case, the type of vibration wave corresponding to the first position area of the anchor point key is different from the type of vibration wave corresponding to the first position area of the non-anchor point key, and the type of vibration wave corresponding to the second position area of the anchor point key is different from the type of vibration wave corresponding to the second position area of the non-anchor point key.

[0447] In an embodiment of the present application, all position areas of anchor point keys and / or non-anchor point keys are divided into a first position area and a second position area. In the two cases where the first contact point is located in the first position area and the first contact point is located in the second position area, the types of vibration waves emitted by the electronic device through at least one first vibration feedback element are different, which is conducive to helping the user remember the boundaries of the virtual keys, that is, it is conducive to assisting the user to establish muscle memory for different areas of the virtual keys, so as to further reduce the difficulty of blind typing on the touch screen.

[0448] In another implementation, the second feedback operation may be in the form of sound feedback, and step 907 may include: the electronic device emits a second prompt tone, and the second prompt tone and the first prompt tone are different prompt tones.

[0449] Optionally, the electronic device can also obtain the position type corresponding to the first contact point based on the first position information of the first contact point; when the first contact point is located in the first position area of the non-anchor point key, and when the first contact point is located in the second position area of the non-anchor point key, the electronic device emits different prompt sounds.

[0450] It should be noted that step 907 is an optional step and may not be performed. That is, when the electronic device determines that the first virtual key is not an anchor point key, no feedback may be performed.

[0451] 908. The electronic device determines whether the first virtual key is an anchor point key. If the first virtual key is an anchor point key, the electronic device proceeds to step 909; if the first virtual key is not an anchor point key, the electronic device proceeds to step 910.

[0452] In the embodiment of the present application, the specific implementation method of step 908 can refer to the above description of step 905 and will not be repeated here.

[0453] 909. The electronic device changes the tactile characteristics of the first contact point on the touch screen to present a first tactile state.

[0454] In some embodiments of the present application, when the contact operation corresponding to the first contact point is a touch operation and the first virtual key is an anchor point key, the electronic device changes the tactile characteristics of the first contact point in the cover of the touch screen to present a first tactile state. The tactile characteristics of the cover of the touch screen include any one or more of the following characteristics: sliding friction coefficient, stick-slip properties, temperature, and other types of tactile characteristics. The electronic device can change the entire cover of the touch screen to the first tactile state to achieve the change of the first contact point in the cover of the touch screen to the first tactile state; or it can change only the first contact point in the cover of the touch screen to the first tactile state without changing the tactile states of other areas in the cover of the touch screen.

[0455] Specifically, in one implementation, if an electronic device's touch screen is integrated with an ultrasonic module, the electronic device can change the tactile characteristics of a first contact point on the touch screen's cover plate by emitting ultrasonic waves through the ultrasonic module in the touch screen. The electronic device can then emit different types of ultrasonic waves through the ultrasonic module to cause the first contact point on the touch screen's cover plate to exhibit different tactile characteristics. If the electronic device emits a single ultrasonic wave through the ultrasonic module, the differences between the different types of ultrasonic waves include any one or more of the following characteristics: vibration amplitude, vibration frequency, vibration duration, or vibration waveform. Furthermore, the frequency of the ultrasonic wave emitted by the ultrasonic module is greater than 20 kHz, and can specifically be 21 kHz, 22 kHz, 24 kHz, 25 kHz, or other values, without limitation. If the electronic device emits pulse waves through the ultrasonic module, the differences between the different types of ultrasonic waves include any one or more of the following characteristics: vibration amplitude, vibration frequency, vibration duration, vibration waveform, or the frequency of the pulse waves emitted by the electronic device. The frequency of the pulse waves emitted by the electronic device can also be referred to as the rhythm of the pulse waves emitted by the electronic device. As an example, for example, an electronic device emits a pulse of ultrasonic waves every 3 milliseconds through an ultrasonic module, and an electronic device emits a pulse of ultrasonic waves every 10 milliseconds through an ultrasonic module. In the above two cases, the frequencies of the pulse waves emitted by the electronic device are different. It should be understood that the examples here are only for the convenience of understanding this solution and are not used to limit this solution.

[0456] Then step 909 may include: the electronic device obtains a third type of ultrasonic wave corresponding to the anchor point button, and emits the third type of ultrasonic wave through the ultrasonic module in the touch screen to change the tactile characteristics of the first contact point on the touch screen to the first tactile state.

[0457] Optionally, when the contact operation corresponding to the first contact point is a touch operation and the first virtual key is an anchor point key, the electronic device may also obtain the position type corresponding to the first contact point based on the first position information of the first contact point. The electronic device may also determine the type of ultrasonic wave corresponding to the first position information based on the position type corresponding to the first contact point, and then emit the aforementioned type of ultrasonic wave through the ultrasonic module in the touch screen. In particular, when the first contact point is located in the first position area of the anchor point key, and when the first contact point is located in the second position area of the anchor point key, the type of ultrasonic wave emitted by the electronic device through the ultrasonic module may be different.

[0458] In another implementation, if an electrostatic module is integrated into the touch screen of an electronic device, the electronic device can change the tactile characteristics of a first contact point on the cover plate of the touch screen by generating static electricity through the electrostatic module in the touch screen. The electronic device can then generate static electricity of varying magnitudes through the electrostatic module to cause the first contact point on the cover plate of the touch screen to exhibit different tactile characteristics. The volt value of the static electricity generated by the electrostatic module can range from 100 volts to 400 volts. For example, the volt value of the static electricity generated by the electrostatic module can be 120 volts, 200 volts, 380 volts, or other values, which are not limited here.

[0459] Then step 909 may include: the electronic device obtains a first volt value of static electricity corresponding to the anchor point button, and emits static electricity of the first volt value through the electrostatic module in the touch screen to change the tactile characteristics of the first contact point on the touch screen to a first tactile state.

[0460] Optionally, when the contact operation corresponding to the first contact point is a touch operation and the first virtual key is an anchor point key, the electronic device may also obtain the position type corresponding to the first contact point based on the first position information of the first contact point. Based on the position type corresponding to the first contact point, the volt value of the current corresponding to the first position information is determined, and then the current module in the touch screen emits a current of the aforementioned volt value. The volt value of the current emitted by the electronic device through the current module may be different when the first contact point is located in the first position area of the anchor point key and when the first contact point is located in the second position area of the anchor point key.

[0461] It should be noted that the electronic device can also change the tactile characteristics of the cover plate in the touch screen through other methods, which are not listed here one by one.

[0462] 910. The electronic device changes the tactile characteristics of the first contact point on the touch screen to present a second tactile state.

[0463] In some embodiments of the present application, when the contact operation corresponding to the first contact point is a touch operation and the first virtual key is a non-anchor point key, the electronic device changes the tactile characteristics of the first contact point in the cover of the touch screen to present a second tactile state. The tactile characteristics when the touch screen presents the first tactile state may be different from the tactile characteristics when the touch screen presents the second tactile state, that is, the feeling when the user touches the anchor point key may be different from the feeling when the user touches the non-anchor point key, so as to further assist the user in distinguishing between the anchor point keys and the non-anchor point keys on the virtual keyboard, so as to further assist the user in locating the virtual keys in the virtual keyboard.

[0464] Specifically, in one implementation, if an ultrasonic module is integrated into the touch screen of the electronic device, the electronic device changes the tactile characteristics of a first contact point on the cover of the touch screen by emitting ultrasonic waves through the ultrasonic module in the touch screen. Step 910 may include: the electronic device obtaining a fourth type of ultrasonic wave corresponding to a non-anchor point button, and emitting the fourth type of ultrasonic wave through the ultrasonic module in the touch screen to change the tactile characteristics of the first contact point on the touch screen to a second tactile state.

[0465] Optionally, when the contact operation corresponding to the first contact point is a touch operation and the first virtual key is a non-anchor point key, the electronic device may also obtain the position type corresponding to the first contact point. Based on the position type corresponding to the first contact point, the type of ultrasonic wave corresponding to the first position information is determined. Specifically, when the first contact point is located in the first position area of the non-anchor point key, and when the first contact point is located in the second position area of the non-anchor point key, the type of ultrasonic wave emitted by the electronic device through the ultrasonic module may be different.

[0466] In another implementation, if the touch screen of the electronic device is integrated with an electrostatic module, the electronic device changes the tactile characteristics of the first contact point on the cover of the touch screen by emitting static electricity through the electrostatic module in the touch screen. Step 909 may include: the electronic device obtaining a second volt value of the static electricity corresponding to the anchor point button, and emitting static electricity of the second volt value through the electrostatic module in the touch screen to change the tactile characteristics of the first contact point on the touch screen to a second tactile state.

[0467] Optionally, when the contact operation corresponding to the first contact point is a touch operation and the first virtual key is an anchor point key, the electronic device may also obtain the position type corresponding to the first contact point. Based on the position type corresponding to the first contact point, the volt value of the current corresponding to the first position information is determined. The volt value of the current emitted by the electronic device through the current module may be different when the first contact point is located in the first position region of a non-anchor point key and when the first contact point is located in the second position region of a non-anchor point key.

[0468] It should be noted that step 908 is an optional step. If step 908 is not executed, steps 909 and 910 can be merged. That is, when the contact operation corresponding to the first contact point is a touch operation, regardless of whether the first virtual key is an anchor point key or a non-anchor point key, the tactile characteristics of the first contact point on the touch screen can be presented as the same tactile state.

[0469] In addition, steps 908 to 910 are optional steps. After the electronic device determines that the contact operation corresponding to the first contact point is not a pressing operation, it may not provide any feedback. That is, when the pressure value corresponding to the first contact point is less than the first pressure value threshold, the electronic device may not provide any feedback.

[0470] In an embodiment of the present application, when a user touches an anchor point key on a virtual key, a first feedback operation is performed through the touch screen to prompt the user that the anchor point key is currently being touched. This allows the user to perceive the location of the anchor point key, thereby reducing the difficulty of blind typing on the touch screen. In addition, the touch screen is configured with multiple vibration feedback elements. When the first virtual key is determined to be the anchor point key, at least one first vibration feedback element that matches the first virtual key is obtained from the multiple vibration feedback elements, and the at least one first vibration feedback element is instructed to emit a vibration wave. This can achieve the effect of generating vibration feedback only around the first virtual key, that is, not vibrating the entire screen. Since all fingers are placed on the touch screen when typing, if the entire screen is vibrated, all fingers will feel the vibration, which can easily confuse the user. However, generating the vibration feedback effect only around the first virtual key is less likely to confuse the user and more easily helps the user form muscle memory in their fingers, thereby assisting the user in blind typing on the touch screen.

[0471] exist Figures 1 to 13 On the basis of the corresponding embodiment, in order to better implement the above solution of the embodiment of the present application, the following also provides related equipment for implementing the above solution. Figure 14 , Figure 14 A structural diagram of an electronic device provided in an embodiment of the present application. The electronic device 1 includes a touch screen 20, a memory 40, one or more processors 10, and one or more programs 401. The touch screen 20 is configured with multiple vibration feedback elements. The one or more programs 401 are stored in the memory 40. When the one or more processors 10 execute the one or more programs 401, the electronic device performs the following steps: detecting a first contact operation on the touch screen 20; in response to the first contact operation, obtaining first position information of a first contact point corresponding to the first contact operation, the first position information corresponding to a first virtual key on a virtual keyboard; when the first virtual key is an anchor point key, obtaining a first vibration feedback element from multiple vibration feedback elements, the first vibration feedback element being a vibration feedback element that matches the first virtual key; and instructing the first vibration feedback element to emit a vibration wave to perform a first feedback operation, the first feedback operation being used to indicate that the first virtual key is an anchor point key.

[0472] In one possible design, a first mapping relationship is configured in the electronic device 1, and the first mapping relationship indicates the correspondence between the virtual key and the vibration feedback element. When one or more processors 10 execute one or more programs 401, the electronic device 1 specifically performs the following steps: obtaining the first vibration feedback element according to the first mapping relationship and the first virtual key.

[0473] In one possible design, a first mapping relationship is configured in the electronic device 1, and the first mapping relationship indicates the correspondence between the position information and the vibration feedback element. When one or more processors 10 execute one or more programs 401, the electronic device 1 specifically performs the following steps: obtaining the first vibration feedback element according to the first mapping relationship and the first position information.

[0474] In one possible design, when executing one or more programs 401, one or more processors 10 cause the electronic device 1 to further perform the following steps: obtaining the vibration intensity of the vibration wave corresponding to each first vibration feedback element in at least one first vibration feedback element, the vibration intensity of the vibration wave of each first vibration feedback element in at least one first vibration feedback element being related to a first quantity, where the first quantity is the number of first vibration feedback elements. When executing one or more programs 401, one or more processors 10 cause the electronic device 1 to specifically perform the following steps: emitting a vibration wave through at least one first vibration feedback element based on the vibration intensity of the vibration wave corresponding to each first vibration feedback element, so that the difference between the intensity of the vibration feedback corresponding to the first virtual key and the intensity of the vibration feedback corresponding to the second virtual key is within a preset intensity range, and the second virtual key and the first virtual key are different virtual keys.

[0475] In a possible design, the first vibration feedback element is any one of the following: a piezoelectric ceramic piece, a linear motor, or a piezoelectric film.

[0476] In one possible design, when one or more processors 10 execute one or more programs 401, the electronic device 1 further executes the following steps: based on the first position information, obtain a position type corresponding to the first contact point, where the position types include the first contact point being located in a first position area of the first virtual key and the first contact point being located in a second position area of the first virtual key, where the first position area and the second position area are different. When one or more processors 10 execute one or more programs 401, the electronic device 1 specifically executes the following steps: based on the position type corresponding to the first contact point, perform a first feedback operation through the touch screen 20, where the feedback operation corresponding to the first position area is different from the feedback operation corresponding to the second position area.

[0477] In one possible design, when executing one or more programs 401, the one or more processors 10 cause the electronic device 1 to further perform the following steps: in response to a detected first gesture operation, select a first type of virtual keyboard corresponding to the first gesture operation from multiple types of virtual keyboards, wherein different types of virtual keyboards in the multiple types of virtual keyboards include different virtual keys; and display the first type of virtual keyboard via the touch screen 20, wherein the position of the first type of virtual keyboard on the touch screen 20 is fixed during the display of the first type of virtual keyboard. When executing the one or more programs 401, the one or more processors 10 cause the electronic device 1 to specifically perform the following steps: during the display of the first type of virtual keyboard, detect a first contact operation on the touch screen 20.

[0478] It should be noted that the information interaction, execution process, etc. between the modules / components in the electronic device 1 are the same as those in the present application. Figures 9 to 13 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.

[0479] The present application also provides an electronic device. Figure 15 , Figure 15 This is a structural diagram of an electronic device provided in an embodiment of the present application. The electronic device 1 can be specifically a mobile phone, a tablet, a laptop or other device equipped with a touch screen, etc., which is not limited here. Figures 1 to 8 The electronic device described in the corresponding embodiment is used to implement Figures 9 to 13 Functions of electronic devices in corresponding embodiments. Specifically, the electronic device 1 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 1522 (for example, one or more processors) and a memory 40, and one or more storage media 1530 (for example, one or more mass storage devices) storing application programs 1542 or data 1544. Among them, the memory 40 and the storage medium 1530 can be short-term storage or persistent storage. The program stored in the storage medium 1530 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the electronic device. Furthermore, the central processing unit 1522 can be configured to communicate with the storage medium 1530 to execute a series of instruction operations in the storage medium 1530 on the electronic device 1.

[0480] The electronic device 1 may also include one or more power supplies 1526, one or more wired or wireless network interfaces 1550, one or more input and output interfaces 1558, and / or one or more operating systems 1541, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

[0481] In the embodiment of the present application, the central processing unit 1522 is used to implement Figures 9 to 13 The functions of the electronic device in the corresponding embodiment. It should be noted that the CPU 1522 executes Figures 9 to 13 The specific implementation of the functions of the electronic device in the corresponding embodiment and the beneficial effects brought about can be referred to Figures 9 to 13 The descriptions in the corresponding method embodiments will not be repeated here one by one.

[0482] The present application also provides a computer-readable storage medium in which a program for generating a vehicle speed is stored. When the program is run on a computer, the computer executes the above-mentioned Figures 9 to 13 The illustrated embodiment describes the steps performed by the electronic device in the method.

[0483] The present application also provides a computer program which, when executed on a computer, enables the computer to execute the aforementioned Figures 9 to 13 The illustrated embodiment describes the steps performed by the electronic device in the method.

[0484] The present application also provides a circuit system in an embodiment, wherein the circuit system includes a processing circuit, wherein the processing circuit is configured to perform the aforementioned Figures 9 to 13 The illustrated embodiment describes the steps performed by the electronic device in the method.

[0485] The electronic device provided in the embodiment of the present application may be a chip, which includes: a processing unit and a communication unit. The processing unit may be, for example, a processor, and the communication unit may be, for example, an input / output interface, a pin, or a circuit. The processing unit may execute the computer-executable instructions stored in the storage unit to enable the chip to execute the aforementioned Figures 9 to 13 The steps performed by the electronic device in the method described in the illustrated embodiment. Optionally, the storage unit is a storage unit within the chip, such as a register, a cache, etc. The storage unit may also be a storage unit located outside the chip within the wireless access device, such as a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM), etc.

[0486] The processor mentioned in any of the above places can be a general-purpose central processing unit, a microprocessor, an ASIC, or one or more integrated circuits for controlling the execution of the program of the above-mentioned first aspect method.

[0487] It should also be noted that the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment. In addition, in the drawings of the device embodiments provided in this application, the connection relationship between the modules indicates that there is a communication connection between them, which can be specifically implemented as one or more communication buses or signal lines.

[0488] Through the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus necessary general-purpose hardware, and of course can also be implemented by dedicated hardware including application-specific integrated circuits, dedicated CLUs, dedicated memories, dedicated components, etc. In general, all functions performed by computer programs can be easily implemented with corresponding hardware, and the specific hardware structures used to implement the same function can also be diverse, such as analog circuits, digital circuits, or dedicated circuits. However, for the present application, software program implementation is a better implementation method in most cases. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer's floppy disk, USB flash drive, mobile hard disk, ROM, RAM, disk or optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0489] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program.

[0490] The computer program includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, a computer, a server, or a data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode to another website, a computer, a server, or a data center. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium can be a magnetic medium, (such as a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid-state drive (SSD)).

[0491] Example 2:

[0492] The embodiments of the present application can be applied to various application scenarios that require input through a virtual keyboard. As an example, in an application for text editing, it is necessary to input text, numbers, characters and other contents through a virtual keyboard; as another example, in an application for making document files (power point, PPT), it is also necessary to input text, numbers, characters and other contents through a virtual keyboard; as another example, in a game application, it is also necessary to use a virtual keyboard to perform operations such as moving virtual characters, modifying character names, and instant messaging with game friends, etc. It should be understood that the embodiments of the present application can also be applied to other application scenarios in which input is performed through a virtual keyboard, which are not exhaustively listed here. In all of the aforementioned scenarios, there is a problem that the number of keys on the virtual keyboard is limited, and an additional physical keyboard needs to be provided to meet the user's input needs.

[0493] In order to solve the above problems, the present invention provides a method for processing a virtual keyboard. Figure 16 In the electronic device shown, multiple types of virtual keyboards are configured in the electronic device. Users can input different types of gesture operations to call up different types of virtual keyboards. That is, the virtual keyboard is no longer limited to displaying only 26 letters, but more virtual keys are provided to the user through different types of virtual keyboards. This not only improves the user's flexibility in the process of calling up the virtual keyboard, but also facilitates the provision of richer virtual keys, thereby eliminating the need to provide an additional physical keyboard.

[0494] See also Figure 16 , Figure 16 A schematic diagram of an electronic device provided in an embodiment of the present application. In some application scenarios, such as Figure 2 As shown, the electronic device 1 includes at least one display screen, which is a touch screen (i.e. Figure 2 If the touch screen 20 is used, the electronic device 1 can obtain various types of gesture operations input by the user through the display screen and display various types of virtual keyboards through the display screen.

[0495] In other application scenarios, such as Figure 16 As shown, the electronic device 2 can be a virtual reality device such as VR, AR or MR. The electronic device 2 collects various types of gesture operations of the user through a camera configured on the head display device, and displays various types of virtual keyboards to the user through the head display device.

[0496] In conjunction with the above description, please refer to Figure 17 , Figure 17 A flowchart of a method for processing a virtual keyboard provided in an embodiment of the present application is provided. The method for processing a virtual keyboard provided in an embodiment of the present application may include:

[0497] 1701. The electronic device detects a first gesture operation and obtains a first gesture parameter corresponding to the first gesture operation.

[0498] In an embodiment of the present application, the electronic device can detect in real time whether the user inputs a gesture operation, and when the electronic device detects a first gesture operation input by the user, it generates a first gesture parameter corresponding to the first gesture operation. Specifically, in some application scenarios, the electronic device is configured with a touch screen, and the electronic device obtains the first gesture operation input by the user in real time through the touch screen. In other application scenarios, the electronic device can capture the first gesture operation input by the user through a camera configured on a head-mounted display device, and then generate a first gesture parameter corresponding to the first gesture operation. In this application scenario, the electronic device can be a virtual reality device such as VR, AR or MR, which is not limited here.

[0499] If the first gesture operation is obtained through a display screen configured by an electronic device, the first gesture parameter includes any one or more of the following parameters: position information of the contact point corresponding to the first gesture operation, number information of the contact points corresponding to the first gesture operation, area information of the contact points corresponding to the first gesture operation, or other types of parameter information. In an embodiment of the present application, it is described what information is included in the first gesture parameter. The first gesture parameter includes not only the position information of each contact point and the number information of multiple contact points, but also the area information of each contact point. The area information of the contact point can distinguish the contact point triggered by the palm from multiple contact points, which is conducive to accurately estimating the type of the first gesture operation, avoiding the display of an erroneous virtual keyboard, and improving the accuracy of the virtual keyboard display process.

[0500] Furthermore, the position information of the contact point corresponding to the first gesture operation can be represented by coordinate information, function or other information. The origin of the coordinate system corresponding to the aforementioned position information can be the center point of the display screen, the upper left corner vertex of the display screen, the lower left corner vertex of the display screen, the upper right corner vertex of the display screen, the lower right corner vertex of the display screen or other position points, etc. The setting of the specific coordinate system origin can be determined in combination with the actual application scenario.

[0501] Specifically, the display screen of the electronic device may be a touch screen, and the touch screen may be configured with a contact sensing module. The electronic device collects the first gesture parameter corresponding to the first gesture operation through the contact sensing module configured in the display screen. For a more intuitive understanding of this solution, please refer to Figure 18 , Figure 18 A schematic diagram of a first gesture parameter in the virtual keyboard processing method provided in an embodiment of the present application. Figure 18 Taking the first gesture operation as a one-hand operation as an example, as shown in the figure, 4 contact points can be obtained on the display screen. Among the 4 contact points, the areas of 3 contact points generated by fingers are relatively small, and the remaining contact point generated by the palm has a larger area. It should be understood that Figure 18 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0502] If the electronic device is a virtual reality device, the virtual keyboard may be visually presented in a three-dimensional space. The electronic device may detect gesture operations in the space in real time, and when a first gesture operation is detected, obtain a first gesture parameter corresponding to the first gesture operation.

[0503] Specifically, in one scenario, the electronic device may track the user's hand in real time via a handheld device or a hand-worn device to monitor the user's first gesture operation. In another scenario, the electronic device includes a head-mounted display (HMD), the first gesture operation is captured by a camera configured in the HMD, the first gesture parameter may be specifically represented by an image corresponding to the first gesture operation, and the electronic device may input the image corresponding to the first gesture operation into a neural network for image recognition to generate first gesture parameters corresponding to the first gesture operation.

[0504] 1702. The electronic device generates first indication information according to the first gesture parameter information.

[0505] In an embodiment of the present application, after the electronic device collects the first gesture parameter corresponding to the first gesture operation, it can also perform secondary processing based on the acquired first gesture parameter to generate first indication information corresponding to the first gesture parameter. The first indication information can also be regarded as a gesture parameter obtained after secondary processing. Among them, the first indication information includes any one or more of the following (that is, the first gesture parameter indicates any one or more of the following): the relative angle information of the hand corresponding to the first gesture operation, the position information of the hand corresponding to the first gesture operation, the number information of the hands corresponding to the first gesture operation, and the shape information of the hand corresponding to the first gesture operation, etc. The specific types of information that can be included in the first indication information can be flexibly set in combination with the actual application scenario, and are not limited here. In an embodiment of the present application, after the acquired first gesture parameter is subjected to secondary processing, information such as the relative angle information of the hand, the position information of the hand, the number information of the hand, or the shape information of the hand can be obtained. That is, based on the first gesture parameter, more abundant information about the first gesture operation can be obtained, thereby increasing the flexibility of the virtual keyboard matching process.

[0506] Specifically, in some application scenarios, if the first gesture parameter is collected through the display screen of an electronic device, the relative angle information of the hand corresponding to the first gesture operation may include any one or more of the following: the relative angle between the hand corresponding to the first gesture operation and any edge of the display screen, the relative angle between the hand corresponding to the first gesture operation and the center line of the display screen, the relative angle between the hand corresponding to the first gesture operation and the diagonal of the display screen, etc., which are not limited here.

[0507] More specifically, if the electronic device determines that the first gesture operation is a single-hand operation (that is, the number of hands corresponding to the first gesture operation is 1), the electronic device obtains at least two first contact points (that is, contact points generated based on fingers) from the multiple contact points corresponding to the first gesture operation, connects the at least two first contact points, or connects the two first contact points that are farthest apart from each other among the at least two first contact points to generate a straight line corresponding to the first gesture operation, and then calculates the relative angle between the aforementioned straight line and a preset line, which preset line includes any one or more of the following: any edge of the display screen, the center line of the display screen, the diagonal line of the display screen, etc., to obtain the relative angle information of the hand corresponding to the first gesture operation.

[0508] If the electronic device determines that the first gesture operation is a two-hand operation (that is, the number of hands corresponding to the first gesture operation is 2), the electronic device obtains at least two first contact points from the multiple contact points corresponding to the first gesture operation, and connects the at least two first contact points corresponding to the left hand, or connects the two first contact points that are farthest apart from each other among the at least two first contact points corresponding to the left hand to generate a first straight line corresponding to the left hand; connects the at least two first contact points corresponding to the right hand, or connects the two first contact points that are farthest apart from each other among the at least two first contact points corresponding to the right hand to generate a second straight line corresponding to the right hand, and then calculates the first sub-angle between the first straight line and the preset line, and calculates the second sub-angle between the second straight line and the preset line, to obtain the relative angle information of the hand corresponding to the first gesture operation.

[0509] For a more intuitive understanding of this solution, please refer to Figure 19 , Figure 19 A schematic diagram of relative angle information in the virtual keyboard processing method provided in an embodiment of the present application. Figure 19 Take the first gesture operation as an example, Figure 19 Including two sub-schematic diagrams (a) and (b), Figure 19 The sub-schematic diagram (a) shows the positions of the contact points corresponding to the two-hand operation. Figure 19 In the sub-diagram (b), the preset line is taken as the bottom edge of the display screen. The two contact points with the farthest distance from each other among the four contact points corresponding to the left hand are connected to generate a first straight line, and the two contact points with the farthest distance from each other among the four contact points corresponding to the right hand are connected to generate a second straight line, thereby obtaining the first sub-angle and the second sub-angle. It should be understood that Figure 19 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0510] The process of determining the position information of the hand. The electronic device first determines the number of hands corresponding to the first gesture operation based on the first gesture parameter obtained. If the first gesture operation is a two-hand operation, the position of the hand corresponding to the first gesture operation includes the distance between the two hands; if the first gesture operation is a one-hand operation, the position of the hand corresponding to the first gesture operation includes the first area and the fourth area. The first area is located at the lower left or lower right of the display screen, and the fourth area is the area of the display panel excluding the first area; further, the width of the first area can be a value such as 3 cm, 4 cm or 5 cm, and the bottom edge of the first area coincides with the bottom edge of the display screen. For a more intuitive understanding of this solution, please refer to Figure 20 , Figure 20 Two schematic diagrams of the first area in the virtual keyboard processing method provided in an embodiment of the present application. Figure 20 (a) Sub-diagram and Figure 20 (b) The sub-schematic diagrams respectively show two schematic diagrams of the first region. It should be understood that Figure 20 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0511] When the first gesture operation is a two-hand operation, the electronic device can determine the distance between the left index finger and the right index finger as the distance between the two hands; it can also determine the shortest distance between the left hand and the right hand as the distance between the two hands; it can also generate the shapes of the left hand and the right hand based on multiple contact points, and then generate the distance between the left hand boundary and the right hand boundary, etc. The methods for determining the distance between the two hands are not exhaustively listed here.

[0512] If the first gesture operation is a one-hand operation, the electronic device selects multiple first contact points from the multiple contact points corresponding to the first gesture operation based on the first gesture parameter corresponding to the first gesture operation, and determines the position of the hand corresponding to the first gesture operation based on the positions of the multiple first contact points. In one implementation, if all of the at least one first contact point are located within the first area, the position of the hand is determined to be the first area; if there is a first contact point outside the first area among the at least one first contact point, the position of the hand is determined to be the fourth area. In another implementation, if there is a first contact point located within the first area among the at least one first contact point, the position of the hand is determined to be the first area; if all of the at least one first contact point are located in the fourth area, the position of the hand is determined to be the fourth area.

[0513] Process for determining the number of hands. The first gesture operation acquired by the electronic device can be a single-hand operation or a two-hand operation. The electronic device can determine the number of hands corresponding to the first gesture parameter based on the number of contact points and the position information of the contact points. In one implementation, the electronic device determines whether the number of multiple contact points is greater than or equal to a first value, and there are two contact points with a distance greater than a second distance threshold among the multiple contact points. If the number of multiple contact points is greater than the first value, and there are two contact points with a distance greater than the second distance threshold among the multiple contact points, then the number of hands corresponding to the first gesture operation is determined to be 2; if the number of multiple contact points is less than the first value, or there are no two contact points with a distance greater than the second distance threshold among the multiple contact points, then the number of hands corresponding to the first gesture operation is determined to be 1. Among them, the value of the first numerical value can be 2, 3, 4, 5 or other numerical values, and the value of the first numerical value can also be customized by the user; the value of the second distance threshold can be 22 mm, 25 mm, 26 mm or other numerical values, and the value of the second distance threshold can also be customized by the user. The specific value of the second distance threshold can be determined in combination with factors such as the size of the display screen and the size of the user's hand, and is not limited here.

[0514] In another implementation, the electronic device determines whether a first subset and a second subset exist among the multiple contact points. If the first subset and the second subset exist, the electronic device determines that the number of hands corresponding to the first gesture operation is 2; if the first subset or the second subset does not exist, the electronic device determines that the number of hands corresponding to the first gesture operation is 1. The number of contact points included in the first subset and the second subset is both greater than or equal to a first value, the distance between any two contact points in the first subset is less than a second distance threshold, the distance between any two contact points in the second subset is less than the second distance threshold, and the distance between any contact point in the first subset and any contact point in the second subset is greater than or equal to the second distance threshold.

[0515] For a more intuitive understanding of this solution, please refer to Figure 21 , Figure 21 A schematic diagram of a first gesture operation in the virtual keyboard processing method provided in an embodiment of the present application. Figure 21 Take the first value of 3 as an example, Figure 21 Including two sub-schematic diagrams (a) and (b), Figure 21 The sub-schematic diagram (a) shows a case where the number of hands corresponding to the first gesture operation is 1 (ie, the first gesture operation is a single-hand operation), and the electronic device can obtain Figure 21 The three contact points in sub-schematic diagram (a) are less than 25 mm in distance between the three contact points; Figure 21The schematic diagram (b) shows the case where the number of hands corresponding to the first gesture operation is 2 (ie, the first gesture operation is a two-hand operation), and the electronic device can obtain 8 contact points (respectively Figure 21 A1, A2, A3, A4, A5, A6, A7 and A8), the contact points represented by A7 and A8 are contact points generated based on the palm, A1, A2, A3, A4, A5 and A6 are contact points generated based on the fingers. A1, A2 and A3 form a first subset, A4, A5 and A6 form a second subset, the distance between the three contact points A1, A2 and A3 is less than 25 mm, the distance between the three contact points A4, A5 and A6 is less than 25 mm, and the distance between the first subset and the second subset is greater than 25 mm. It should be understood that Figure 21 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0516] Optionally, the electronic device may further first divide the multiple contact points corresponding to the first gesture operation into first contact points and second contact points based on the first gesture parameter corresponding to the first gesture operation, wherein the first contact points are generated based on the user's fingers and the second contact points are generated based on the user's palms. The electronic device then determines whether the number of first contact points in the multiple contact points is greater than or equal to a first value, and whether there are two contact points in at least one first contact point that are separated by a distance greater than a second distance threshold, to determine the number of hands corresponding to the first gesture operation. Specifically, in one implementation, the electronic device may determine whether the area of each contact point is greater than or equal to a first area threshold. If the area is greater than or equal to the first area threshold, the contact point is determined as a second contact point (i.e., a contact point generated by the palm); if the area is less than the first area threshold, the contact point is determined as a first contact point (i.e., a contact point generated by the finger). The value of the first area threshold may be pre-set or user-defined; the value of the first area threshold may be determined based on factors such as the size of the user's hand, and is not limited herein. It should be noted that the example of using the area of the contact point to determine whether the contact point is the first contact point or the second contact point is only for the convenience of understanding the feasibility of this solution and is not used to limit this solution.

[0517] The process of determining the shape information of the hand. The first gesture operation can be a static gesture operation, and the shape information of the hand corresponding to the first gesture operation can specifically be the left hand, right hand, two fingers, fist, or other shape information. Optionally, if the first gesture operation can also be a dynamic sliding operation, the shape information of the hand can specifically be a "Z" shape, a check mark shape, a circle shape, etc., which are not exhaustive here. Specifically, if the number of multiple contact points obtained by the electronic device is two, it can be determined that the shape information corresponding to the first gesture operation is two fingers. For a more direct understanding of this solution, please refer to Figure 22 , Figure 22 A schematic diagram of a first gesture operation in the virtual keyboard processing method provided in an embodiment of the present application. Figure 22 There are two sub-schematic diagrams (a) and (b). Figure 22 The first gesture operation shown in the sub-schematic diagram (a) is a two-finger operation. Figure 22 The sub-schematic diagram (b) shows two contact points corresponding to the two-finger operation. It should be understood that Figure 22 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0518] If the number of multiple contact points acquired by the electronic device is greater than or equal to three, the electronic device needs to determine whether the number of hands corresponding to the first gesture operation is one or two. If the electronic device determines that it is a single-handed operation, it needs to determine whether the shape of the hand corresponding to the first gesture operation is the left hand or the right hand based on the acquired first gesture parameter. Specifically, in one implementation, if the multiple contact points corresponding to the first gesture operation are all located on the left side of the center line of the display screen, the shape of the hand corresponding to the first gesture operation is the left hand; if the multiple contact points corresponding to the first gesture operation are all located on the right side of the center line of the display screen, the shape of the hand corresponding to the first gesture operation is the right hand. It should be noted that the method of determining whether it is the left hand or the right hand provided here is only for the convenience of understanding the feasibility of this solution and is not used to limit this solution.

[0519] In other application scenarios, if the first gesture parameter is generated based on an image corresponding to the first gesture operation, the electronic device may input the image corresponding to the first gesture operation into a neural network for image recognition to directly generate the first indication information.

[0520] 1703. The electronic device obtains a first rule.

[0521] In an embodiment of the present application, a first rule may be pre-configured in the electronic device, and the first rule indicates the correspondence between multiple types of gesture operations and multiple types of virtual keyboards, and the first type of virtual keyboard is one type of the multiple types of virtual keyboards. In one case, different types of virtual keyboards have different functions, and virtual keyboards with different functions may include a combination of any two or more of the following virtual keyboards: a numeric keypad, a function key keyboard, a full keyboard, and a custom keyboard, and the function key keyboard is composed of function keys. In an embodiment of the present application, different types of virtual keyboards have different functions, so that a plurality of virtual keyboards with different functions can be provided to the user, thereby improving the user's flexibility in using the virtual keyboard, so as to improve the user stickiness of this solution.

[0522] In another embodiment, the different types of virtual keyboards may include a combination of any two or more of the following virtual keyboards: a mini keyboard, a numeric keyboard, a functional keyboard, a function key keyboard, a circular keyboard, an arc keyboard, a custom keyboard, and a full keyboard.

[0523] The first rule indicates the following information: When the first gesture operation is a one-handed operation, the first type of virtual keyboard is any of the following virtual keyboards: mini keyboard, numeric keyboard, functional keyboard, function key keyboard, circular keyboard, curved keyboard, custom keyboard. The mini keyboard includes 26 letter keys. The functional keyboard is displayed in the application. The virtual keys included in the functional keyboard correspond to the functions of the application. It should be noted that the same electronic device does not need to be configured with a mini keyboard, numeric keyboard, functional keyboard, function key keyboard, circular keyboard, curved keyboard, and custom keyboard at the same time. The example here is only to prove that a single-handed operation in an electronic device can trigger any virtual keyboard among the mini keyboard, numeric keyboard, functional keyboard, function key keyboard, circular keyboard, curved keyboard, or custom keyboard. When the first gesture operation is a two-handed operation, the first type of virtual keyboard is a full keyboard. The full keyboard includes at least 26 letter keys, and the size of the full keyboard is larger than that of the mini keyboard. In the embodiment of the present application, multiple specific forms of virtual keyboards displayed on the display screen are provided in both cases where the first gesture operation is a one-handed operation and a two-handed operation, which improves the implementation flexibility of the solution and expands the application scenarios of the solution.

[0524] Furthermore, since the correspondence between gesture operations and different types of virtual keyboards may be different in different electronic devices, the same electronic device may include a combination of at least two of the following five items:

[0525] (1) When the first gesture operation is a first one-hand operation, the first type of virtual keyboard is a mini keyboard.

[0526] The first one-hand operation can be a left-hand operation or a right-hand operation; the first one-hand operation can be a one-hand operation with a stylus or a one-hand operation without a stylus. Figure 23 , Figure 23 A schematic diagram of a first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application. Figure 23 Taking the first one-hand operation as an example where the user holds a stylus, the electronic device detects that the first gesture operation is the first one-hand operation, and the corresponding first type of virtual keyboard is a mini keyboard, which includes 26 letter keys and is smaller than a full keyboard. It should be understood that Figure 23 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0527] In the embodiment of the present application, when the first gesture operation is a one-hand operation, the first type of virtual keyboard is a mini keyboard, which is conducive to improving the flexibility of the user's letter input process.

[0528] (2) When the first gesture operation is a right-handed single-handed operation, the first type of virtual keyboard is a numeric keyboard; when the first gesture operation is a left-handed single-handed operation, the first type of virtual keyboard is a functional keyboard.

[0529] The virtual keys included in the functional keyboard correspond to the functions of the application. For example, if the first gesture operation is obtained in a gaming application, the functional keyboard may be a gaming keyboard configured with commonly used gaming keys. For another example, if the first gesture operation is obtained in a drawing application, the functional keyboard may be commonly used keys in the drawing software, etc., and the examples are not exhaustive.

[0530] For a more intuitive understanding of this solution, please refer to Figure 24 and Figure 25 , Figure 24 and Figure 25 These are two schematic diagrams of a first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application. Figure 23 and Figure 24 Both include (a) and (b) two sub-diagrams, first refer to Figure 24 , Figure 24 The schematic diagram (a) shows that the first gesture operation is a right-hand operation. Figure 24 The diagram (b) of FIG. 1 represents a first type of virtual keyboard, specifically a numeric keyboard. Figure 25 , Figure 25 The first gesture operation shown in the sub-schematic diagram (a) is a left-hand operation. Figure 25 The schematic diagram (b) of FIG. 1 represents a first type of virtual keyboard, specifically a designer keyboard. It should be understood that Figure 24 and Figure 25 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0531] In an embodiment of the present application, when the first gesture operation is a right-handed single-handed operation, the first type of virtual keyboard is a numeric keyboard; when the first gesture operation is a left-handed single-handed operation, the first type of virtual keyboard is a functional keyboard, which is more in line with the user's usage habits of the physical keyboard, thereby reducing the difference between the virtual keyboard and the physical keyboard, which is conducive to enhancing user stickiness.

[0532] (3) When the first gesture operation is a one-hand operation located in the first area of the display screen, the first type of virtual keyboard is a function key keyboard, and the first area is located in the lower left or lower right of the display screen. The concept of the first area can be found in the description of step 202 above and will not be repeated here.

[0533] Among them, the function key keyboard shows one or more function keys, including but not limited to the Shift key, Ctrl key, Alt key, Fn (short for function) key, Delete key, etc. The specific function keys included in the function key keyboard can be defined in combination with actual application scenarios and are not limited here; among them, the Fn key is a modifier key used on computer keyboards. Its main function is to define more keys with two meanings in a compact keyboard layout as a combination key. For a more intuitive understanding of this solution, please refer to Figure 26 and Figure 27 , Figure 26 and Figure 27 These are two schematic diagrams of a first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application. Figure 26 and Figure 27 Including (a) and (b) two sub-diagrams, first refer to Figure 26 , Figure 26 In the case where the first area is located at the lower left of the display screen, such as Figure 26 As shown in the diagram (a), when the user places one hand on the first area of the display screen, the user enters the Figure 26 (b) shows that the first type of virtual keyboard is a function key keyboard. Figure 27 , Figure 27 In the case where the first area is located at the lower right of the display screen, such as Figure 27 As shown in the diagram (a), when the user places one hand on the first area of the display screen, the user enters the Figure 27 (b) sub-schematic diagram, that is, the first type of virtual keyboard is a function key keyboard, it should be understood that Figure 26 and Figure 27 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0534] In the embodiment of the present application, since the function key is arranged at the lower left or lower right of the physical keyboard, when the first gesture operation is a one-handed operation located in the first area of the display screen, the first type of virtual keyboard is a function key keyboard. Since the trigger gesture is the same as the user's habit of using the physical keyboard, it is convenient for the user to remember the trigger gesture, reducing the difficulty of implementing this solution, and is conducive to enhancing user stickiness.

[0535] (4) When the first gesture operation is a single-hand operation with less than three contact points, the first type of virtual keyboard is a circular keyboard or a curved keyboard.

[0536] Among them, a circular keyboard refers to a keyboard with a circular shape, and a curved keyboard refers to a keyboard with an arc shape. Optionally, when the first gesture operation is a one-handed operation with two contact points, and the distance between the two contact points is greater than a third distance threshold, the first type of virtual key is a circular keyboard or a curved keyboard, and the value of the third distance threshold can be 58 mm, 60 mm, 62 mm, etc., which are not exhaustive here. For a more intuitive understanding of this solution, please refer to Figure 28 , Figure 28 A schematic diagram of a first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application. Figure 28 Including two sub-schematic diagrams (a) and (b), Figure 28 The sub-diagram (a) of FIG. 1 represents a one-handed operation with two contact points (ie, less than three contact points) for the first gesture operation. Figure 28 The schematic diagram (b) of FIG. 1 represents a first type of virtual keyboard which is a circular keyboard. It should be understood that Figure 28 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0537] In an embodiment of the present application, when the first gesture operation is a single-handed operation with less than three contact points, a circular keyboard or a curved keyboard can also be provided. Not only can keyboards that exist in a physical keyboard be provided, but keyboards that do not exist in a physical keyboard can also be provided, thereby enriching the types of keyboards, providing users with more choices, and further enhancing the user's flexibility of choice.

[0538] (5) When the first gesture operation is a two-handed operation, the first type of virtual keyboard is a full keyboard.

[0539] For a more intuitive understanding of this solution, please refer to Figure 29 , Figure 29 A schematic diagram of a first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application. Figure 29 The virtual keyboard corresponding to two-hand operation is a full keyboard, which includes at least 26 letter keys. Figure 29 and Figure 23 It can be seen that the size of the full keyboard is larger than the mini keyboard. It should be understood that Figure 29 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0540] It should be noted that, among the above items (1) to (5), except for item (1) and item (2), which are incompatible with each other and cannot be configured in the same electronic device, the remaining items can be matched arbitrarily.

[0541] Furthermore, in one implementation, the first rule directly includes the correspondence between multiple types of gesture operations and multiple types of virtual keyboards, as shown in items (1) to (5) above. The first rule includes the correspondence between multiple first identification information and multiple second identification information, where the first identification information is used to uniquely point to the first identification information corresponding to a type of gesture operation, and the second identification information is used to uniquely point to a type of virtual keyboard.

[0542] In another implementation, the first rule includes a correspondence between multiple groups of conditions and multiple types of virtual keyboards, each group of conditions in the multiple groups of conditions corresponds to a type of gesture operation, that is, each group of conditions in the multiple groups of conditions is used to limit a type of gesture operation.

[0543] Specifically, if the first gesture parameter is collected based on the display screen, the set of conditions for limiting one-handed operation can be that the number of contact points is greater than or equal to a first value, and the distances between the multiple contact points are all less than a second distance threshold. The values of the first value and the second distance threshold can be described above. Alternatively, the set of conditions for limiting one-handed operation can be that the number of contact points with an area less than the first area threshold is greater than or equal to the first value, and the distances between the multiple contact points with an area less than the first area threshold are all less than the second distance threshold.

[0544] A set of conditions for limiting left-hand single-hand operation may be that the number of contact points is greater than or equal to a first value, and the distances between the multiple contact points are all less than a second distance threshold, and the multiple contact points are all located to the left of the center line of the display screen; a set of conditions for limiting left-hand single-hand operation may be that the number of contact points is greater than or equal to a first value, and the distances between the multiple contact points are all less than the second distance threshold, and the multiple contact points are all located to the right of the center line of the display screen.

[0545] A set of conditions for limiting one-handed operation of the first area may be that the number of contact points is greater than or equal to a first value, and the distances between the multiple contact points are all less than a second distance threshold, and the multiple contact points are all located in the first area of the display screen; or, a set of conditions for limiting one-handed operation of the first area may be that the number of contact points is greater than or equal to a first value, and the distances between the multiple contact points are all less than the second distance threshold, and at least one contact point among the multiple contact points is located in the first area of the display screen, etc.

[0546] A set of conditions for defining two-handed operation may include multiple contact points including a first subset and a second subset, the number of contact points in the first subset and the second subset are both greater than or equal to a first value, the distances between the multiple contact points in the first subset are all less than a second distance threshold, the distances between the multiple contact points in the second subset are all less than the second distance threshold, and the distance between any contact point in the first subset and any contact point in the second subset is greater than the second distance threshold. Alternatively, a set of conditions for defining two-handed operation may include multiple contact points having an area less than a first area threshold including the first subset and the second subset.

[0547] It should be noted that the above provides multiple sets of conditions for limiting various types of gesture operations, but the types of gesture operations configured in a specific electronic device and the limiting conditions corresponding to each type of gesture operation can be flexibly set in combination with the actual application scenario and are not limited here.

[0548] Optionally, the first rule includes a first sub-rule, which is obtained by performing a custom operation on at least one type of gesture operation and / or at least one type of virtual keyboard. In this embodiment of the present application, the user can customize the triggering gesture and / or the type of virtual keyboard to make the display process of the virtual keyboard more in line with the user's expectations, thereby further improving the user stickiness of this solution.

[0549] Specifically, the electronic device has a "settings" function, in which a first setting interface for the first rule is configured, so that the user can customize any one or more of the following through the first setting interface: gesture operation, virtual keyboard, and the corresponding relationship between gesture operation and virtual keyboard. For a more intuitive understanding of this solution, please refer to Figures 30 to 32 , Figure 30 and Figure 31 This is a schematic diagram of a first setting interface in the virtual keyboard processing method provided in an embodiment of the present application. Figure 32 A schematic diagram of a customized gesture operation in the virtual keyboard processing method provided in the embodiment of the present application. Figure 30 , Figure 30 It includes four sub-schematic diagrams (a), (b), (c) and (d). Figure 30 The (a) sub-diagram represents the correspondence between multiple types of gesture operations pre-configured in the electronic device and multiple types of virtual keyboards, such as Figure 30 As shown in the diagram (a), a single-handed operation triggers the display of a numeric keyboard, a two-handed operation triggers the display of a full keyboard, and a two-finger operation triggers the display of a circular keyboard. When the user clicks on the "numeric keyboard" (a type of virtual keyboard), it triggers the display of the Figure 30(b) sub-diagram, that is, the customized operation of the "numeric keyboard". Figure 30 In the (b) sub-diagram of FIG, when the user performs a long press operation, a double-click operation, a triple-click operation or other types of contact operations on any key in the numeric keyboard, Figure 30 In the example of long pressing key 2 on the numeric keypad, a delete icon (i.e. Figure 30 The "×" symbol shown in the figure) triggers the entry Figure 30 (c) Sub-diagram of . Figure 30 In the (c) diagram, the key with the "×" symbol is a deletable key. In addition, the user can also move the position of the key in the numeric keypad by long pressing and dragging the key. The above-mentioned operations of deleting keys and moving key positions can be performed multiple times, such as Figure 30 As shown in the diagram (d), the user has deleted the numeric keys except 1-9 to customize the numeric keyboard. Figure 30 The examples in the example are only for the convenience of understanding this solution. You can also use other operations to delete or move the virtual keys in the virtual keyboard. Figure 30 Here, we only take the customization of the numeric keyboard as an example. Other types of virtual keyboards can also be customized.

[0550] Continue reading Figure 31 , Figure 31 Need to be combined Figure 30 Describe, when the user clicks Figure 30 When you enter the "One-handed operation" in the (a) sub-diagram of Figure 31 (a) sub-schematic diagram, Figure 31 The (a) sub-diagram shows an icon for inputting "custom gestures". The user clicks the icon to enter Figure 31 (b) Sub-diagram of the user based on Figure 31 The prompt of the (b) sub-diagram is used to input a custom gesture, that is, Figure 31 In one implementation, the electronic device may pre-set a first duration threshold, which is the total duration threshold for inputting a custom gesture. When the first duration threshold is reached, the user enters the state of the gesture. Figure 31 In another implementation, the electronic device may also pre-configure a second time threshold, which is a threshold for the user to stop inputting a gesture. When the electronic device detects that the time for the user to stop inputting a gesture reaches the second time threshold, the electronic device enters the state of Figure 31 (d) sub-diagram, etc., here is not correct to enter Figure 31 The method of sub-schematic diagram (d) is exhaustive. Figure 31In the (d) sub-diagram of FIG, the display screen displays an icon for indicating “confirmation” and an icon for indicating “re-enter custom gesture”. If the user clicks the “confirmation” icon, the electronic device will Figure 31 The obtained gesture operation is determined to be the custom gesture 1 in the sub-schematic diagram (c), and the electronic device updates the first rule, updates the correspondence between the one-hand operation and the numeric keyboard to the correspondence between the custom gesture 1 and the numeric keyboard, and displays Figure 31 (e) of the diagram, that is, confirming the custom gesture 1 as the trigger gesture of the numeric keyboard, thus completing the customization of the trigger gesture. In addition, see Figure 31 The (f) sub-symbol, Figure 31 The sub-symbol (f) represents the shape of the custom gesture 1 obtained by the electronic device (ie, the "fist" shape). It should be understood that Figure 31 The examples are only for facilitating understanding of this solution and are not intended to limit this solution. Users can also set custom gestures of other shapes, which are not limited here.

[0551] Please continue reading Figure 32 , Figure 32 Need to combine Figure 31 Describe, user based on Figure 31 (b) of the diagram, start entering the custom gesture. Figure 32 (a) Sub-diagram and Figure 32 (b) Sub-schematic diagram of Figure 32 In the example, the custom gesture is a dynamic gesture. Figure 32 The custom gesture is a dynamic gesture of making a fist and then opening it. When the electronic device determines that the user has completed the input of the custom gesture, it can enter Figure 31 (d) of the diagram, the subsequent steps can refer to the above Figure 31 The description is not repeated here.

[0552] 1704. The electronic device determines whether the first gesture operation is included in the pre-stored multiple types of gesture operations based on the first rule. If the first gesture operation is one of the pre-stored multiple types of gesture operations, the process proceeds to step 1705. If the first gesture parameter is not included in the pre-stored multiple types of gesture operations, the process re-enters step 1701.

[0553] In an embodiment of the present application, if the first rule includes the correspondence between multiple types of gesture operations and multiple types of virtual keyboards, the electronic device needs to generate first indication information through step 1702. The first indication information needs to include the number information of hands corresponding to the first gesture operation, the position information of the hands corresponding to the first gesture operation, and the shape information of the hands corresponding to the first gesture operation. After knowing the first indication information, the electronic device can determine whether the first gesture operation is one of the multiple types of gesture operations pre-configured in the electronic device.

[0554] If the first rule includes multiple sets of conditions, after the electronic device obtains the first gesture parameter corresponding to the first gesture operation through step 1701, it can directly determine whether the first gesture operation satisfies any set of conditions among the multiple sets of conditions included in the first rule. For the description of the multiple sets of conditions, please refer to the description in the above step 1703.

[0555] 1705. The electronic device displays a first type of virtual keyboard through a display screen.

[0556] In an embodiment of the present application, after the electronic device determines, according to a first rule, that the first gesture operation is a target type of gesture operation among multiple types of gesture operations pre-stored in the electronic device, it can obtain a first type of virtual keyboard corresponding to the target type of gesture operation (that is, obtain a first type of virtual keyboard corresponding to the first gesture operation). Then, the first type of virtual keyboard is displayed through the display screen. In an embodiment of the present application, the electronic device is pre-configured with a first rule, and the first rule indicates the correspondence between multiple types of gesture operations and the multiple types of virtual keyboards. After detecting the first gesture operation acting on the display screen, the first type of virtual keyboard corresponding to the specific first gesture operation can be obtained according to the first rule, thereby improving the efficiency of the virtual keyboard matching process.

[0557] Specifically, in one implementation, during the display of the first type of virtual keyboard, the position of the first type of virtual keyboard on the display screen is fixed. In another implementation, during the display of the first type of virtual keyboard, the position of the first type of virtual keyboard on the display screen can move as the user's hand moves.

[0558] In another implementation, multiple types of virtual keyboards are divided into a third subset and a fourth subset, each of the third subset and the fourth subset includes at least one type of virtual keyboard, each type of virtual keyboard in the third subset is fixed in position during the display process, and each type of virtual keyboard in the fourth subset can move as the user's hand moves during the display process; that is, the positions of some types of virtual keyboards among the multiple types of virtual keyboards are fixed during the display process, and the positions of other types of virtual keyboards move as the user's hand moves during the display process.

[0559] Optionally, if the first type of virtual keyboard is a mini keyboard, a numeric keyboard, or a functional keyboard, the first type of virtual keyboard can move with the movement of the user's hand, that is, the third subset includes any one or more combinations of the following: a mini keyboard, a numeric keyboard, and a functional keyboard. If the first type of virtual keyboard is a circular keyboard, a curved keyboard, or a full keyboard, the first type of virtual keyboard can be fixed in position during the display process, that is, the fourth subset includes any one or more combinations of the following: a circular keyboard, a curved keyboard, or a full keyboard.

[0560] Furthermore, for a virtual keyboard that moves with the movement of the user's hand, when the user wants to turn off the movement function of the virtual keyboard, a second gesture operation can be input through the display screen. The second gesture operation can be a double-click operation, a triple-click operation, a single-click operation or other operations, etc., which are not limited here.

[0561] Regarding the initial display position of the virtual keyboard. The initial display position of the first type of virtual keyboard can be pre-set or determined by the electronic device based on the position of the finger. As an example, if the first type of virtual keyboard is a numeric keyboard, then when the numeric keyboard is initially displayed, the key corresponding to the number 5 can be configured below the index finger; as another example, if the first type of virtual keyboard is a mini keyboard, then the initial display position of the mini keyboard can be below the hand, etc. The examples here are only for the convenience of understanding this solution and are not used to limit this solution.

[0562] Regarding the display size of the virtual keyboard. In one implementation, the size of each type of virtual keyboard in the electronic device is fixed. In another implementation, the same type of virtual keyboard can have different sizes to accommodate different finger / hand sizes. Specifically, the electronic device can pre-store at least two different sizes for the same type of virtual keyboard, and pre-store the correspondence between the contact point size and the different sizes. After determining the first type of virtual keyboard, the target size corresponding to the contact point size can be obtained, and the first type of virtual keyboard of the target size can be displayed.

[0563] Optionally, before displaying the first type of virtual keyboard through the display screen, the electronic device may further obtain a first angle based on the first indication information generated in step 1702, where the first angle indicates the relative angle between the hand and the edge of the display screen in the first gesture corresponding to the first gesture operation, or the first angle indicates the relative angle between the hand and the centerline of the display screen in the first gesture corresponding to the first gesture operation. Step 1705 may include: the electronic device obtaining a first display angle of the first type of virtual keyboard based on the first angle, and displaying the first type of virtual keyboard through the display screen at the first display angle; the first display angle indicates the relative angle between the edge of the first type of virtual keyboard and the edge of the display screen, or the first display angle indicates the relative angle between the edge of the first type of virtual keyboard and the centerline of the display screen.

[0564] Specifically, in one implementation, the electronic device determines whether the first angle is greater than or equal to a preset angle threshold. If it is greater than or equal to the preset angle threshold, it obtains a first display angle and displays the first type of virtual keyboard through the display screen according to the first display angle, wherein the value of the preset angle threshold can be 25 degrees, 28 degrees, 30 degrees, 32 degrees, 35 degrees or other values, etc., which are not limited here.

[0565] Furthermore, if the first type of virtual keyboard is a full keyboard, the first angle includes a relative angle for the left hand and a relative angle for the right hand, the full keyboard is split into a first sub-keyboard and a second sub-keyboard, the first sub-keyboard and the second sub-keyboard including different virtual keys in the full keyboard, and the first display angle includes a display angle of the first sub-keyboard and a display angle of the second sub-keyboard. If the first angle indicates the relative angle between the hand and the edge of the display screen in a first gesture corresponding to the first gesture operation, the first display angle indicates the relative angle between the bottom edge of the virtual keyboard and the edge of the display screen; further, the display angle of the first sub-keyboard indicates the relative angle between the edge of the first sub-keyboard and the edge of the display screen, and the display angle of the second sub-keyboard indicates the relative angle between the edge of the second sub-keyboard and the edge of the display screen. If the first angle indicates the relative angle between the hand and the centerline of the display screen in the first gesture corresponding to the first gesture operation, the first display angle indicates the relative angle between the bottom edge of the virtual keyboard and the centerline of the display screen; further, the display angle of the first sub-keyboard indicates the relative angle between the edge of the first sub-keyboard and the centerline of the display screen, and the display angle of the second sub-keyboard indicates the relative angle between the edge of the second sub-keyboard and the centerline of the display screen.

[0566] For a more intuitive understanding of this solution, please refer to Figure 33 , Figure 33 A schematic diagram of a first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application. Figure 33 In the example, the preset angle threshold value is 30. Figure 33 It includes three sub-schematic diagrams (a), (b) and (c). Figure 33 The sub-schematic diagram (a) of FIG. 1 represents eight first contact points corresponding to a two-hand operation (a type of first gesture operation). Figure 33 The (b) sub-schematic diagram shows the first sub-angle (i.e., the relative angle on the left hand) formed by the first straight line and the bottom edge of the display screen, and the second sub-angle (i.e., the relative angle on the right hand) formed by the second straight line and the bottom edge of the display screen. The values of the first sub-angle and the second sub-angle are both 32 degrees. Figure 33 The sub-schematic diagram (c) represents displaying the first type of virtual keyboard at a first display angle through the display screen. It should be understood that Figure 33 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0567] If the first type of virtual keyboard is a mini keyboard, a numeric keyboard, a functional keyboard, or a function key keyboard, the first angle is an angle for one hand, and the first display angle is a relative angle of the entire virtual keyboard.

[0568] In another implementation, after obtaining the first angle, the electronic device determines the first display angle of the first type of virtual keyboard as the first angle, and displays the first type of virtual keyboard at the first angle through the display screen, wherein, if the first angle indicates the relative angle between the hand and the edge of the display screen in the first gesture corresponding to the first gesture operation, the first display angle indicates the relative angle between the bottom edge of the virtual keyboard and the edge of the display screen; if the first angle indicates the relative angle between the hand and the edge of the display screen in the first gesture corresponding to the first gesture operation, the first display angle indicates the relative angle between the bottom edge of the virtual keyboard and the center line of the display screen.

[0569] In an embodiment of the present application, the relative angle (i.e., the first angle) between the user's hand and the edge or center line of the display interface is obtained, and the display angle of the virtual keyboard is determined based on the first angle, so that the display angle of the keyboard is more in line with the placement angle of the user's hand, making the process of the user inputting using the virtual keyboard more comfortable and convenient.

[0570] Optionally, if the electronic device determines that the first gesture parameter is a two-hand operation, that is, determines that the first type of virtual keyboard is a full keyboard, the electronic device will also obtain the distance between the two hands, and determine whether the distance between the two hands is greater than or equal to a first distance threshold. When the distance between the two hands is less than or equal to the first distance threshold, the first type of virtual keyboard is displayed in an integrated manner through the display screen; when the distance between the two hands is greater than the first distance threshold, the first sub-keyboard is displayed through the second area of the display screen, and the second sub-keyboard is displayed through the third area of the display screen, wherein the second area and the third area are different areas in the display screen, and the first sub-keyboard and the second sub-keyboard include different virtual keys in the full keyboard; the value of the first distance threshold can be 70 mm, 75 mm, 80 mm, etc., which is not limited here.

[0571] For a more intuitive understanding of this solution, please refer to Figure 34 , Figure 34 A schematic diagram of a first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application. Figure 34 In the example, the first distance threshold is 75 mm. Figure 34 Including two sub-schematic diagrams (a) and (b), Figure 34 The diagram (a) shows that the distance between the two hands in two-handed operation is 80 mm. Since 80 mm is larger than 75 mm, Figure 34 The (b) sub-schematic diagram represents that the first sub-keyboard is displayed in the second area of the display screen, and the second sub-keyboard is displayed in the third area of the display screen. It should be understood that Figure 34 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0572] In an embodiment of the present application, whether to display the virtual keyboard in an integrated manner or in a separated manner can be decided based on the distance between the user's two hands, thereby further improving the flexibility of the virtual keyboard display process, making the displayed virtual keyboard more convenient for users to use, and further improving the user stickiness of this solution.

[0573] Further optionally, if the electronic device determines that the first gesture parameter is a two-handed operation, that is, determines that the first type of virtual keyboard is a full keyboard, the electronic device will also obtain the distance between the two hands and determine whether the distance between the two hands is less than a fourth distance threshold. If the distance between the two hands is less than the fourth distance threshold, the electronic device displays a prompt message to instruct the user to adjust the distance between the two hands, and / or the electronic device directly displays the full keyboard in an integrated manner; optionally, the electronic device displays the minimum-sized full keyboard in an integrated manner. The aforementioned prompt information can be a text prompt, voice prompt, vibration prompt, or other types of prompts, and the display methods of the prompt information are not exhaustively listed here.

[0574] For a more intuitive understanding of this solution, please refer to Figure 35 , Figure 35 A schematic diagram of a first type of virtual keyboard in the virtual keyboard processing method provided in an embodiment of the present application. Figure 35 Including two sub-schematic diagrams (a) and (b), Figure 35 The diagram (a) shows that the distance between the two hands is 0 mm during two-handed operation. Figure 35 B1 in the (b) sub-diagram represents a prompt message to remind the user that the distance between the hands is too close, and the full keyboard is displayed in an integrated manner. It should be understood that Figure 35 The examples are only for facilitating understanding of this solution and are not intended to limit this solution.

[0575] Optionally, the display screen is further configured with multiple vibration feedback elements. If, during the display of the first type of virtual keyboard, the first type of virtual keyboard is fixed in position on the display screen, after the electronic device displays the first type of virtual keyboard through the display screen, the electronic device may further detect a first contact operation on the display screen. In response to the first contact operation, the electronic device obtains first position information of a first contact point corresponding to the first contact operation, where the first position information corresponds to a first virtual key on the virtual keyboard. If the first virtual key is an anchor point key, the electronic device obtains a first vibration feedback element from the multiple vibration feedback elements, where the first vibration feedback element is a vibration feedback element that matches the first virtual key; and instructs the first vibration feedback element to emit a vibration wave to perform a first feedback operation, where the first feedback operation is used to indicate that the first virtual key is an anchor point key. It should be noted that the meanings of the various terms in the foregoing description, the specific implementation methods of the steps, and the beneficial effects thereof can all be referred to the description of the first embodiment above and are not further elaborated here. The purpose of setting the anchor point key is to help users remember the location of the anchor point key, thereby helping users achieve blind typing on various types of virtual keyboards. Therefore, which virtual keys on each type of virtual keyboard are anchor point keys can be flexibly determined.

[0576] To further understand this solution, the following examples are given of the anchor point keys in each type of virtual keyboard, in combination with the various types of virtual keyboards shown above. For example, the first type of virtual keyboard is Figure 24 For example, if the first type of virtual keyboard is Figure 26For the function key keyboard shown, the anchor point keys can be the Ctrl key and the Shift key. It should be understood that the examples given here are only for the convenience of understanding the concept of anchor point keys in various types of virtual keyboards. The specific virtual keys in each type of virtual keyboard are set as anchor point keys. The developer can flexibly set them based on the actual application scenarios, or the user can customize them. There is no limitation here.

[0577] 1706. The electronic device obtains a contact operation on a first virtual key in the function key keyboard.

[0578] In some embodiments of the present application, if the first type of virtual keyboard displayed by the electronic device is a function key keyboard, the electronic device may also obtain a contact operation on one or more first virtual keys in the function key keyboard. The contact operation may be a press operation or a touch operation. For example, the first virtual key may be a Ctrl key, or may include both a Ctrl key and a Shift key, etc., without limitation herein.

[0579] 1707. In response to the touch operation, the electronic device highlights a second virtual key on the display screen, where the second virtual key is a key in the combined shortcut key except the first virtual key.

[0580] In some embodiments of the present application, the electronic device highlights at least one second virtual key on the display screen in response to a touch operation. Each of the at least one second virtual key can form a shortcut key with the first virtual key, and the second virtual key is a key other than the first virtual key in the combined shortcut key; the highlighted display includes but is not limited to highlight display, bold display, flashing display, etc., which are not limited here. As an example, in a drawing application, for example, the combination of the Ctrl key + Shift key + I key can provide a function of inverting the currently processed image, then the first virtual key includes the Ctrl key and the Shift key, and the second virtual key is the virtual key I; wherein, inver...

Claims

1. A method for processing an application interface, characterized in that: The method is applied to an electronic device, the electronic device including a first display screen and a second display screen, and the method includes: Displaying a first application interface via the first display screen, wherein the first display screen includes a plurality of application interfaces; In response to detecting a first operation on the first application interface, changing the mode type corresponding to the first application interface to handwriting input; In response to the handwriting input mode, triggering display of the first application interface on the second display screen to obtain handwritten content for the first application interface through the second display screen, wherein the second display screen displays the first application interface and the second application interface in a matrix format, or alternatively, the second display screen displays the first application interface in a suspended format with the first application interface suspended over the second application interface, wherein the second application interface is the application interface displayed on the second display screen before the first application interface is displayed; The first display screen displays a first interface, and the content displayed on the first interface is different from the first application interface. The first interface displayed on the first display screen is the third application interface among the multiple application interfaces, and the third application interface is an application interface that is not displayed on the first display screen when displaying the first application interface.

2. The method according to claim 1, characterized in that After triggering display of the first application interface on the second display screen in response to the input mode of the handwriting input, the method further includes: In the case where it is detected that the mode type corresponding to the first application interface is changed to keyboard input, in response to the input mode of the keyboard input, triggering the display of the first application interface on the first display screen and displaying a virtual keyboard on the second display screen; or When it is detected that the mode type corresponding to the first application interface is changed to keyboard input, in response to the input mode of the keyboard input, the first application interface is triggered to be displayed on the first display screen, and the virtual keyboard and application control bar are displayed on the second display screen.

3. The method according to claim 1, characterized in that After triggering display of the first application interface on the second display screen in response to the input mode of the handwriting input, the method further includes: When it is detected that the mode type corresponding to the first application interface is changed to a browsing mode, in response to the browsing mode, the first application interface is triggered to be displayed on the first display screen.

4. The method according to any one of claims 1 to 3, characterized in that The detecting of the first operation includes any one or more of the following five items: In the case of detecting that the holding posture of the electronic pen satisfies a first preset condition, determining that the first operation is detected, wherein the holding posture includes any one or a combination of multiple of the following: holding position, holding strength, and holding angle; or, Acquiring a trigger instruction for handwriting input through a first icon, wherein the first icon is displayed on the first application interface; or, In a case where a preset click operation or a preset track operation is detected, determining that the first operation is detected; or, In a case where it is detected that the electronic pen is located within a preset range of the second display screen, determining that the first operation is detected; or, When it is detected that the electronic pen changes from the first preset state to the second preset state, it is determined that the first operation is detected.

5. The method according to any one of claims 1 to 3, characterized in that The first operation is to obtain a sliding operation in a first direction through the second display screen, and the sliding operation in the first direction is a sliding operation from the upper edge of the second display screen to the lower edge of the second display screen, and the distance between the upper edge of the second display screen and the first display screen is closer than the distance between the lower edge of the second display screen and the first display screen.

6. The method according to any one of claims 1 to 3, characterized in that After triggering the display of the first application interface on the second display screen, the method further includes: Obtaining a startup operation for the second application interface, and determining a mode type corresponding to the second application interface based on the startup operation, where the second application interface is different from the first application interface; In a case where the mode type corresponding to the second application interface is handwriting input, triggering display of the second application interface on the second display screen in response to the input mode of the handwriting input; or In a case where the mode type corresponding to the second application interface is keyboard input, in response to the input mode of the keyboard input, triggering display of the second application interface on the first display screen and displaying a virtual keyboard on the second display screen; or, In the case where the mode type corresponding to the second application interface is a browsing mode, in response to the browsing mode, the second application interface is triggered to be displayed on the first display screen.

7. An electronic device, characterized in that: The electronic device includes a first display screen, a second display screen, a memory, one or more processors, and one or more programs; the one or more programs are stored in the memory, and when the one or more processors execute the one or more programs, the electronic device performs the following steps: Displaying a first application interface via the first display screen, wherein the first display screen includes a plurality of application interfaces; In response to detecting a first operation on the first application interface, changing the mode type corresponding to the first application interface to handwriting input; In response to the handwriting input mode, triggering display of the first application interface on the second display screen to obtain handwritten content for the first application interface through the second display screen, wherein the second display screen displays the first application interface and the second application interface in a matrix format, or alternatively, the second display screen displays the first application interface in a suspended format with the first application interface suspended over the second application interface, wherein the second application interface is the application interface displayed on the second display screen before the first application interface is displayed; The first display screen displays a first interface, and the content displayed on the first interface is different from the first application interface. The first interface displayed on the first display screen is the third application interface among the multiple application interfaces, and the third application interface is an application interface that is not displayed on the first display screen when displaying the first application interface.

8. The electronic device according to claim 7, wherein: When the one or more processors execute the one or more programs, the electronic device further performs the following steps: When detecting that the mode type corresponding to the first application interface is changed to keyboard input, triggering display of the first application interface on the first display screen and displaying a virtual keyboard on the second display screen in response to the input mode of the keyboard input; or, When it is detected that the mode type corresponding to the first application interface is changed to keyboard input, in response to the input mode of the keyboard input, the first application interface is triggered to be displayed on the first display screen, and the virtual keyboard and application control bar are displayed on the second display screen.

9. The electronic device according to claim 7, wherein: When the one or more processors execute the one or more programs, the electronic device further performs the following steps: When it is detected that the mode type corresponding to the first application interface is changed to a browsing mode, in response to the browsing mode, the first application interface is triggered to be displayed on the first display screen.

10. The electronic device according to any one of claims 7 to 9, characterized in that: When the one or more processors execute the one or more programs, the electronic device specifically performs any one or more combinations of the following four items: In the case of detecting that the holding posture of the electronic pen satisfies a first preset condition, determining that the first operation is detected, wherein the holding posture includes any one or a combination of multiple of the following: holding position, holding strength, and holding angle; or, Acquiring a trigger instruction for handwriting input through a first icon, wherein the first icon is displayed on the first application interface; or, A first contact operation is detected, where the first contact operation is a preset click operation or a preset track operation; or, In a case where it is detected that the electronic pen is located within a preset range of the second display screen, determining that the first operation is detected; When it is detected that the electronic pen changes from the first preset state to the second preset state, it is determined that the first operation is detected.

11. The electronic device according to any one of claims 7 to 9, characterized in that: The first operation is to obtain a sliding operation in a first direction through the second display screen, and the sliding operation in the first direction is a sliding operation from the upper edge of the second display screen to the lower edge of the second display screen, and the distance between the upper edge of the second display screen and the first display screen is closer than the distance between the lower edge of the second display screen and the first display screen.

12. The electronic device according to any one of claims 7 to 9, characterized in that: When the one or more processors execute the one or more programs, the electronic device further performs the following steps: Obtaining a startup operation for the second application interface, and determining a mode type corresponding to the second application interface based on the startup operation, where the second application interface is different from the first application interface; In a case where the mode type corresponding to the second application interface is handwriting input, triggering display of the second application interface on the second display screen in response to the input mode of the handwriting input; or, In a case where the mode type corresponding to the second application interface is keyboard input, in response to the input mode of the keyboard input, triggering display of the second application interface on the first display screen and displaying a virtual keyboard on the second display screen; or, In the case where the mode type corresponding to the second application interface is a browsing mode, in response to the browsing mode, the second application interface is triggered to be displayed on the first display screen.

13. An electronic device, characterized in that: The method comprises a processor coupled to a memory, wherein the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, the method according to any one of claims 1 to 6 is implemented.

14. A computer program product, characterized in that The computer program product includes instructions, and when the instructions are loaded and executed by an electronic device, the electronic device executes the method according to any one of claims 1 to 6.

Images