Method for opening virtual operation area, electronic device, readable storage medium, and program product

Abstract

The present application discloses a method for opening a virtual operation area, an electronic device, a readable storage medium, and a program product. A virtual operation area (e.g., a virtual keyboard or a virtual touchpad) may be preconfigured on the electronic device, and by inputting a palm touch gesture or a multi-finger touch gesture on a display screen, a user triggers the electronic device to open the virtual operation area. By implementing the method, the virtual operation area does not continuously occupy the area of a screen, and appears only when needed by the user in response to the touch gesture of the user, so that the utilization rate of the display screen is improved, thereby improving the utilization rate of the screen. In addition, the method also achieves the effects of high interaction efficiency, natural interaction, and accidental-touch prevention.

Description

Methods for opening virtual operating areas, electronic devices, readable storage media, and program products

[0001] [Amended 17.12.2025 according to Regulation 91] This application claims priority to Chinese Patent Application No. 202411848484.5, filed on December 13, 2024, entitled “Method for Opening a Virtual Operating Area, Electronic Device, Readable Storage Medium and Program Product”, filed on December 11, 2025, filed with the China National Intellectual Property Administration, entitled “Method for Opening a Virtual Operating Area, Electronic Device, Readable Storage Medium and Program Product”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of human-computer interaction technology, and in particular to methods for opening virtual operating areas, electronic devices, readable storage media, and program products. Background Technology

[0003] Electronic devices such as tablets and foldable phones can display virtual keyboards and touchpads on their screens, allowing users to control the devices through gestures such as clicking, dragging, and swiping. The way these virtual keyboards and touchpads are displayed affects the user experience, requiring a balance between screen occupancy and interaction efficiency, while also preventing accidental touches. Summary of the Invention

[0004] This application provides a method, electronic device, readable storage medium, and program product for opening a virtual operation area, which can open the virtual operation area efficiently and naturally, and the virtual operation area will not continuously occupy the screen area, thereby improving the utilization rate of the display screen.

[0005] In a first aspect, a method for opening a virtual touchpad is provided. The method is applied to an electronic device and may include: displaying a first user interface; detecting a first touch gesture on a display screen; displaying a first virtual touchpad on the first user interface, wherein the first virtual touchpad is displayed in an area that does not overlap or partially overlaps with the touch area of ​​the first touch gesture; and moving the touch focus on the first user interface in response to a sliding operation on the first virtual touchpad.

[0006] By implementing the first approach, the virtual touchpad does not continuously occupy screen space, appearing only in response to user touch gestures when needed, thus improving screen utilization. The virtual touchpad and the touch area do not overlap, preventing the initial touch gesture from excessively obscuring the virtual touchpad and facilitating user operation. Furthermore, this method also offers high interaction efficiency, natural interaction, and prevention of accidental touches.

[0007] In conjunction with the first aspect, in some embodiments, after the first virtual touchpad is displayed on the first user interface, the method may also stop displaying the first virtual touchpad in any of the following ways:

[0008] 1. It is detected that the hand that input the first touch gesture has left the display screen and there is no touch event on the first virtual touchpad. This application embodiment does not limit the order in which the detection of the hand that input the first touch gesture leaving the display screen and the detection of no touch event on the first virtual touchpad occur; the two can occur sequentially or simultaneously.

[0009] 2. A user operation applied to the first control is detected. The first control may be, for example, a control displayed in response to a first touch gesture. The embodiments of this application do not limit the implementation form of the first control.

[0010] 3. A user action was detected that occurred outside the area of ​​the first virtual touchpad. This user action could be, for example, a click.

[0011] In conjunction with the previous embodiment, in some embodiments, after the first virtual touchpad is displayed on the first user interface, the method may further include: the electronic device detecting a user operation received in an area other than the first virtual touchpad; the electronic device refusing to respond to the user operation. In this embodiment, after the electronic device opens the first virtual touchpad, other areas outside the first virtual touchpad become inactive.

[0012] In combination with either of the two embodiments above, in some embodiments, after detecting the first touch gesture on the display screen, the method may further include: outputting a first prompt message. This first prompt message may, for example, be used to indicate a short-term use scenario of entering the virtual touchpad. This first prompt message may also be used to indicate, for example, how to close the first virtual touchpad in a short-term use scenario, interaction rules for other areas besides the first virtual touchpad, etc. The embodiments of this application do not limit the implementation form of the first prompt message.

[0013] In conjunction with any of the above embodiments, in some embodiments, detecting a first touch gesture on the display screen specifically includes: detecting a first touch gesture on the display screen that does not meet a first condition.

[0014] In conjunction with the first aspect, in some embodiments, after the first virtual touchpad is displayed on the first user interface, the method may also stop displaying the first virtual touchpad in any of the following ways:

[0015] 1. The system detects that the hand that input the first touch gesture has left the display screen and that there has been no touch event on the first virtual touchpad for a first duration. This application does not limit the order in which the detection of the hand leaving the display screen and the detection of no touch event on the first virtual touchpad for a first duration are performed; they can be detected sequentially or simultaneously.

[0016] 2. A first touch gesture is detected on the display screen. This first touch gesture may be different from or the same as the first touch gesture in the first aspect; no restriction is placed here.

[0017] 3. A first touch gesture that meets the first condition is detected on the display screen.

[0018] 4. A user operation applied to the first control is detected. The first control may be, for example, a control displayed in response to a first touch gesture. This application does not limit the implementation of the first control.

[0019] 5. A user action was detected that occurred outside the area of ​​the first virtual touchpad. This user action could be, for example, a click.

[0020] In conjunction with the previous embodiment, in some embodiments, after the first virtual touchpad is displayed on the first user interface, the method may further include: the electronic device detecting a user operation received in an area other than the first virtual touchpad; and the electronic device responding to the user operation by performing a corresponding action. In this embodiment, after the electronic device opens the first virtual touchpad, other areas outside the first virtual touchpad remain active.

[0021] In combination with either of the two embodiments above, in some embodiments, after detecting the first touch gesture on the display screen, the method may further include: outputting a second prompt message. This second prompt message may, for example, be used to indicate a prolonged use scenario involving the virtual touchpad. This second prompt message may also be used to indicate how to close the first virtual touchpad during prolonged use, interaction rules for other areas besides the first virtual touchpad, etc. The embodiments of this application do not limit the implementation form of the second prompt message.

[0022] In conjunction with the first aspect or any embodiment of the first aspect, in some embodiments, detecting a first touch gesture on the display screen specifically includes: detecting a first touch gesture that meets a first condition on the display screen.

[0023] In conjunction with the first aspect or any embodiment of the first aspect, in some embodiments, the first touch gesture includes one of the following: a palm touch gesture, a multi-finger touch gesture.

[0024] In conjunction with the first aspect or any embodiment of the first aspect, in some embodiments, detecting a first touch gesture on the display screen specifically includes: detecting a first touch gesture of palm touch gesture by one or more of the following: the area of ​​the touch area, the outline of the touch area, the density of the touch points, and the pressure distribution of the touch; or, detecting a first touch gesture of multi-finger touch gesture by one or more of the following: the size of the touch point, the area of ​​the touch point, the number of touch points, the distribution of the touch points, and the time of touch point landing.

[0025] In conjunction with any of the aforementioned implementations of the first condition, the first condition includes one or more of the following: a first duration condition, a first pressure condition, a first sliding distance condition, a first sliding direction condition, and a first number of touches condition. The embodiments of this application do not limit the specific content of the first condition. The first condition can be set by the user as needed, or it can be preset in the electronic device.

[0026] In conjunction with any of the aforementioned implementations of the first condition, in some implementations, the first touch gesture is a palm touch gesture, and the first touch gesture that meets the first condition includes: a long press gesture, a heavy press gesture, a multiple touch gesture, and a swipe gesture; or, the first touch gesture is a multi-finger touch gesture, and the first touch gesture that meets the first condition includes: a long press gesture, a heavy press gesture, a multi-tap gesture, a pinch gesture, and a magnify gesture.

[0027] In conjunction with any of the aforementioned implementations of the first control, in some implementations, the electronic device may also display the first control while displaying the first virtual touchpad on the first user interface, and the first control may move with the movement of the first virtual touchpad; or, the first control may be a control that existed before the first virtual touchpad was displayed.

[0028] In conjunction with the first aspect or any embodiment of the first aspect, in some embodiments, the electronic device can also detect that a hand continuously touches and slides on the display screen while inputting the first touch gesture, and moves the position of the first virtual touchpad on the display screen as the hand slides. This embodiment allows users to easily move the virtual touchpad to a position that is easy for them to operate when the display screen of the electronic device is large, thus improving the user experience.

[0029] In conjunction with the first aspect or any embodiment of the first aspect, in some embodiments, a second virtual keyboard is displayed on the first user interface before a first touch gesture is detected on the display screen. The relationship between the first virtual touchpad and the second virtual keyboard can be any of the following:

[0030] The first virtual touchpad and the second virtual keyboard are in the same position and size on the display screen. In this way, the electronic device can efficiently switch between the first virtual touchpad and the second virtual touchpad.

[0031] The first virtual touchpad covers a portion of the second virtual keyboard. In this way, the electronic device displays both the touchpad and keyboard simultaneously, allowing users to easily choose which virtual operating area to interact with as needed.

[0032] The first virtual touchpad floats above the second virtual keyboard. This allows users to control both the keyboard and touchpad simultaneously, and also to manipulate any area of ​​the keyboard by moving the floating touchpad over areas previously obscured by the keyboard.

[0033] Adjust the display area of ​​the first virtual keyboard so that it does not overlap with the first virtual touchpad. This ensures the keyboard is unobstructed, allowing the user to simultaneously control the entire area of ​​both the keyboard and touchpad.

[0034] In conjunction with the first aspect or any embodiment of the first aspect, in some embodiments, when the first virtual touchpad is displayed on the first user interface, the layout of the first user interface on the display screen remains unchanged. Through this embodiment, the layout of the original interface is not affected when the electronic device opens the virtual touchpad.

[0035] In conjunction with the first aspect or any embodiment of the first aspect, in some embodiments, the electronic device is a foldable electronic device, and the display screen of the foldable electronic device includes a first screen and a second screen in the folded state. The electronic device can detect a first touch gesture on the first screen and display a first virtual touchpad on the first screen.

[0036] In conjunction with the previous embodiment, in some embodiments, the electronic device can move the touch focus on a second screen in response to a swipe operation on a first virtual touchpad. This embodiment allows users to conveniently perform uploading and downloading operations on a foldable electronic device.

[0037] Secondly, a method for activating a function is provided, the method being applied to an electronic device, the method including: displaying a first user interface; detecting a second touch gesture on the display screen, the second touch gesture including one of the following: a palm touch gesture, a multi-finger touch gesture; activating a first function of the electronic device.

[0038] The second approach allows electronic devices to activate the first function in response to the user's touch gesture when needed, enabling the user to open the first function efficiently, naturally, and conveniently.

[0039] In conjunction with the second aspect, in some embodiments, after activating the first function of the electronic device, the method can also deactivate the first function by either detecting that a hand that input a second touch gesture leaves the display screen, or detecting a user operation applied to a second control. The second control may, for example, be a control displayed in response to a second touch gesture. The embodiments of this application do not limit the implementation of the second control.

[0040] In conjunction with the previous embodiment, in some embodiments, after detecting a second touch gesture on the display screen, the method may further include: outputting a third prompt message. This third prompt message may, for example, be used to prompt a short-term use scenario of the first function. This third prompt message may also be used, for example, to prompt a method for closing the first function in a short-term use scenario. The embodiments of this application do not limit the implementation form of the third prompt message.

[0041] In conjunction with the second aspect or any implementation thereof, in some implementations, detecting a second touch gesture on the display screen specifically includes: detecting a second touch gesture on the display screen that does not meet the second condition.

[0042] In conjunction with the second aspect of the method, in some embodiments, after activating the first function of the electronic device, the method can also deactivate the first function by any of the following methods: detecting a second touch gesture on the display screen; or detecting a second touch gesture that meets a second condition on the display screen; or detecting a user operation performed on a second control. The second touch gesture here can be a different gesture or the same gesture as the second touch gesture in the second aspect.

[0043] In conjunction with the previous embodiment, in some embodiments, after detecting a second touch gesture on the display screen, the method may further include: outputting a fourth prompt message. This fourth prompt message may, for example, be used to indicate a prolonged use scenario of the first function. This fourth prompt message may also be used to indicate how to close the first function during prolonged use. The embodiments of this application do not limit the implementation form of the fourth prompt message.

[0044] In conjunction with the second aspect or any implementation thereof, in some implementations, detecting a second touch gesture on the display screen specifically includes: detecting a second touch gesture that meets a second condition on the display screen.

[0045] In conjunction with any implementation of the second condition mentioned in the second aspect, in some implementations, the second condition includes one or more of the following: a second duration condition, a second pressure condition, a second sliding distance condition, a second sliding direction condition, and a second number of touches condition.

[0046] In conjunction with the second aspect or any implementation thereof, in some implementations, the first function is set by default by the electronic device or by the user. For example, the first function may be the function of turning on the wireless local area network, the function of turning on the hotspot, the function of turning on Bluetooth, or the function of playing music, etc.

[0047] Thirdly, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement a method as described in the first aspect, or any embodiment of the first aspect, or the second aspect, or any embodiment of the second aspect.

[0048] Fourthly, a computer-readable storage medium is provided having a computer program stored thereon, wherein the computer program, when executed by a processor, implements a method as described in the first aspect, or any embodiment of the first aspect, or the second aspect, or any embodiment of the second aspect.

[0049] Fifthly, a computer program product is provided, the computer program product including a computer program, which, when executed by a processor, implements a method as described in the first aspect, or any implementation of the first aspect, or the second aspect, or any implementation of the second aspect.

[0050] In a sixth aspect, a chip system is provided, the chip system including a processing circuit and an interface circuit, the interface circuit being used to receive computer instructions and transmit them to the processing circuit, the processing circuit being used to execute the computer instructions to implement the method as described in the first aspect, or any embodiment of the first aspect, or the second aspect, or any embodiment of the second aspect. Attached Figure Description

[0051] Figures 1A-1C illustrate three ways to display a keyboard and touchpad using a foldable phone as an example.

[0052] Figure 1D illustrates several first touch gestures;

[0053] Figure 2A exemplarily illustrates a set of user interfaces displayed by an electronic device when the virtual operating area is used for a short period of time;

[0054] Figure 2B illustrates, for example, a set of user interfaces displayed by an electronic device when the virtual touchpad is used briefly;

[0055] Figure 2C illustrates, using a five-finger touch operation as an example, how an electronic device opens a virtual operation area.

[0056] Figure 2D illustrates, for example, how an electronic device switches between a touchpad and a keyboard, with the first touch operation being a five-finger touch operation.

[0057] Figure 2E exemplarily illustrates a set of user interfaces for opening a virtual operating area on a foldable electronic device;

[0058] Figure 3A exemplarily illustrates a set of user interfaces displayed by an electronic device when the virtual operating area is used for an extended period of time;

[0059] Figure 3B illustrates, for example, a set of user interfaces displayed on an electronic device when the virtual touchpad is used for an extended period of time;

[0060] Figure 4 illustrates an exemplary scenario of implementing the method provided in the embodiments of this application on a large-screen electronic device;

[0061] Figure 5 is a flowchart of the method for opening a virtual operation area provided in an embodiment of this application;

[0062] Figures 6A-6D are schematic diagrams of the contact points when the palm or fingers touch the display screen;

[0063] Figure 7 is a flowchart of the method for opening the function provided in an embodiment of this application;

[0064] Figure 8 is a hardware structure diagram of the electronic device provided in an embodiment of this application;

[0065] Figure 9 is a software structure diagram of the electronic device provided in an embodiment of this application. Detailed Implementation

[0066] The technical solutions in the embodiments of this application will be clearly and thoroughly described below with reference to the accompanying drawings.

[0067] Virtual operation areas commonly found in electronic devices include virtual keyboards and virtual touchpads. These areas are displayed on the screen, not physical keyboards or touchpads, hence the term "virtual" operation areas. A virtual keyboard, also known as a soft keyboard or touch keyboard, is a software-simulated interface that displays a physical keyboard on the screen. Users can input characters by clicking with a mouse or using the touchscreen. A virtual touchpad is a software-simulated touch area on the screen. Users can input touch operations in this area to control cursor movement, clicking, etc. The cursor's movement on the screen corresponds to the user's touch trajectory on the virtual touchpad. Touchpads are generally rectangular areas, but can also be circular or other shapes.

[0068] For the sake of brevity, the keyboard mentioned in the following embodiments of this application refers to the virtual keyboard displayed on the screen, and the touchpad mentioned refers to the virtual touchpad displayed on the screen.

[0069] In this embodiment, the virtual operating area may include, but is not limited to, a virtual keyboard and virtual touchpad. It may also include pages provided by an application or windows. Pages provided by the application may include, for example, the application's main page and subpages, such as the desktop page provided by a desktop application or the main page provided by a music application. Windows may include, for example, drop-down notification windows.

[0070] Figures 1A-1C illustrate three ways to display a keyboard and touchpad using a foldable phone as an example.

[0071] Figure 1A illustrates a foldable phone displaying a relatively small keyboard and touchpad. As shown in Figure 1A, the lower half of the display screen in the foldable phone houses the keyboard 101 and touchpad 102, with the touchpad 102 positioned in the center below the keyboard 101. In Figure 1A, to reduce the virtual operation area's footprint on the display screen, both the keyboard 101 and touchpad 102 have small operating areas, making it easy for users to accidentally touch the touchpad 102 when trying to operate on the keyboard 101. The small operating area of ​​the keyboard 101 leads to lower typing accuracy, and the small operating area of ​​the touchpad 102 results in some gestures being unusable or having a low success rate, and user operation feels cramped. Furthermore, using the method shown in Figure 1A, with both the keyboard 101 and touchpad 102 integrated into the display screen, the user's entire hand or elbow needs to frequently touch the screen, causing fatigue and potentially affecting the screen's lifespan.

[0072] Figure 1B illustrates how a foldable phone switches between displaying the keyboard and touchpad. As shown in Figure 1B, the foldable phone first displays the keyboard 101 in the lower area of ​​the screen and stops displaying the touchpad 102. When the user needs to use the touchpad 102, they can open the touchpad 102 by clicking a function button on the screen or by using a gesture, and then stop displaying the keyboard 101. The method shown in Figure 1B reduces the screen area occupied by displaying one operation area and stopping displaying another, and solves the problem of accidental touches. However, it requires the user to switch operation areas by clicking function buttons or inputting gestures, which involves multiple interaction steps and low efficiency. Repeatedly raising the elbow to switch operation areas can also cause fatigue for the user.

[0073] Figure 1C illustrates a foldable phone with a floating touchpad. As shown in Figure 1C, the foldable phone displays a keyboard 101 in the lower area of ​​the display screen and a floating touchpad 102 above it. The touchpad 102 can be dragged to other positions by the user. This method still suffers from accidental touches, and the two operation areas occupy a significant portion of the display screen area.

[0074] When a virtual operation area is displayed on the screen, it covers the content that is originally displayed. Its screen space occupancy affects other content output on the screen. Therefore, minimizing the screen space occupied by the virtual operation area is desirable for users. The method for opening a virtual operation area provided in this application embodiment can solve the problem of virtual operation area occupying screen space, improving screen utilization. Furthermore, this method also offers high interaction efficiency, natural interaction, and prevention of accidental touches.

[0075] In this application embodiment, the usage scenarios of the virtual operation area can be divided into long-term use scenarios and short-term use scenarios. Compared with short-term use scenarios, the virtual operation area is displayed on the display screen for a longer time in long-term use scenarios. The virtual operation area's presence on the display screen in long-term use scenarios can be referred to as persistent, while the virtual operation area's presence on the display screen in short-term use scenarios can be referred to as short-term persistence.

[0076] Comparing long-term and short-term usage scenarios, the ways to trigger the virtual operation area in the two scenarios are different, the ways to hide the virtual operation area in the two scenarios are different, and the impact of the two scenarios on areas outside the virtual operation area is different.

[0077] The method for opening the virtual operation area will now be described in conjunction with the user interface provided in the embodiments of this application.

[0078] Electronic devices can have a pre-set virtual operating area (such as a virtual keyboard or virtual touchpad). When the user needs to use this virtual operating area, they can input a first touch gesture by touching the display screen. The electronic device can then respond to this first touch gesture by opening the virtual operating area on the display screen.

[0079] The embodiments of this application do not limit the specific content of the first touch gesture.

[0080] The first touch gesture is input by the user's hand. The hand used to input the first touch gesture can be the entire palm or a part of the palm. The palm can include the thenar eminence, hypothenar eminence, palm center, and fingers. Fingers can include the thumb, index finger, middle finger, ring finger, and little finger. Each finger can be further divided into the fingertip and the web of the finger.

[0081] In some implementations, the first touch gesture may be, for example, a palm touch gesture, such as a gesture of touching the display screen with a single palm. Exemplarily, the first touch gesture may be a touch gesture input by the user's entire palm.

[0082] In some implementations, the first touch gesture can be, for example, a finger touch gesture, such as a gesture of multiple fingers touching the display screen. The multiple fingers can be fingers of the same hand. The multiple fingers can be five fingers, four fingers, three fingers, two fingers, etc. For example, the first touch gesture can be a touch gesture input by the user's five fingers.

[0083] This application does not limit the touch force of the first touch gesture. For example, it can be a light touch or a tap with a certain force, similar to a click. When the first touch gesture is input from multiple parts of the hand, the touch force of these multiple parts can be the same or different. For example, the first touch gesture is, for instance, a touch gesture where the user's entire palm presses heavily on the display screen.

[0084] This application does not limit the duration of the first touch gesture; for example, it can be a long touch or a short touch. When the first touch gesture is input from multiple parts of the hand, the touch duration of these multiple parts can be the same or different. For example, the first touch gesture may be a long-term touch gesture of the user's entire palm touching the display screen.

[0085] This application does not limit the sliding distance during the first touch gesture. For example, it can be a long sliding distance, a short sliding distance, or a stationary sliding distance. When the first touch gesture is input from multiple parts of the hand, the sliding distances of these multiple parts can be the same or different. For example, the first touch gesture may be a touch gesture in which the user's entire palm slides a certain distance on the display screen, or a touch gesture in which the user's five fingers slide outward from a point on the display screen (i.e., zoom in) or slide from different points towards a central point (i.e., pinch).

[0086] This application does not limit the sliding direction of the first touch gesture; for example, it can be an upward slide, a downward slide, or a leftward slide. When the first touch gesture is input from multiple parts of the hand, the sliding directions of these multiple parts can be the same or different. For example, the first touch gesture is, for instance, a touch gesture in which the user's entire palm slides from left to right on the display screen.

[0087] The embodiments of this application do not limit the number of touches in the first touch gesture; for example, it can be a single touch or multiple touches over a period of time.

[0088] The embodiments of this application do not limit the position of the first touch gesture input on the display screen.

[0089] Figure 1D illustrates several first touch gestures. The first touch gestures shown in Figure 1D are merely examples and do not constitute a limitation on the first touch gestures in the embodiments of this application.

[0090] As shown in Figure 1D(a), when the electronic device detects a user's palm touch gesture on the display screen, the electronic device responds to the palm touch gesture by displaying the virtual operation area 201 shown in Figure 1D(a) on the display screen.

[0091] As shown in Figure 1D(b), when the electronic device detects a gesture of the user's five fingertips touching the display screen, the electronic device responds to the five-finger touch gesture and displays the virtual operation area 201 shown in Figure 1D(b) on the display screen.

[0092] As shown in Figure 1D(c), when the electronic device detects a user's palm touches the display screen and slides on the display screen, the electronic device responds to the palm touch gesture and displays the virtual operation area 201 shown in Figure 1D(c) on the display screen.

[0093] As shown in Figure 1D(d), when the electronic device detects that the user's five fingertips touch the display screen and the five fingers slide towards the center, i.e., a five-finger pinch gesture, the electronic device responds to the five-finger pinch gesture and displays the virtual operation area 201 shown in Figure 1D(d) on the display screen.

[0094] After the electronic device displays the virtual operating area on the screen, it will identify whether the current scenario is a short-term or long-term use scenario, and adaptively provide different interaction methods accordingly. The following examples, using the user interface, illustrate two different use scenarios.

[0095] Scenario 1: Short-term use of the virtual operating area

[0096] Triggering method for scenario 1

[0097] In this embodiment of the application, if the first touch gesture detected by the electronic device does not meet the first condition, the electronic device will enter a scenario of short-term use of the virtual operation area.

[0098] The embodiments of this application do not limit the specific content of the first condition. The first condition can be defined by the user as needed, or it can be preset in the electronic device. The first condition may include, but is not limited to, conditions such as touch duration, touch pressure, swipe distance during touch, swipe direction during touch, and number of touches.

[0099] In some implementations, the first condition may include one or more of the following: a first duration condition, a first pressure condition, a first sliding distance condition, a first sliding direction condition, and a first number of touches condition.

[0100] For example, when the first touch gesture is a palm touch gesture, the first condition may include one or more of the following: the duration of palm touch on the display screen meets a first duration condition (e.g., greater than a second duration), the pressure of palm touch on the display screen meets a first pressure condition (e.g., greater than a first pressure value), the duration of palm touch on the display screen meets a first sliding distance condition (e.g., greater than a first sliding distance), the duration of palm touch on the display screen meets a first sliding direction condition (e.g., sliding in a first sliding direction), and the duration of palm touch on the display screen meets a first touch count condition (e.g., a single touch).

[0101] For example, when the first touch gesture is a multi-finger touch gesture, the first condition may include one or more of the following: the duration of multi-finger touch on the display screen meets the first duration condition (e.g., greater than a third duration), the pressure of multi-finger touch on the display screen meets the first pressure condition (e.g., greater than a second pressure value), the duration of multi-finger touch on the display screen meets the first sliding distance condition (e.g., greater than a second sliding distance), the duration of multi-finger touch on the display screen meets the first sliding direction condition (e.g., multiple fingers slide outward from a center point in different directions, or multiple fingers slide towards the same center point from different positions, or multiple fingers slide in the same direction), and the duration of multi-finger touch on the display screen meets the first touch count condition (e.g., single touch or multiple touches).

[0102] Hiding the virtual operation area in scenario 1

[0103] In Scenario 1, the virtual operation area can be hidden in the following two ways:

[0104] 1. In some embodiments, after displaying the virtual operation area, the electronic device may stop displaying the virtual operation area after detecting that the hand that entered the first touch gesture has left the display screen and that there is no touch event on the virtual operation area. In this embodiment, the order in which the electronic device detects that the hand that entered the first touch gesture has left the display screen and that there is no touch event on the virtual operation area is not limited; the two can be detected sequentially or simultaneously.

[0105] 2. In some implementations, the electronic device may stop displaying the virtual operating area in response to a user operation on the first control.

[0106] In some embodiments, the electronic device may also respond to a first touch gesture by displaying functional controls for operating the virtual operation area while simultaneously displaying the virtual operation area. These functional controls may include, for example, one or more of the following: a close control, a zoom control, a zoom-out control, a move control, etc. This application embodiment does not limit the form of these functional controls; for example, they may be controls capable of receiving click operations or controls capable of receiving swipe operations. These functional controls may be located within the virtual operation area (such as the upper right or lower right corner of the virtual operation area) or outside the virtual operation area; this application embodiment does not limit this. After displaying the virtual operation area, the electronic device may stop displaying the virtual operation area in response to a user operation applied to the close control. The user operation applied to the close control may be, for example, a click operation, a touch operation, a swipe operation, etc.; this application embodiment does not limit this. The close control is one form of the first control.

[0107] In some implementations, the electronic device may display a first control before the virtual operation area is displayed; that is, the first control is a control that exists before the virtual operation area is displayed. For example, the first control may be a control that is permanently displayed in the sidebar or drop-down notification bar of the screen, or it may be a floating control. As another example, the first control may be used to clear all virtual operation areas displayed by the electronic device with a single click.

[0108] 3. In some embodiments, after displaying the virtual operation area, the electronic device can detect user operations applied to areas outside the virtual operation area and can stop displaying the virtual operation area in response to the user operation. The area outside the virtual operation area may include, for example, the entire area outside the virtual operation area, a blank area without displayed elements outside the virtual operation area, or a preset area outside the virtual operation area. The preset area outside the virtual operation area can be preset by the user; for example, the user can set a fixed-size area in the lower right corner of the display screen as the preset area. User operations applied to areas outside the virtual operation area can be, for example, click operations, touch operations, swipe operations, etc., and this application embodiment does not limit this.

[0109] In some implementations, the premise of the second and third methods mentioned above is that there are no touch events on the virtual operation area. This is because if there are still touch events on the virtual operation area, it means that the user still intends to interact with the virtual operation area. At this time, even if the user operation of closing the virtual operation area in the second and third methods mentioned above is detected, the electronic device can continue to display the virtual operation area, thereby meeting the user's actual needs.

[0110] Interaction methods outside the virtual operation area in Scenario 1

[0111] In this embodiment of the application, when the virtual operation area is used for a short period of time, other areas of the display screen outside the virtual operation area will be disabled when the electronic device displays the virtual operation area. That is, the electronic device will not respond to user operations in other areas and perform corresponding actions. It is equivalent to the electronic device refusing to respond to user operations applied to other areas.

[0112] Figure 2A illustrates an example of a set of user interfaces displayed on an electronic device in scenario 1. This set of user interfaces uses a palm touch gesture as an example of a first touch gesture.

[0113] Figure 2A(a) shows the initial state of the electronic device, where the device displays the original image on the screen. This image is not shown in the figure for the sake of brevity. If the electronic device is foldable, its initial folding state is unrestricted; for example, it can be in a fully unfolded state or in a hovering state where it is fixed at a certain angle during folding.

[0114] Referring to Figure 2A(b), when a user touches the display screen with their palm, the electronic device responds to the palm touch gesture by displaying a virtual operation area 201 on the display screen. The type of the virtual operation area 201 is preset by the electronic device, which may be the default setting of the electronic device or a setting made by the electronic device in response to the user's settings operation. For example, the virtual operation area 201 may be a virtual touchpad selected by the user in the settings application.

[0115] This application does not limit the position of the virtual operation area 201 on the display screen. In some embodiments, the virtual operation area 201 can be displayed in a position on the display screen that is easy for the user to operate, such as the lower and right position of the display screen shown in FIG2A(b), which facilitates the user's right hand to input operations on the virtual operation area 201. In some embodiments, the virtual operation area 201 can be displayed in an area on the display screen where the touch area of ​​the first touch gesture does not overlap or partially overlaps, such as the virtual operation area 201 that does not overlap with the touch area of ​​the first touch gesture shown in FIG2A(b). In this way, the first touch gesture will not obscure the virtual operation area 201 too much, which makes it convenient for the user to operate in the virtual operation area 201. In some embodiments, the virtual operation area 201 can also be fixedly displayed in the center area of ​​the display screen.

[0116] The shape of the virtual operation area 201 is not limited in this embodiment; it can be implemented as a rectangle, a circle, or other shapes.

[0117] The virtual operation area 201 is not limited in size in this embodiment. For example, it can occupy the lower half of the area in the display direction of the screen, or it can occupy a small area in the lower part of the display direction of the screen as shown in Figure 2A(b).

[0118] The position, size, and shape of the virtual operation area 201 on the display screen can be set by default by the electronic device or preset by the user. The virtual operation area 201 can have a background color to make it stand out on the display screen.

[0119] In some implementations, the virtual operation area 201 can also be dragged and dropped by the user to other locations as needed.

[0120] For example, the virtual operation area 201 can move its position as the hand that inputs the first touch gesture continues to touch and slide on the display screen. This movement of the virtual operation area 201, driven by the hand's movement, allows the user to easily move it to a position convenient for operation, especially on large electronic device displays, thus improving the user experience. For example, referring to Figures 2A(b) and 2A(n), when the user's palm continuously touches the display screen and slides upwards, the virtual operation area 201 adjusts its position accordingly, maintaining the relative position of the virtual operation area 201 and the user's palm before and after the adjustment.

[0121] For example, after a user inputs the first touch gesture and lifts their hand, they can input a long press gesture on the virtual operation area 201 to trigger the virtual operation area to enter a draggable state. Then, the user can drag the virtual operation area 201 to the desired position using their finger, stylus, or other touch-enabled parts.

[0122] In this embodiment of the application, the palm touch gesture input by the user in Figure 2A(b) does not meet the first condition, so the electronic device enters a short-term use scenario in the virtual operation area.

[0123] In some embodiments, when the electronic device displays the virtual operation area 201 in response to a palm touch gesture, it recognizes a short-term usage scenario and can output a first prompt message. This first prompt message can be used to inform the user that the virtual operation area 201 has been briefly opened or that the user has entered a short-term usage scenario within the virtual operation area. In some embodiments, the first prompt message can also be used to inform the user about the method of hiding the virtual operation area during the short-term usage scenario, and / or the interaction method for other areas outside the virtual operation area. This application does not limit the form of the first prompt message; for example, it may include visual interface elements on the display screen (such as the background color and border of the virtual operation area 201, prompt text displayed on the display screen, etc.), voice, vibration, indicator lights, etc.

[0124] In short-term use scenarios, in some implementations, the virtual operation area 201 can be overlaid on the original interface of the display screen, located on top of the display screen. The layout of the original interface can remain unchanged, and the content of the original interface covered by the virtual operation area 201 can become invisible to the user. In some implementations, the electronic device can shrink the original interface displayed on the display screen to an area other than the virtual operation area 201, so that the original interface will not be covered by the virtual operation area 201 and the display of the original interface will not be affected.

[0125] In some implementations, when the virtual operation area is used for a short period of time, other areas of the display screen will be disabled when the electronic device displays the virtual operation area 201, that is, the electronic device will not respond to user operations in other areas and perform the corresponding functions.

[0126] When the electronic device displays the virtual operation area 201, the virtual operation area 201 has the highest priority on the display screen and is on the topmost layer. The electronic device will not switch other content to the layer above the virtual operation area 201, thus making the virtual operation area 201 invisible. That is, the virtual operation area 201 will not be covered by other content and become invisible.

[0127] Referring to Figure 2A(c), when a user's palm continuously touches the display screen, the electronic device can receive touch operations on the virtual operation area 201, such as swiping or clicking operations input by a finger or stylus, and execute corresponding functions in response to the operation. When the virtual operation area 201 is a virtual keyboard, the user can input characters through the virtual keyboard. When the virtual operation area 201 is a virtual touchpad, the user can input swiping operations to control cursor movement, clicking operations to click controls, and long-press operations to select content, etc.

[0128] When there are no touch events from the palm of the hand or from the user's finger or stylus on the virtual operating area 201 on the display of the electronic device, the electronic device will stop displaying the virtual operating area 201.

[0129] Referring to Figure 2A(d), if the user's palm leaves the display screen while the user is inputting a touch operation into the virtual operation area 201, the electronic device will continue to display the virtual operation area 201, allowing the user's touch operation to continue. Referring to Figure 2A(e), when the user stops inputting a touch operation into the virtual operation area 201, the electronic device will stop displaying the virtual operation area 201.

[0130] Referring to Figure 2A(f), when the user's finger or stylus stops inputting a touch operation on the virtual operation area 201, the electronic device will continue to display the virtual operation area 201 because the user's palm is still touching the display screen. Referring to Figure 2A(g), when the user's palm leaves the display screen, the electronic device will stop displaying the virtual operation area 201.

[0131] Referring to Figure 2A(b) and Figure 2A(h), after the electronic device displays the virtual operation area 201, if the user's palm leaves the display screen and the user has not yet input a touch operation to the virtual operation area 201 with a finger or stylus, the electronic device will directly stop displaying the virtual operation area.

[0132] Referring to Figure 2A(b), Figure 2A(i), and Figure 2A(j), after the electronic device displays the virtual operation area 201, if the user's palm continues to touch the display screen, the electronic device can receive touch operations in other areas outside the virtual operation area 201, such as sliding operations or clicking operations input by fingers or styluses. In response to the touch operations in other areas outside the virtual operation area 201, the electronic device will stop displaying the virtual operation area 201.

[0133] Referring to Figures 2A(k)-2A(m), after the electronic device displays the initial state shown in Figure 2A(a), in response to a palm touch on the display screen, it can display the virtual operation area 201 and the closing control 201a at the same time. Afterwards, if the user's palm continues to touch the display screen, the electronic device can receive the user operation applied to the closing control 201a and stop displaying the virtual operation area 201 in response to the user operation.

[0134] In the user interface shown in Figure 2A, the user opens the virtual operation area 201 on the electronic device by placing their palm on the display screen. The user can also trigger the electronic device to stop displaying the virtual operation area 201 through various means (such as lifting their palm or the absence of touch events on the virtual operation area 201). In this way, the virtual operation area 201 does not need to be constantly displayed on the screen, thus increasing screen space utilization. The size of the virtual operation area 201 can be set for easy operation, improving the accuracy and convenience of user operations on the virtual operation area 201.

[0135] In the user interface shown in Figure 2A, the user can open the virtual control area 201 in the electronic device by touching the display screen with one hand, and can use the fingers of the other hand to operate the virtual control area 201. By using both hands together, the electronic device can stop displaying the virtual control area 201. This method allows the user to conveniently, naturally and efficiently operate the virtual control area 201 with both hands.

[0136] Figure 2A illustrates an interactive method for opening and closing the virtual control area 201 via palm touch gestures, which is natural, efficient, and convenient for users. Compared to the methods shown in Figures 1A and 1C, using the method in Figure 2A, when the virtual control area 201 is located in the lower part of the display screen, the user's elbow and most of their hand can rest on the table, requiring only brief contact with the display screen using their palm or fingers. This reduces user fatigue when using the virtual control area and also extends the lifespan of the display screen.

[0137] Figure 2B illustrates another set of user interfaces displayed on an electronic device in scenario 1.

[0138] The user interface shown in Figure 2B uses a touchpad as an example of a preset virtual operating area on an electronic device, and demonstrates the switching process between two virtual operating areas. The user interface shown in Figure 2B uses a palm touch gesture as an example of a first touch gesture.

[0139] Figure 2B(a) shows the initial state of the electronic device, which is a foldable device in a hovering state, with the keyboard 202 displayed on the screen. This embodiment does not limit the size or position of the keyboard 202 on the screen; these two aspects can be set by default by the electronic device. Other interface information can also be displayed in the area outside the keyboard 202 on the screen, but these are not shown in the figure for the sake of brevity. Figure 2B(a) exemplarily shows the keyboard 202 located in the lower part of the display direction, and the width of the keyboard 202 is the same as the width of the display screen. This embodiment does not limit the way the keyboard 202 is invoked. For example, the electronic device can use the method provided in this embodiment to display the keyboard 202, or the electronic device can receive a user's click to invoke the keyboard 202.

[0140] Referring to Figure 2B(b), when a user touches the display screen with their palm, the electronic device responds to the palm touch gesture and displays the touchpad 203 on the display screen. The position, size, shape, etc. of the touchpad 203 can be referred to the previous description of the virtual operation area 201 in Figure 2A. The touchpad 203 shown in Figure 2B(b) is positioned and sized the same as the keyboard 202, so that the touchpad 203 completely covers the keyboard 202, and the user will not accidentally touch the keyboard 202 when operating the touchpad 203.

[0141] Referring to Figure 2B(c), when a user's palm continuously touches the display screen, the electronic device can receive touch operations on the touchpad 203, such as sliding operations or clicking operations input by a finger or stylus, and respond to the operation by executing corresponding functions such as controlling cursor movement or clicking controls.

[0142] As long as the user's palm continues to touch the display screen, the electronic device can respond to the operation by displaying the touchpad 203. When there is no palm touch event or user finger or stylus touch event on the touchpad 203 on the display screen of the electronic device, the electronic device will stop displaying the touchpad 203.

[0143] Referring to Figure 2B(d), if the user's palm leaves the display screen while the user is inputting a touch operation onto the touchpad 203, the electronic device will continue to display the touchpad 203, allowing the user's touch operation to continue. Referring to Figure 2B(e), when the user stops inputting a touch operation onto the touchpad 203, the electronic device will stop displaying the touchpad 203 and redisplay the keyboard 202.

[0144] Referring to Figure 2B(f), when the user's finger or stylus stops inputting a touch operation on the touchpad 203, the electronic device will continue to display the touchpad 203 because the user's palm is still touching the display screen. Referring to Figure 2B(g), when the user's palm leaves the display screen, the electronic device will stop displaying the touchpad 203 and redisplay the keyboard 202.

[0145] Referring to Figure 2B(b) and Figure 2B(h), after the electronic device displays the touchpad 203, if the user's palm leaves the display screen and the user has not yet input a touch operation to the touchpad 203 with a finger or stylus, the electronic device will directly stop displaying the touchpad 203 and redisplay the keyboard 202.

[0146] Referring to Figure 2B(b), Figure 2B(i), and Figure 2B(j), after the electronic device displays the touchpad 203, if the user's palm continues to touch the display screen, the electronic device can receive touch operations on other areas besides the touchpad 203, such as sliding operations or clicking operations input by fingers or styluses. In response to the touch operations on other areas besides the touchpad 203, the electronic device will stop displaying the touchpad 203 and redisplay the keyboard 202.

[0147] Referring to Figures 2B(k)-2B(m), after the electronic device displays the initial state shown in Figure 2B(a), in response to a palm touch on the display screen, it can display the touchpad 203 and the close control 203a at the same time. Afterwards, if the user's palm continues to touch the display screen, the electronic device can receive the user operation applied to the close control 203a and, in response to the user operation, stop displaying the virtual operation area 201 and redisplay the keyboard 202.

[0148] In the user interface shown in Figure 2B, the virtual operation areas that the electronic device can open may include the keyboard 202, touchpad 203, etc. When there are multiple virtual operation areas, the electronic device defaults to opening only one virtual operation area at a time. When the user's palm rests on the display screen, the electronic device opens the touchpad 203. The user can also trigger the electronic device to stop displaying the touchpad 203 and open the keyboard 202 through certain methods (such as lifting the user's palm or the absence of a touch event on the touchpad 203). When the touchpad 203 and keyboard 202 are of the same position and size, accidental touches when switching between the keyboard 202 and touchpad 203 can be avoided. The user interface shown in Figure 2B allows for quick switching between the keyboard 202 and touchpad 203, preventing accidental touches on the touchpad 203 while typing and also preventing accidental touches on the keyboard 202 while controlling the cursor.

[0149] In addition to the electronic device described in Figure 2B above, which defaults to opening only one virtual operating area at a time, in some implementations, the electronic device can also open multiple virtual operating areas at the same time.

[0150] For example, referring to Figures 2B(a) and 2B(n), after receiving a first touch operation, the electronic device can display a touchpad 203. The touchpad 203 covers the keyboard 202 and occupies part of the display area of ​​the keyboard 202, such as half of the display area. In this embodiment, the hierarchical relationship between virtual operation areas does not affect user operation; regardless of which layer a virtual operation area is located on, the user can interact with that virtual operation area. Therefore, the electronic device displays both the touchpad 203 and the keyboard 202 simultaneously, allowing the user to conveniently select which virtual operation area to interact with as needed.

[0151] For example, referring to Figures 2B(a) and 2B(o), after receiving a first touch operation, the electronic device can shrink the keyboard 202 to occupy half of the original display area, while simultaneously displaying the touchpad 203 in the other half of the original display area of ​​the keyboard 202. The touchpad 203 covers the keyboard 202 and occupies half of the keyboard 202's display position. In this way, the keyboard 202 is not obstructed, and the user can simultaneously control the entire area of ​​both the keyboard 202 and the touchpad 203. In other embodiments, the size is not limited to half the original display area; the electronic device can also adjust the virtual keyboard to other sizes, as long as the keyboard 202 and the touchpad 203 do not obstruct each other.

[0152] For example, referring to Figures 2B(a) and 2B(p), after receiving a first touch operation, the electronic device can display a touchpad 203, which can be displayed floating above the keyboard 202. In this way, the user can simultaneously control the keyboard 202 and the touchpad 203, and the user can also control any area of ​​the keyboard 202 by moving the floating touchpad 203 over areas previously obscured by the touchpad 203.

[0153] Not limited to the palm touch operation shown in Figures 2A and 2B, in some embodiments, the first touch operation can also be other operations.

[0154] For example, referring to Figure 2C, which exemplifies how an electronic device opens a virtual operation area using a five-finger touch operation as the first touch operation. Compared to Figure 2A, Figure 2C essentially replaces the palm touch operation in Figure 2A with a five-finger touch operation. Figure 2C(a) shows the initial state of the electronic device. Referring to Figure 2C(b), when a user touches the display screen with five fingers, the electronic device responds to the five-finger touch gesture and displays the virtual operation area 201 on the display screen. In this user interface shown in Figure 2C, the user can subsequently close the virtual operation area 201 according to actual needs. The method for closing the virtual operation area 201 can be found in the relevant description in Figure 2A, and will not be repeated here.

[0155] For example, referring to Figure 2D, which exemplifies how an electronic device switches between the touchpad and keyboard, using a five-finger touch operation as the first touch action. Compared to Figure 2B, Figure 2D essentially replaces the palm touch operation in Figure 2B with a five-finger touch operation. Figure 2D(a) shows the initial state of the electronic device. Referring to Figure 2D(b), when a user touches the display screen with five fingers, the electronic device responds to the five-finger touch gesture and displays the touchpad 203 on the screen. In this user interface shown in Figure 2D, the user can subsequently disable the touchpad 203 as needed. The method for disabling the touchpad 203 can be found in the relevant description in Figure 2B, and will not be repeated here.

[0156] Not limited to the switching between keyboard 202 and touchpad 203 shown in Figures 2B and 2D, the method of this application embodiment can also be applied to the switching between other virtual display areas.

[0157] After the electronic device displays the virtual operation area 201, the virtual operation area 201 can interact with the user.

[0158] When the virtual operation area 201 is a virtual touchpad, the user can input swipe operations on the virtual operation area 201 to control the position of the touch focus on the display screen. The touch focus is usually displayed on the display screen using a cursor or other markers to indicate the location of the touch focus to the user.

[0159] In some implementations, operations on the virtual operation area 201 can be mapped to the entire display screen of the electronic device. That is, the user's swiping operation on the virtual operation area 201 can control the area displayed on the entire display screen located below the virtual operation area 201.

[0160] In some implementations, operations on the virtual operation area 201 can be mapped to other areas of the display screen besides the display area of ​​the virtual operation area 201. That is, the user's swiping operation on the virtual operation area 201 can control other display areas on the display screen where the virtual operation area 201 is located.

[0161] In some embodiments, the electronic device is a foldable electronic device, and its display screen can be divided into a first screen and a second screen in the foldable state. If the electronic device receives a first touch gesture input by the user on the first screen in the folded state, the electronic device can display a virtual operation area 201 on the first screen, which can occupy part or all of the area of ​​the first screen. Furthermore, the operation input by the user on the virtual operation area 201 can be mapped to the second screen; that is, the virtual operation area 201 is invoked on the screen on which the user inputs the first touch gesture, and the other screen can be controlled through the virtual operation area 201. For example, referring to FIG2E(a), the electronic device is in a folded state, and the display screen is divided into a lower first screen and an upper second screen. As shown in FIG2E(b), when the first screen detects a first touch gesture, the electronic device displays the virtual operation area 201 on the first screen. As shown in FIG2E(c), the user can input a swipe operation on the virtual operation area 201 using a finger or stylus, etc. As shown in FIG2E(d), in response to the swipe operation input by the user on the virtual operation area 201 on the first screen, the electronic device moves the touch focus on the second screen. Users can also input clicks on the virtual operation area 201 to trigger the electronic device to select the content displayed on the currently touched focus on the second screen. As can be seen, users can easily perform up-and-down control on the foldable electronic device.

[0162] In conjunction with the previous implementation method, after the electronic device receives the first touch gesture in the foldable state, the content originally displayed on the screen can remain unchanged, or the electronic device can move all the content originally displayed on the screen to the second screen, which makes it convenient for the user to control the original interface through the virtual operation area 201.

[0163] Scenario 2: Scenarios involving prolonged use of the virtual operating area

[0164] Triggering method for scenario 1

[0165] In this embodiment, if the first touch gesture detected by the electronic device meets the first condition, the electronic device will enter a scenario of short-term use of the virtual operation area. The definition of the first condition can be found in the relevant description in Scenario 1 above.

[0166] For example, when the first touch gesture is a palm touch gesture, the first touch gesture that meets the first condition may include, but is not limited to: palm long press gesture, palm heavy press gesture, palm multiple touch gesture, and palm swipe gesture. When the first touch gesture is a multi-finger touch gesture, the first touch gesture that meets the first condition may include, but is not limited to: multi-finger long press gesture, multi-finger heavy press gesture, multi-finger multi-tap gesture, multi-finger pinch gesture, and multi-finger zoom gesture.

[0167] Hiding the virtual operation area in scenario 2

[0168] In Scenario 2, the virtual operation area can be hidden in the following ways:

[0169] 1. In some embodiments, after displaying a virtual operation area, if the user's hand has left the display screen and there is no touch event on the virtual operation area for a first duration, the electronic device may stop displaying the virtual operation area. In this embodiment, the order in which the electronic device detects the hand leaving the display screen to input the first touch gesture and the absence of touch event on the virtual operation area for the first duration is not limited; they can be detected sequentially or simultaneously. This application does not limit the specific value of the first duration. The value of the first duration can be set by the user as needed, or it can be preset in the electronic device.

[0170] 2. In some embodiments, if the electronic device detects a first touch gesture again on the display screen after displaying the virtual operation area, it stops displaying the virtual operation area in response to the first touch gesture. The first touch gesture detected again and the first touch gesture that triggered the display of the virtual operation area may not be the same gesture. For example, the user may trigger the display of the virtual operation area with a palm touch gesture, and trigger the stop of the display of the virtual operation area with a multi-finger touch gesture. The first touch gesture detected again and the first touch gesture that triggered the display of the virtual operation area may be input by the same hand or by different hands.

[0171] 3. In some embodiments, after displaying the virtual operation area, if a first touch gesture meeting the first condition is detected on the display screen, the electronic device stops displaying the virtual operation area in response to the first touch gesture meeting the first condition. The first touch gesture meeting the first condition that is detected again and the first touch gesture that triggers the display of the virtual operation area may not be the same gesture. For example, a user can trigger the display of the virtual operation area by pressing down with their palm, while a touch gesture of sliding and converging five fingers towards the center point can trigger the cessation of the display of the virtual operation area. The first touch gesture meeting the first condition that is detected again and the first touch gesture that triggers the display of the virtual operation area may be input by the same hand or by different hands.

[0172] 4. In some embodiments, the electronic device may also, in response to a first touch gesture, display functional controls for operating the virtual operation area, such as a close control, while simultaneously displaying the virtual operation area. After displaying the virtual operation area, the electronic device may, in response to a user operation on the close control, stop displaying the virtual operation area. Specific implementation details of this embodiment can be found in the relevant embodiments of Scenario 1, and will not be repeated here.

[0173] 5. In some embodiments, after displaying the virtual operation area, the electronic device can detect user operations applied to areas outside the virtual operation area and can stop displaying the virtual operation area in response to the user operation. Specific implementation details of this embodiment can be found in the relevant embodiments in Scenario 1, and will not be repeated here.

[0174] In some implementations, the premise of the above methods 2-5 is that there are no touch events on the virtual operation area. This is because if there are still touch events on the virtual operation area, it means that the user still intends to interact with the virtual operation area. At this time, even if the user operation of closing the virtual operation area in the above methods 2-3 is detected, the electronic device can continue to display the virtual operation area, thereby meeting the user's actual needs.

[0175] Interaction methods outside the virtual operation area in scenario 2

[0176] In the embodiments of this application, in scenarios where the virtual operation area is used for a long time, when the electronic device displays the virtual operation area, other areas on the display screen outside the virtual operation area remain effective, that is, the electronic device can still respond to user operations in other areas and perform corresponding actions.

[0177] Figure 3A exemplarily illustrates a set of user interfaces displayed on an electronic device in scenario 2. This set of user interfaces uses a palm touch gesture as an example of a first touch gesture, and a first condition as either a first pressure condition or a first duration condition.

[0178] Figure 3A(a) shows the initial state of the electronic device, where the device displays the original image on the screen. This image is not shown in the figure for the sake of brevity. If the electronic device is foldable, its initial folding state is unrestricted; for example, it can be in a fully unfolded state or in a hovering state where it is fixed at a certain angle during folding.

[0179] Referring to Figure 3A(b), when a user touches the display screen with their palm, the electronic device responds to the palm operation and displays a virtual operation area 201 on the display screen. This step can be referred to the relevant description in Figure 2A(b) above.

[0180] Referring to Figure 3A(c), when the user's palm touches the display screen for a duration exceeding T1, and / or when the pressure of the user's palm pressing the display screen exceeds F1, the electronic device will respond to the above operations and enter a long-term use scenario in the virtual operation area, i.e., the virtual operation area 201 will be permanently displayed. That is, even after the user's palm is lifted and / or there is no touch event on the virtual operation area, the electronic device will continue to display the virtual operation area 201. As shown in Figure 3A(d), the electronic device will still display the virtual operation area 201 after the user's palm leaves the display screen.

[0181] In some embodiments, when the electronic device displays the virtual operation area 201 in response to a palm touch gesture, it recognizes a prolonged usage scenario and can output a second prompt message. This second prompt message can be used to inform the user that the virtual operation area 201 has been open for a prolonged period or that the user has entered a prolonged usage scenario within the virtual operation area. In some embodiments, the second prompt message can also be used to inform the user about the hiding method of the virtual operation area during a prolonged usage scenario, and / or the interaction method of other areas outside the virtual operation area. This application does not limit the form of the second prompt message; for example, it may include visual interface elements on the display screen (such as the background color and border of the virtual operation area 201, the prompt text displayed on the display screen, etc.), voice, vibration, indicator lights, etc. The second prompt message differs from the first prompt message, allowing the user to distinguish different scenarios through the prompt information.

[0182] As long as the electronic device is still displaying the virtual operation area 201, the virtual operation area 201 can receive user input, and the electronic device can execute the corresponding function in response to the input. As shown in Figure 3A(e), the virtual operation area 201 can receive user finger input.

[0183] For long-term use scenarios, the display position of the virtual operation area 201, the way it moves on the display screen, and the interaction between the virtual operation area 201 and the user can all refer to the corresponding introductions for short-term use scenarios. For example, you can refer to the relevant content in Figure 2A, Figure 2B, and Figure 2D. They will not be repeated here.

[0184] While the virtual operation area 201 is constantly displayed, other areas of the display screen remain active, meaning the electronic device can respond to user actions in other areas and execute corresponding functions. For example, when the virtual operation area 201 is a virtual keyboard, the user can first select a text input box in the existing interface displayed on the screen with their finger or a stylus, and then input characters through the virtual keyboard.

[0185] When the electronic device displays the virtual operation area 201, the virtual operation area 201 has the highest priority on the display screen and is on the topmost layer. The electronic device will not switch other content to the layer above the virtual operation area 201, thus making the virtual operation area 201 invisible. That is, the virtual operation area 201 will not be covered by other content and become invisible.

[0186] Referring to Figure 3A(f), after the user's palm leaves the display screen, if the duration of no touch event on the virtual operation area 201 is greater than T2, the electronic device can stop displaying the virtual operation area 201.

[0187] Referring to Figure 3A(g), when there is no touch event on the virtual operation area 201, if the user's palm touches and covers the display screen, the electronic device will stop displaying the virtual operation area 201 in response to the palm operation.

[0188] In some implementations, once the electronic device is permanently displaying the virtual operation area 201, the user's palm can continuously touch the display screen, and this palm operation will keep the virtual operation area 201 continuously displayed. For example, if the user's palm continues to touch the display screen after Figure 3A(b), then after Figure 3A(e), even if there is no touch event on the virtual operation area 201 for a duration greater than T2, the electronic device can continue to display the virtual operation area 201. As another example, if the user's palm continues to touch the display screen after Figure 3A(b), then after Figure 3A(e), the user can first remove their palm from the display screen, and then touch and cover the display screen with their palm, thereby triggering the electronic device to stop displaying the virtual operation area 201.

[0189] In the user interface shown in Figure 3A, the user opens the virtual operation area 201 of the electronic device by placing their palm on the display screen. The virtual operation area 201 is kept active by pressing or long-pressing the display screen. When the duration of no touch event on the virtual operation area 201 exceeds T2, or when the user's palm touches and covers the display screen again, the electronic device stops displaying the virtual operation area. In this way, the virtual operation area 201 can be displayed on the screen for a period of time and can stop displaying as the user interacts with it, without continuously occupying screen space, thus improving screen utilization. The size of the virtual operation area 201 can be set for easy operation, improving the accuracy and convenience of user operations on the virtual operation area 201.

[0190] In addition to the methods shown in Figure 3A for stopping the display of the virtual operation area 201, in some embodiments, the electronic device can also hide the virtual operation area 201 in other ways described above. For example, the electronic device can also stop displaying the virtual operation area 201 in response to a detected first touch gesture that meets a first condition, or in response to a user operation on a close control, or in response to a user operation on an area other than the virtual operation area 201.

[0191] In the user interface shown in Figure 3A, the user can touch the display screen with one hand to operate the virtual control area 201 of the electronic device, and use the fingers of the other hand to control the virtual control area 201. This method allows the user to conveniently, naturally and efficiently control the virtual control area 201 with both hands.

[0192] Figure 3A shows an interactive method for opening and maintaining the virtual operation area 201 via palm operation, which is natural, efficient, and convenient for users. The method shown in Figure 3A is the same as that in Figure 2A, which can also reduce user fatigue when using the virtual operation area and extend the lifespan of the display screen.

[0193] Figure 3B illustrates another set of user interfaces displayed on an electronic device in scenario 2.

[0194] The user interface shown in Figure 3B uses the touchpad as an example of a virtual operating area preset by an electronic device, and the user interface demonstrates the switching process between two virtual operating areas.

[0195] Figure 3B(a) shows the initial state of the electronic device, which is a foldable device in a hovering state, with the keyboard 202 displayed on the screen. This embodiment does not limit the size or position of the keyboard 202 on the screen; these two aspects can be set by default by the electronic device. Other interface information can also be displayed in the area of ​​the screen other than the keyboard 202; however, this interface information is not shown in the figure for the sake of brevity. Figure 3B(a) exemplarily shows the keyboard 202 located in the lower part of the display direction, and the width of the keyboard 202 is the same as the width of the display screen.

[0196] Referring to Figure 3B(b), when a user touches the display screen with their palm, the electronic device responds to the palm operation by displaying the touchpad 203 on the display screen. The position, size, shape, etc. of the touchpad 203 can be referred to the previous description of the virtual operation area 201 in Figure 2A. The touchpad 203 shown in Figure 3B(b) is positioned and sized the same as the keyboard 202, so that the touchpad 203 completely covers the keyboard 202, and the user will not accidentally touch the keyboard 202 when operating the touchpad 203.

[0197] Referring to Figure 3B(c), when the user's palm touches the display screen for a duration exceeding T1, and / or when the pressure of the user's palm pressing the display screen exceeds F1, the electronic device will respond to the above operations by continuously displaying the touchpad 203. That is, the electronic device continues to display the touchpad 203 even after the user's palm is lifted and / or there is no touch event on the virtual operation area. As shown in Figure 3B(d), the electronic device continues to display the touchpad 203 even after the user's palm leaves the display screen.

[0198] As long as the electronic device is still displaying the touchpad 203, the touchpad 203 can receive user input, and the electronic device can execute the corresponding function in response to the input. As shown in Figure 3B(e), the touchpad 203 can receive user finger input.

[0199] Referring to Figure 3B(f), when the duration of no touch event on touchpad 203 is greater than T2, the electronic device can stop displaying touchpad 203 and redisplay keyboard 202.

[0200] Referring to Figure 3B(g), when there is no touch event on the touchpad 203, if the user's palm touches and covers the display screen, the electronic device will respond to the palm operation by stopping the display of the touchpad 203 and redisplaying the keyboard 202.

[0201] In addition to the methods shown in Figure 3B for stopping the touchpad 203 from being displayed, in some embodiments, the electronic device can also hide the touchpad 203 and redisplay the keyboard 202 using other methods described above. For example, the electronic device can also stop displaying the touchpad 203 and redisplay the keyboard 202 in response to a detected first touch gesture that meets a first condition, or in response to a user operation acting on a close control, or in response to a user operation on an area other than the touchpad 203.

[0202] In the user interface shown in Figure 3B, the virtual operation areas that the electronic device can open may include the keyboard 202, touchpad 203, etc. When there are multiple virtual operation areas, the electronic device defaults to opening only one virtual operation area at a time. When the user's palm lands on the display screen, the electronic device opens the touchpad 203. Furthermore, the user can trigger the electronic device to stop displaying the touchpad 203 and open the keyboard 202 through various means (such as pressing or long-pressing the display screen to keep the touchpad 203 active, or when the duration of no touch event on the touchpad 203 exceeds T2, or when the user's palm touches and covers the display screen again). When the touchpad 203 and keyboard 202 are of the same position and size, accidental touches when switching between the keyboard 202 and touchpad 203 can be avoided. The user interface shown in Figure 3B allows for quick switching between the keyboard 202 and touchpad 203, preventing accidental touches on the touchpad 203 while typing and also preventing accidental touches on the keyboard 202 while controlling the cursor.

[0203] Not limited to the examples in Figures 3A and 3B where the first touch operation is a palm touch operation and the first condition is a first pressure condition or a first duration condition, in some embodiments, the first touch operation that the user triggers to display the virtual operation area of ​​the electronic device and meets the first condition can also be other operations. For example, the first touch operation that meets the first condition can also be an operation in which the five fingers slide and converge from different positions toward the same center point, or an operation in which the five fingers slide and spread out in different directions from the same center point, or an operation in which the palm slides a certain distance from left to right, or an operation in which the five fingers slide a certain distance in the same direction, etc.

[0204] The examples of virtual operation area 201 in scenarios 1 and 2 above are all information input function areas such as keyboard 202, touchpad 203, etc., but are not limited to these. In this embodiment, the virtual operation area preset by the electronic device can also be a page of an application, such as the homepage or subpage of some applications, or it can be some windows (such as chat windows or prompt windows). The application page can fill the entire area of ​​the display screen, or it can be displayed only in a part of the display screen.

[0205] The method of this application embodiment can be applied not only to portable terminals that are easy to hold (such as mobile phones, tablets, and laptops), but also to non-portable terminals with larger screens, such as large-screen TVs, desktop computers, and smart billboards. Figure 4 exemplarily illustrates a scenario in which the method provided by this application embodiment is implemented on a large-screen electronic device. As shown in Figure 4, when a user faces a large screen, they can input a first touch gesture on the display screen, and the electronic device can respond to the first touch gesture to open the virtual operation area 201. Using the method of this application embodiment in a large-screen scenario, even if the user is not tall enough or has difficulty reaching the high part of the screen for other reasons, the virtual operation area can still be opened efficiently and conveniently through the first touch gesture. For details on the display and closing methods of the virtual operation area in a large-screen electronic device, please refer to the descriptions in Scenario 1 and Scenario 2 above, which will not be elaborated here.

[0206] In scenarios 1 and 2 described above, the electronic device has a pre-set virtual operation area. In other embodiments, the electronic device can also pre-set multiple virtual operation areas and set a corresponding display area (such as the upper left corner, lower right corner, etc.) for each virtual operation area. In this way, the user can combine first touch gestures in different areas of the display screen to open different virtual operation areas. Not limited to display area, in some embodiments, the electronic device can also respond to different first touch gestures to open different virtual operation areas, such as responding to first swipe gestures with different pressure, different durations, different swipe distances, etc. to open different virtual operation areas.

[0207] In this embodiment, the electronic device may only provide the short-term use of the virtual operating area in scenario 1, or only the long-term use of the virtual operating area in scenario 2. In other embodiments, the electronic device may also provide both scenario 1 and scenario 2 simultaneously. For example, when the user's palm touches the display screen for a duration exceeding T1, and / or when the pressure of the user's palm pressing the display screen exceeds F1, the long-term use of the virtual operating area in scenario 2 is triggered; when the above conditions are not met, the short-term use of the virtual operating area in scenario 1 is triggered.

[0208] Figure 5 is a flowchart of the method for opening a virtual operation area provided in an embodiment of this application.

[0209] As shown in Figure 5, the method may include the following steps:

[0210] S101, the electronic device displays the first user interface.

[0211] The initial user interface displayed when an electronic device executes the method provided in the embodiments of this application is referred to as a first user interface. The first user interface can be any user interface that the electronic device can open. For example, the first user interface can be a memo page, a gallery page, or other pages. The content displayed by the first user interface may not include any virtual operations, as shown in Figure 2A or Figure 2B; or, the content displayed by the first user interface may include a virtual operation area, as shown in the keyboard 202 in Figure 3A or Figure 3B. The virtual operation area displayed in the first user interface can be referred to as a second virtual operation area. The first user interface may occupy the entire area of ​​the display screen or only a portion of the display screen.

[0212] S102, the electronic device detects the first touch gesture.

[0213] The embodiments of this application do not limit the specific content of the first touch gesture. The definition of the first touch gesture can be found in the foregoing description.

[0214] The initial touch gesture may be input by the user's palm or fingers. Electronic devices can distinguish or identify the specific location of the initial touch gesture based on the characteristics of the palm and fingers. When touching a display screen, the user's palm has a larger touch area and more touch points compared to fingers. A touch point refers to an independent, continuous area. Touch points can be simply referred to as contact points.

[0215] Specifically, electronic devices can distinguish or identify the type of input gesture by the contact area, outline of the touch area, number of contact points, and shape of the contact points on the display screen. They can also be used to identify the specific location of the input gesture. This application does not limit the specific method by which the electronic device detects the first touch gesture.

[0216] For example, electronic devices may recognize palms / fingers in the following ways:

[0217] 1. The palm is identified by the area of ​​the touch region of the first touch gesture. In some embodiments, the electronic device can preset a touch area threshold M1. When the electronic device detects a touch event on the display screen, it can identify the touch area M of the touch event. If M > M1, the touch event is considered to be a palm touch on the display screen. M1 can be calculated by testers based on the area of ​​multiple users' palms touching the display screen. This application embodiment does not limit its specific value. M1 is usually larger than the touch area when only fingers touch the display screen.

[0218] 2. Recognizing the palm through the touch contour of the first touch gesture. In some embodiments, since the palm contour is generally close to an ellipse or circle, the electronic device can fit the contour formed by the touch points of the touch event. If the shape of the contour is close to a circle or ellipse, the touch event is considered to be an operation of the palm touching the display screen. For example, referring to FIG6A, whether the first touch gesture is input with the whole palm or part of the palm, the electronic device can recognize the palm touch event by recognizing the contour formed by the touch points of the touch event.

[0219] 3. The palm is identified by the density of the touch points of the first touch gesture. In some embodiments, if the touch area of ​​the palm is not at the edge of the display screen, the density of touch points on the display screen will be greater than the density threshold X1 due to the touch of the palm and surrounding areas. Accordingly, the electronic device can identify the touch point density X. If X > X1, the detected touch event is considered to be a palm touch operation on the display screen. If the touch area of ​​the palm includes the edge of the display screen, the density of touch points on the display screen will be greater than the density threshold X2 due to the touch of the palm and surrounding areas at the edge of the display screen, and the total area of ​​touch points at the edge of the display screen will be greater than the area threshold M2. Accordingly, the electronic device can identify the touch point density X and the total area M' of touch points at the edge of the display screen. If X > X2 and M' > M2, the detected touch event is considered to be a palm touch operation on the display screen. The aforementioned X1, X2, M2, etc., can be obtained by testers based on the situation of multiple users touching the display screen with their palms respectively. The embodiments of this application do not limit their specific values. For example, referring to FIG6B, whether the first touch gesture is input with the whole palm or with part of the palm, the electronic device can recognize the touch event of the palm by recognizing the density of the touch points of the touch event.

[0220] 4. Recognizing the palm / finger based on the pressure of the first touch gesture. In some implementations, the pressure distribution of the palm and fingers is different; for example, the pressure distribution of the palm is more dispersed, while the pressure distribution of the fingers is more compact. Therefore, the electronic device can recognize the palm / finger based on the pressure distribution of the first touch gesture.

[0221] The methods for recognizing a palm described in items 1-4 above can be combined in any way. For example, an electronic device may consider a touch event as a palm touch on the display screen if the touch outline of the first touch gesture is close to a circle or ellipse and the touch area M > M1.

[0222] 5. Recognizing palms or fingers using machine learning algorithms. In some implementations, electronic devices can have a pre-installed palm / finger recognition algorithm. Images (such as heatmaps) generated from touch points on the display screen can be input into the algorithm to identify whether the user's touch event is a palm touch. This palm / finger recognition algorithm can be a convolutional neural network (CNN). The algorithm can be trained by other devices and pre-installed into the electronic device implementing the method provided in this application. During training, the algorithm can first collect a large amount of touch data from palms and fingers touching the display screen, extract relevant features such as touch area, contour shape, pressure distribution, and touch point density from this data, and then train a classifier to finally obtain the palm / finger recognition algorithm.

[0223] 6. For multi-finger touch gestures, recognition can be achieved through one or more of the following: touch point size, touch point area, number of touch points, touch point distribution, and touch point landing time.

[0224] (1) Finger touches are identified by the size and area of ​​the touch points. In some implementations, a touch point is considered a finger touch point if its minor axis is less than the axial distance threshold D1, or if its area is less than the area threshold M3. If the number of finger touch points is multiple, such as five, the touch event is considered a multi-finger touch operation, such as a five-finger touch operation. Referring to FIG6C, FIG6C exemplarily illustrates the shape of the touch points when a five-finger touches a display screen.

[0225] (2) Multi-finger touch gestures can be identified by one or more of the control distribution characteristics of the touch points, such as roundness, spacing, and angle. For example, electronic devices can calculate the center of the circle formed by multiple finger touch points, calculate the angle of each touch point relative to the center, sort them by angle size, and see if the positional distribution of multiple touch points conforms to hand characteristics. For example, there should be a thumb touch point that is far from the center and has a large gap from other touch points. The other four fingers should be evenly distributed within a certain angle range.

[0226] (3) Multi-finger touch gestures can be identified by the timing of the finger touches. For example, if the total duration of the five finger touches is within the first time threshold and the time interval between the five finger touches is within the second time threshold, the touch event can be considered as a five-finger touch operation, and other finger touch operations (such as other three-finger, four-finger, six-finger, eight-finger, etc.) can be excluded.

[0227] Items (1)-(3) above can be combined in any way, and the embodiments of this application do not limit this.

[0228] In some implementations, considering that when a user touches the display with multiple fingers, in addition to touching the display with multiple fingers, additional touch points may be generated at the edges of the display because the user wants to rest other hands on the display, the electronic device can first filter out touch points at the display edges that are too large / too small / too short in duration, and analyze whether the touch event is a multi-finger touch operation based on the other touch points obtained after filtering. Referring to Figure 6D, Figure 6D exemplarily illustrates the touch point positions formed when a user rests their hand on the display.

[0229] S103, the electronic device responds to the first touch gesture and displays a virtual operation area on the first user interface.

[0230] The definition of the first touch gesture can be found in the previous text.

[0231] The type of virtual operation area displayed on the electronic device can be preset by the user or set by default by the electronic device. For example, the virtual operation area can be a virtual keyboard, a touchpad as shown in Figures 2B and 3B, or an application page such as the first page of a first application (e.g., the main page or a subpage of an application), or a window such as the first window (e.g., a drop-down notification window, or a chat window). The position, size, and style of the virtual operation area on the display screen can be referred to in the descriptions of Scenario 1 and Scenario 2 above. The virtual operation area mentioned in S103 and subsequent steps can be referred to as the first virtual operation area. When the virtual operation area is a touchpad, it can be referred to as the first virtual touchpad.

[0232] As long as the electronic device is displaying the virtual control area, it can respond to user actions applied to that area and execute corresponding functions. The interaction between the user and the virtual control area can be found in the previous section. For example, when the virtual control area is a touchpad, the user can input a swipe operation on it, and the electronic device can respond to this swipe operation by moving the touch focus on the primary user interface of the display screen.

[0233] This step can be referenced in Figure 2A(b), Figure 2B(b), Figure 3A(b), or Figure 3B(b).

[0234] S104, a scenario where an electronic device enters a virtual operation area for a short period of time.

[0235] In some implementations, if the electronic device only provides a short-term virtual operation area solution in scenario 1, and not a long-term virtual operation area solution in scenario 2, then after detecting the first touch gesture, the electronic device can directly respond to the first touch gesture and enter the short-term virtual operation area scenario. In this implementation, the specific content of the first touch gesture is not limited. For example, the first touch gesture can be any first touch gesture, or it can be a first touch gesture that meets a first condition, or it can be a first touch gesture that does not meet the first condition. The definition of the first condition can be found in the preceding description.

[0236] In some implementations, if the electronic device simultaneously provides both the short-term use of the virtual operating area in scenario 1 and the long-term use of the virtual operating area in scenario 2, if the first touch gesture detected by the electronic device in S102 does not meet the first condition, the electronic device can enter the short-term use of the virtual operating area scenario in response to the first touch gesture that does not meet the first condition. The definition of the first condition can be found in the preceding description.

[0237] S105, the electronic device stops displaying the first virtual operation area by hiding the virtual operation area in scenarios where the virtual operation area is used for a short time.

[0238] For scenarios where the virtual operation area is used for a short period of time, the method of hiding the virtual operation area can be referred to the previous introduction and Figures 2A-2D, which will not be repeated here.

[0239] S106, a scenario where electronic devices enter a virtual operation area used for extended periods.

[0240] In some implementations, if the electronic device does not provide a short-term virtual operation area solution as in Scenario 1, but only a long-term virtual operation area solution as in Scenario 2, then after detecting the first touch gesture, the electronic device can directly respond to the first touch gesture and enter the long-term virtual operation area scenario. In this implementation, the specific content of the first touch gesture is not limited. For example, the first touch gesture can be any first touch gesture, or it can be a first touch gesture that meets a first condition, or it can be a first touch gesture that does not meet the first condition. The definition of the first condition can be found in the preceding description.

[0241] In some implementations, if the electronic device simultaneously provides both the short-term use of the virtual operating area in scenario 1 and the long-term use of the virtual operating area in scenario 2, and if the first touch gesture detected by the electronic device in S102 meets a first condition, the electronic device can enter the short-term use of the virtual operating area scenario in response to the first touch gesture that meets the first condition. The definition of the first condition can be found in the preceding description.

[0242] S107, the electronic device stops displaying the first virtual operation area by hiding the virtual operation area in scenarios where the virtual operation area is used for a long time.

[0243] For scenarios involving prolonged use of the virtual control area, please refer to the previous introduction and Figures 3A and 3B for methods of hiding the virtual control area; these will not be elaborated upon here.

[0244] Using the method shown in Figure 5, the electronic device does not need to set up a fixed area to display the virtual operation area. Instead, it displays the virtual operation area based on the hand's touch operation on the screen. This virtual operation area does not continuously occupy the screen, thus improving screen utilization. Furthermore, when the first user interface itself has a virtual operation area (such as a keyboard), it can also avoid accidental touches when switching between this virtual operation area and the virtual operation area opened by the first touch gesture. At the same time, this method of opening the virtual operation area is also more natural and efficient.

[0245] In some implementations, the electronic device may respond to a user operation by first providing a short-term use of the virtual operating area in scenario 1, and then responding to another user operation by providing a long-term use of the virtual operating area in scenario 2.

[0246] In some implementations, the electronic device may only provide the solution for scenario 1, without providing the solution for scenario 2. Thus, the method of this application embodiment may include S101-S105, but not S106-S107.

[0247] In some implementations, the electronic device may only provide the solution for scenario 2, without providing the solution for scenario 1. Thus, the method of this application embodiment may include S101-S103 and S106-S107, but not S104-S105.

[0248] This application also provides a method for enabling a function.

[0249] In some implementations, the method for opening the virtual operation area described above can be replaced by "displaying the virtual operation area" or "opening a function," and "stopping the display of the virtual operation area" can be replaced by "stopping a function." This allows the method shown in Figure 5 to efficiently open or close some functions. In summary, when the electronic device displays the first user interface, a second touch gesture can be detected, activating the first function of the electronic device. The first function can be either a default setting of the electronic device or a user-defined setting. Some implementation details of the implementation of opening the first function can be found in the method embodiments described above.

[0250] Figure 7 illustrates an exemplary method for enabling this function. The method may include the following steps:

[0251] S201, the electronic device displays the first user interface. This step can be referred to as S101 in Figure 5.

[0252] S202, the electronic device detected a second touch gesture.

[0253] The definition of the second touch gesture can be found in the definition of the first touch gesture mentioned above.

[0254] If an electronic device provides both a method for opening the virtual control area and a method for opening functions, then the second touch gesture is different from the first touch gesture. If the electronic device only provides a method for opening functions and not a method for opening the virtual control area, then the second touch gesture can be the same as the first touch gesture.

[0255] S203, the electronic device responds to the second touch gesture and activates the first function.

[0256] The embodiments of this application do not limit the specific content of the first function. The first function can be set by the user as needed, or it can be preset in the electronic device. The first function can be, for example, the function of turning on the wireless local area network, the function of turning on Bluetooth, or the function of playing music. In this way, through the method provided by this application, the electronic device can efficiently turn some functions on and off.

[0257] S204, the electronic device enters a scenario where the primary function is used for a short period of time.

[0258] In some implementations, if the electronic device only provides a short-term use of the first function in scenario 1, and does not provide a long-term use of the first function in scenario 2, then after detecting the second touch gesture, the electronic device can directly respond to the second touch gesture and enter the scenario of short-term use of the first function. In this implementation, the specific content of the second touch gesture is not limited. For example, the second touch gesture can be any second touch gesture, or it can be a second touch gesture that meets the second condition, or it can be a second touch gesture that does not meet the second condition. The definition of the second condition can refer to the definition of the first condition introduced above. The second condition includes one or more of the following: a second duration condition, a second pressure condition, a second sliding distance condition, a second sliding direction condition, and a second number of touches condition.

[0259] In some implementations, if the electronic device simultaneously provides both a short-term use of the first function in scenario 1 and a long-term use of the first function in scenario 2, and if the second touch gesture detected by the electronic device in S102 does not meet the second condition, the electronic device can enter the scenario of short-term use of the first function in response to the second touch gesture that does not meet the second condition. The definition of the second condition can be found in the preceding description.

[0260] If the electronic device provides both a method for opening the virtual operating area and a method for opening the function, then the second condition and the first condition are different. If the electronic device only provides a method for opening the function and not a method for opening the virtual operating area, then the second condition and the first condition can be the same.

[0261] In some implementations, after detecting a second touch gesture on the display screen, a third prompt message may also be output. This third prompt message may, for example, be used to indicate a short-term use scenario of the first function. It may also be used to indicate how to close the first function during a short-term use scenario. The embodiments of this application do not limit the implementation form of the third prompt message.

[0262] S205, the electronic device disables the first function by disabling the first function in a scenario where the first function is used for a short period of time.

[0263] 1. In some embodiments, after the electronic device activates the first function, it may deactivate the first function after detecting that the hand that input the first touch gesture has left the display screen.

[0264] 2. In some embodiments, the electronic device may also respond to a first touch gesture by displaying a function control for operating the first function while activating the first function. This function control may include, for example, a close control. This application embodiment does not limit the form of these function controls; for example, they may be controls capable of receiving click operations or swipe operations. After activating the first function, the electronic device may close the first function in response to a user operation applied to the close control. The user operation applied to the close control may be, for example, a click operation, a touch operation, a swipe operation, etc., and this application embodiment does not limit this. The close control may also be referred to as a second control.

[0265] S206, the electronic device enters the scenario of long-term use of the primary function.

[0266] In some implementations, if the electronic device does not provide a short-term use of the first function as in scenario 1, but only a long-term use of the first function as in scenario 2, then upon detecting the second touch gesture, the electronic device can directly respond to the second touch gesture and enter the scenario of long-term use of the first function. In this implementation, the specific content of the second touch gesture is not limited. For example, the second touch gesture can be any second touch gesture, or it can be a second touch gesture that meets the second condition, or it can be a second touch gesture that does not meet the second condition. The definition of the second condition can be found in the preceding description.

[0267] In some implementations, if the electronic device simultaneously provides a short-term use of the first function in scenario 1 and a long-term use of the first function in scenario 2, if the second touch gesture detected by the electronic device in S102 meets the second condition, the electronic device can enter the long-term use of the first function scenario in response to the second touch gesture that meets the second condition. The definition of the second condition can be found in the preceding description.

[0268] In some implementations, after detecting a second touch gesture on the display screen, a fourth prompt message may also be output. This fourth prompt message may, for example, be used to indicate a prolonged use scenario of the first function. It may also be used to indicate how to close the first function during prolonged use. The embodiments of this application do not limit the implementation form of the fourth prompt message.

[0269] S207, the electronic device turns off the display of the first function by turning off the first function in a scenario where the first function is used for a long time.

[0270] 1. In some embodiments, if a second touch gesture is detected again after the electronic device has activated the first function, the first function can be turned off in response to the second touch gesture.

[0271] 2. In some embodiments, after the electronic device activates the first function, if a second touch gesture that meets the second condition is detected on the display screen, the first function is deactivated in response to the first touch gesture that meets the first condition.

[0272] 3. In some embodiments, the electronic device may also respond to a second touch gesture by displaying a function control for operating the first function while activating the first function. This function control may include, for example, a close control. This application embodiment does not limit the form of these function controls; for example, they may be controls capable of receiving click operations or swipe operations. After activating the first function, the electronic device may close the first function in response to a user operation applied to the close control. The user operation applied to the close control may be, for example, a click operation, a touch operation, a swipe operation, etc., and this application embodiment does not limit this. The close control may also be referred to as a second control.

[0273] Using the method shown in Figure 7, the electronic device can turn a first function on or off based on the user's touchscreen operation. This first function does not need to be continuously active, thus improving the efficiency of the electronic device. At the same time, this method of turning on the function is naturally efficient, enhancing the user experience.

[0274] In some implementations, the electronic device may respond to a user operation by first providing a short-term use of the first function in scenario 1, and then responding to another user operation by providing a use of the first function in scenario 2.

[0275] In some implementations, the electronic device may only provide the solution for scenario 1, without providing the solution for scenario 2. Thus, the method of this application embodiment may include S201-S205, but not S206-S207.

[0276] In some implementations, the electronic device may only provide the solution for scenario 2, without providing the solution for scenario 1. Thus, the method of this application embodiment may include S201-S203 and S206-S207, but not S204-S205.

[0277] The electronic device provided in the embodiments of this application is described below.

[0278] The electronic device in this application embodiment is used to implement the various method embodiments described above. The electronic device is a smart terminal device and can be of various types; this application embodiment does not limit its specific type. For example, the electronic device can be a mobile phone (e.g., a foldable phone or a non-foldable phone), and can also include a tablet computer (e.g., a foldable tablet computer or a non-foldable tablet computer), a desktop computer, a desktop computer with a touch-sensitive surface or touch panel, a laptop computer, a handheld computer, a smart screen, a wearable device (such as a smartwatch, smart bracelet, etc.), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, an in-vehicle system, a game console, and can also be an Internet of Things (IoT) device or a smart home device such as a smart water heater, smart lighting, smart air conditioner, etc.

[0279] The electronic device in this application embodiment is equipped with a touch-sensitive device (such as a display screen), which can display a virtual operation area, an application page, a window, or open a function in response to a hand touch operation on the device.

[0280] Figure 8 is a hardware structure diagram of the electronic device 100 provided in an embodiment of this application.

[0281] As shown in Figure 8, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a sensor module 180, a camera 193, a display screen 194, etc. The sensor module 180 may include a pressure sensor 180A, a touch sensor 180K, etc.

[0282] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0283] Processor 110 may include one or more processing units, such as application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0284] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0285] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0286] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via a USB interface. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0287] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0288] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0289] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0290] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD). The display panel can also be manufactured using organic light-emitting diodes (OLEDs), active-matrix organic light-emitting diodes (AMOLEDs), flexible light-emitting diodes (FLEDs), miniled, microled, micro-oled, quantum dot light-emitting diodes (QLEDs), etc. In some embodiments, the electronic device may include one or N displays 194, where N is a positive integer greater than 1.

[0291] The display screen 194 can be a foldable display screen, in which a folding component can be provided, allowing the display screen to bend around the folding component. The folding component can be, for example, a hinge or pivot.

[0292] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0293] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM).

[0294] Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, fifth generation DDR SDRAM is generally called DDR5 SDRAM), etc.; non-volatile memory can include disk storage devices and flash memory.

[0295] Flash memory can be classified according to its operating principle, including NOR FLASH, NAND FLASH, 3D NAND FLASH, etc.; according to the level of the storage cell, including single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc.; and according to the storage specification, including universal flash storage (UFS) and embedded multimedia card (eMMC), etc.

[0296] The random access memory can be directly read and written by the processor 110. It can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data.

[0297] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110.

[0298] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, music, video, and other files can be stored in the external non-volatile memory.

[0299] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0300] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0301] In this embodiment, the internal memory 121 stores a computer program that implements the method for opening a virtual operation area provided in this embodiment. The processor 110 can be used to execute the computer program to implement the method provided in this embodiment. The display screen 194 is used to display the content displayed by the electronic device described above. The touch sensor 180K is used to detect touch operations, and the processor 110 is used to determine whether there is a first touch gesture and whether the user's hand has left the display screen based on the data collected by the touch sensor 180K. The pressure sensor 180A is used to detect pressure on the display screen, and the processor 110 is also used to determine whether the pressure of the palm contacting the display screen is greater than F1 based on the data collected by the pressure sensor 180A. The processor 110 is also used to control the display and stop display of the virtual operation area, as detailed in the description of the method embodiment above, which will not be repeated here.

[0302] In this embodiment, the internal memory 121 may also store a computer program that implements the method for opening the function provided in this embodiment. The processor 110 can be used to execute the computer program to implement the method provided in this embodiment. The display screen 194 is used to display the content displayed by the electronic device described above. The touch sensor 180K is used to detect touch operations, and the processor 110 is used to determine whether there is a second touch gesture and whether the user's hand has left the display screen based on the data collected by the touch sensor 180K. The pressure sensor 180A is used to detect pressure on the display screen. The processor 110 is also used to control the opening and closing of the first function, as detailed in the description of the method embodiment above, which will not be repeated here.

[0303] The electronic device provided in this application embodiment can run an operating system (OS). This operating system can be various operating systems used in the industry, such as an operating system based on OpenHarmony, like HarmonyOS; or other operating systems such as Android. TM An operating system can refer to the iOS mobile operating system; it can also refer to various open-source operating systems or their derivatives, such as Linux OS and other embedded operating systems; or it can refer to future new operating systems, such as AI operating systems based on artificial intelligence. An operating system is a set of interconnected system software programs that manage and control the operation of electronic devices, utilize and run hardware and software resources, and provide public services to organize user interactions. In electronic devices, the operating system connects downwards to the physical devices at the hardware layer and upwards to provide a runtime environment for application software.

[0304] An operating system typically includes a kernel layer, a middleware layer, and an application layer. The application layer includes applications, which can include system applications and third-party applications. The middleware layer includes a suite of software providing various services to application developers, or frameworks providing services such as databases, multimedia, and graphics, or capabilities such as distributed scheduling and system scaling. For example, the middleware layer may include a framework layer and / or a system service layer. The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The system service layer includes the system's core capabilities, providing services to applications through the framework layer. The kernel layer is the layer between hardware and software. The kernel layer may include hardware drivers and the operating system kernel. In addition to providing hardware drivers, the kernel layer also supports functions such as memory management and system process management.

[0305] The electronic devices we use in our daily lives come in various types and forms, and are applied in a wide range of scenarios. Therefore, based on the different forms and functions of electronic devices, different application scenarios, and different user needs, the operating systems used in these devices may also differ. The basic functions implemented by the electronic device provided in this application can be implemented using a general-purpose operating system or a dedicated operating system. To more clearly illustrate the implementation of the embodiments of this application under a specific operating system, Figure 9 shows the architecture of HarmonyOS. Those skilled in the art can deduce the implementation of the embodiments of this application under other specific operating systems, such as Android. TM Implementation under operating systems, etc.

[0306] As shown in Figure 9, the software architecture of an electronic device can be divided into several layers. In some embodiments, from bottom to top, these layers are: kernel layer, system service layer, framework layer, and application layer. Layers communicate with each other through software interfaces. System functions can be tailored, added, or combined at the subsystem level depending on the deployment scenario of different device forms. Each subsystem can also be tailored, added, or combined at the functional level.

[0307] The kernel layer includes the following modules:

[0308] The Kernel Abstraction Layer (KAL) provides basic kernel capabilities to upper layers by shielding the differences between multiple kernels, including but not limited to process / thread management, memory management, file system, network management, and peripheral device management.

[0309] Kernel Subsystem: Supports the selection of a suitable OS kernel for different resource-constrained devices, including but not limited to Linux kernel, HarmonyOS kernel, LiteOS (Lite Operating System), etc.

[0310] Driver Subsystem: The driver framework is the foundation for the open system hardware ecosystem, providing unified peripheral access capabilities and a framework for driver development and management. The driver framework includes: display drivers, camera drivers, audio drivers, Bluetooth drivers, sensor drivers, etc.

[0311] The system service layer comprises the core capabilities of the system, providing services to applications through the framework layer. This layer includes, but is not limited to, the following subsystems:

[0312] The system's basic capability subsystem set provides fundamental capabilities for the operation, scheduling, and migration of distributed applications across multiple devices. This set may include distributed soft bus, distributed data management, distributed task scheduling, and Ark multi-language runtime; it may also include multi-modal input subsystem, graphics subsystem, security subsystem, and AI subsystem.

[0313] Basic software service subsystem set: provides public and general software services; the basic software service subsystem set may include event notification subsystem, telephone service subsystem, multimedia subsystem, etc.

[0314] Enhanced software service subsystem suite: Provides differentiated enhanced software services for different devices; the enhanced software service subsystem suite may include smart screen proprietary business subsystem, wearable proprietary business subsystem, IoT proprietary business subsystem, etc.

[0315] Hardware service subsystem set: Provides hardware services; the hardware service subsystem set may include location service subsystem, user IAM (Identity and Access Management) subsystem, wearable proprietary hardware service subsystem, biometric identification, IoT proprietary hardware service subsystem, etc.

[0316] Distributed task scheduling enables distributed service management (discovery, synchronization, registration, and invocation), supporting remote startup, remote invocation, remote connection, and migration of applications across devices.

[0317] Distributed data management enables data synchronization, data storage, data sharing, and data access across all scenarios and devices.

[0318] The distributed soft bus provides communication-related capabilities for seamless interconnection between multiple devices, including: WLAN service capabilities, Bluetooth service capabilities, soft bus, inter-process communication RPC (Remote Procedure Call), and StarFlash communication capabilities.

[0319] Ark Multilingual Runtime is a unified compilation runtime platform designed to support the joint compilation and execution of multiple programming languages ​​and multiple chip platforms.

[0320] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The framework layer includes: the ArkUI framework (which provides a complete infrastructure for UI development of system applications, including UI functions such as components, layouts, animations, and interactive events, as well as a real-time interface preview tool), the user application framework, and the Ability framework (an Ability is a lightweight application; the Ability framework schedules and manages the operation and lifecycle of Abilities). Different devices may have different operating systems, and the APIs they support may also differ.

[0321] The HarmonyOS API is a series of open capabilities provided to support HarmonyOS application development. The HarmonyOS API can be set at the framework layer or independently of the framework layer. The HarmonyOS API includes the Audio API (audio service), Push API (push service), and Account API (account service), among others.

[0322] Applications can include system apps and extended / third-party apps. System apps can include the desktop, control bar, settings, contacts, phone, camera, etc., while extended / third-party apps can include social apps, travel apps, etc.

[0323] The input management module manages system input, such as touchscreen input. After receiving input events from input devices like displays, it distributes these events to appropriate target modules, such as application windows. In one embodiment, the input management module can be a multi-modal input subsystem in HarmonyOS. This subsystem integrates input from multiple dimensions. Specifically, it receives device input events, such as those from keyboards, mice, touchscreens, and touchpads, based on the kernel subsystem and driver framework. After normalizing and standardizing the input events, it distributes them to the ArkUI framework. The ArkUI framework encapsulates the events and forwards them to the application, or distributes the events to the application through other interfaces. In this embodiment, the input management module can acquire events such as a hand touching the display screen, a hand leaving the display screen, and touch events from fingers or styluses on the virtual operating area.

[0324] The graphics subsystem mainly includes UI components, layout, animation, fonts, input events, window management, rendering, and drawing modules. The graphics service provides graphics rendering and display output functions, and internally, through the rational utilization of system hardware resources, it provides a smooth and efficient display experience. In this embodiment, the graphics subsystem can provide the content displayed on the screen, such as the screen content shown in Figures 2A, 2B, 2C, 2D, 3A, and 3B.

[0325] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules in the processor.

[0326] This application also provides an electronic device that may include a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the method performed by the electronic device as described in any of the above embodiments.

[0327] This application also provides a chip system including a processing circuit and an interface circuit. The interface circuit is used to receive computer instructions and transmit them to the processing circuit. The processing circuit is used to execute the computer instructions to implement the method performed by the electronic device as in any of the above embodiments.

[0328] This application also provides a chip system including at least one processor for implementing the methods executed by the electronic device in any of the above embodiments. In one possible design, the chip system further includes a memory for storing program instructions and data, the memory being located within or outside the processor.

[0329] A chip system can consist of chips or include chips and other discrete components.

[0330] Optionally, there may be one or more processors in the chip system. The processor can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0331] Optionally, the chip system may contain one or more memories. These memories may be integrated with the processor or disposed separately; this application does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed on different chips. This application does not specifically limit the type of memory or the arrangement of the memory and processor.

[0332] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0333] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method executed by the electronic device in any of the above embodiments.

[0334] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the method executed by the electronic device as described in any of the above embodiments.

[0335] The various embodiments of this application can be combined arbitrarily to achieve different technical effects.

[0336] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0337] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0338] In the description of the embodiments of this application, unless otherwise stated, " / " means "or". For example, A / B can mean A or B. The "and / or" in the text is merely a description of the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of this application, "multiple" means two or more.

[0339] The terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.

[0340] In summary, the above description is merely an embodiment of the technical solution of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made based on the disclosure of this application should be included within the scope of protection of this application.

Claims

1. A method for opening a virtual touchpad, characterized in that, The method is applied to an electronic device, and the method includes: Display the first user interface; The first touch gesture was detected on the display screen; A first virtual touchpad is displayed on the first user interface, and the first virtual touchpad is displayed in an area that does not overlap or partially overlaps with the touch area of ​​the first touch gesture; In response to a swipe operation on the first virtual touchpad, the touch focus on the first user interface is moved.

2. The method according to claim 1, characterized in that, After displaying the first virtual touchpad on the first user interface, the method further includes: The hand that input the first touch gesture has left the display screen and there is no touch event on the first virtual touchpad; Alternatively, a user action performed on the first control is detected; Alternatively, a user action is detected that is applied to an area other than the first virtual touchpad; Stop displaying the first virtual touchpad.

3. The method according to claim 2, characterized in that, The detection that the hand that input the first touch gesture has left the display screen and there is no touch event on the first virtual touchpad specifically includes: First, it is detected that the hand that input the first touch gesture leaves the display screen, and then it is detected that there is no touch event on the first virtual touchpad; or, First, it is detected that there is no touch event on the first virtual touchpad, and then it is detected that the hand that entered the first touch gesture leaves the display screen.

4. The method according to claim 2 or 3, characterized in that, After displaying the first virtual touchpad on the first user interface, the method further includes: The electronic device detects a user operation received in an area other than the first virtual touchpad; The electronic device refused to respond to the user's action.

5. The method according to any one of claims 2-4, characterized in that, After detecting the first touch gesture on the display screen, the method further includes: Output the first prompt message.

6. The method according to any one of claims 1-5, characterized in that, Detecting a first touch gesture on the display screen specifically includes: detecting a first touch gesture on the display screen that does not meet a first condition.

7. The method according to claim 1, characterized in that, After displaying the first virtual touchpad on the first user interface, the method further includes: The system detects that the hand that input the first touch gesture has left the display screen and that there has been no touch event on the first virtual touchpad for a first duration; Alternatively, a first touch gesture is detected on the display screen; Alternatively, a first touch gesture that meets the first condition is detected on the display screen; Alternatively, a user action performed on the first control is detected; Alternatively, a user action is detected that is applied to an area other than the first virtual touchpad; Stop displaying the first virtual touchpad.

8. The method according to claim 7, characterized in that, The detection that the hand that input the first touch gesture has left the display screen and that there have been no touch events on the first virtual touchpad for a first duration specifically includes: First, it is detected that the hand that input the first touch gesture leaves the display screen, and then it is detected that there is no touch event on the first virtual touchpad for more than a first time period; or, First, it is detected that there has been no touch event on the first virtual touchpad for a first period of time. Then, it is detected that the hand that input the first touch gesture leaves the display screen.

9. The method according to claim 7 or 8, characterized in that, After displaying the first virtual touchpad on the first user interface, the method further includes: The electronic device detects a user operation received in an area other than the first virtual touchpad; The electronic device responds to the user's operation by performing the corresponding action.

10. The method according to any one of claims 7-9, characterized in that, After detecting a first touch gesture that meets a first condition on the display screen, the method further includes: Output the second prompt message.

11. The method according to any one of claims 1-5 and 7-10, characterized in that, Detecting a first touch gesture on the display screen specifically includes: detecting a first touch gesture that meets a first condition on the display screen.

12. The method according to any one of claims 1-11, characterized in that, The first touch gesture includes one of the following: palm touch gesture, multi-finger touch gesture.

13. The method according to any one of claims 1-12, characterized in that, The first touch gesture is detected on the display screen, specifically including: The first touch gesture of the palm touch gesture is detected by one or more of the following: the area of ​​the touch area, the outline of the touch area, the density of the touch points, and the pressure distribution of the touch. Alternatively, the first touch gesture of a multi-finger touch gesture can be detected by one or more of the following: touch size, touch area, number of touches, touch distribution, and touch drop time.

14. The method according to any one of claims 6, 7, and 11, characterized in that, The first touch gesture is a palm touch gesture. The first touch gesture that meets the first condition includes: palm long press gesture, palm heavy pressure gesture, palm multiple touch gesture, and palm swipe gesture. Alternatively, the first touch gesture is a multi-finger touch gesture, and the first touch gesture that meets the first condition includes: multi-finger long press gesture, multi-finger heavy press gesture, multi-finger multi-tap gesture, multi-finger pinch gesture, and multi-finger zoom gesture.

15. The method according to claim 2 or 7, characterized in that, The method further includes: displaying the first virtual touchpad on the first user interface while also displaying the first control, wherein the first control can move as the first virtual touchpad moves; or, The first control is a control that existed before the first virtual touchpad was displayed.

16. The method according to any one of claims 1-15, characterized in that, The method further includes: The system detects that the hand that input the first touch gesture is continuously touching and sliding on the display screen; The first virtual touchpad moves in position on the display screen as the hand slides.

17. The method according to any one of claims 1-16, characterized in that, Before detecting the first touch gesture on the display screen, the first user interface displays a second virtual keyboard. When the first virtual touchpad is displayed on the first user interface, the first virtual touchpad and the second virtual touchpad are in the same position and size on the display screen, or the first virtual touchpad covers a part of the second virtual keyboard, or the first virtual touchpad is displayed floating on the second virtual keyboard, or the method further includes: adjusting the display area of ​​the first virtual keyboard so that the adjusted first virtual keyboard and the first virtual touchpad do not overlap.

18. The method according to any one of claims 1-17, characterized in that, When the first virtual touchpad is displayed on the first user interface, the layout of the first user interface on the display screen remains unchanged.

19. The method according to any one of claims 1-18, characterized in that, The electronic device is a foldable electronic device, and the display screen of the foldable electronic device includes a first screen and a second screen in the folded state; Detecting a first touch gesture on the display screen specifically includes: detecting a first touch gesture on the first screen; Displaying the first virtual touchpad on the first user interface specifically includes: displaying the first virtual touchpad on the first screen.

20. The method according to claim 19, characterized in that, In response to a swipe operation on the first virtual touchpad, the touch focus on the first user interface is moved, specifically including: In response to a swipe operation on the first virtual touchpad, the touch focus is moved on the second screen.

21. An electronic device, characterized in that, include: A memory, a processor, and a computer program stored on the memory, wherein the processor executes the computer program to implement the method as described in any one of claims 1-20.

22. A computer-readable storage medium, characterized in that, It stores a computer program thereon, which, when executed by a processor, implements the method as described in any one of claims 1-20.

23. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the method as described in any one of claims 1-20.

24. A chip system comprising a processing circuit and an interface circuit, the interface circuit being configured to receive computer instructions and transmit them to the processing circuit, the processing circuit being configured to execute the computer instructions to implement the method as described in any one of claims 1-20.

Images