Display method and device of virtual input panel and computer readable storage medium

Abstract

The invention discloses a display method and device of a virtual input panel and a computer readable storage medium, relates to the technical field of terminals, and can ensure that the size of the virtual input panel conforms to ergonomics and ensure the input efficiency and the input comfort of a user while meeting the personalized use requirements of the user on a display area where the virtual input panel is located. In the application, the electronic device can adaptively adjust the virtual touchpad on the virtual input panel according to the adjustment of a user on the position of the virtual keyboard on the virtual input panel, so as to meet the personalized use requirements of the user on the display area where the virtual input panel is located; for example, when a user does not need to perform touchpad input, the virtual touchpad is hidden, the virtual touchpad is displayed in a minimized state or only touchpad keys and the like are included to provide more display areas for content display, or when the virtual input panel is displayed on the display area, it is guaranteed that the size of the virtual input panel conforms to ergonomics.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a method, device and computer-readable storage medium for displaying a virtual input panel. Background Technology

[0002] Traditional electronic devices such as laptops include keyboards and touchpads for input. As users demand greater flexibility, electronic devices supporting virtual input panels have emerged. These devices can display both the interface and the virtual input panel on the screen, including a virtual keyboard and / or a virtual touchpad. This solution allows users to control the display of the virtual input panel according to their needs: displaying only the virtual touchpad when no keyboard input is needed, displaying only the virtual keyboard when no touchpad input is needed, or displaying both when both keyboard and touchpad input are required. However, in some cases, users may not need to input and prefer a larger display area. This solution only offers a few fixed virtual input panel display formats and cannot meet this need. Summary of the Invention

[0003] This application provides a method, device, and computer-readable storage medium for displaying a virtual input panel, which can meet the user's personalized usage needs for the display area where the virtual input panel is located, while ensuring that the size of the virtual input panel conforms to ergonomics and guaranteeing the user's input efficiency and input comfort.

[0004] To achieve the above objectives, this application adopts the following technical solution:

[0005] In a first aspect, a method for displaying a virtual input panel is provided. The method includes: an electronic device displaying a virtual input panel, the virtual input panel including a virtual keyboard and a virtual touchpad; the electronic device receiving a first operation from a user on the virtual keyboard, the first operation being used to adjust the position of the virtual keyboard; in response to the first operation, the electronic device adjusting the position of the virtual keyboard from a first position to a second position, and adaptively adjusting the virtual touchpad according to the second position.

[0006] The solution provided in the first aspect above allows the electronic device to adaptively adjust the virtual touchpad on the virtual input panel according to the user's adjustment of the virtual keyboard position on the virtual input panel, so as to meet the user's personalized usage needs for the display area where the virtual input panel is located. For example, the virtual touchpad can be hidden when the user does not need to input with the touchpad, displayed in a minimized state, or only include touchpad buttons to provide more display area for content display, or the size of the virtual input panel can be ensured to conform to ergonomics when the virtual input panel is displayed on the display area.

[0007] As an example, the electronic device includes a first display screen on which a virtual input panel and a first content page are displayed.

[0008] As an example, the electronic device also includes a second display screen on which a second content page is displayed. For example, the electronic device is a dual-screen device or a foldable screen device.

[0009] As one possible implementation, the aforementioned adjustments to the virtual touchpad include: adjusting the display layout and / or functions of the virtual touchpad. This can meet users' personalized usage needs regarding the display layout and / or functions of the virtual touchpad, thereby improving the user experience.

[0010] As one possible implementation, the above-mentioned adaptive adjustment of the virtual touchpad based on the second position includes: determining the maximum height of the virtual touchpad that can be accommodated on the virtual input panel as the target height based on the second position; adjusting the height of the virtual touchpad to the target height when the target height meets a first condition; or, hiding the virtual touchpad or displaying it in a minimized state when the target height meets a second condition; or, including only touchpad buttons when the target height meets a third condition; or, adjusting the height of the virtual touchpad to the standard height when the target height meets a fourth condition. In this way, corresponding display layout adjustments can be made based on different layouts on the virtual input panel to meet users' personalized usage needs regarding the display layout of the virtual touchpad and improve the user experience.

[0011] As one possible implementation, the above-mentioned adaptive adjustment of the virtual touchpad based on the second position further includes: adjusting the width of the virtual touchpad according to the target height when the target height meets the first condition. In this way, even when the vertical operable space of the virtual touchpad is limited, increasing the horizontal operable space of the virtual touchpad ensures that the size of the virtual touchpad conforms to ergonomics, reducing the user's touch complexity and ensuring the user's input efficiency and comfort.

[0012] As one possible implementation, adjusting the width of the virtual touchpad according to the target height includes: increasing the width of the virtual touchpad as the target height gradually decreases; or decreasing the width of the virtual touchpad as the target height gradually increases. This allows for dynamic adjustment of the lateral operable space based on the vertical operable space of the virtual touchpad, ensuring that the size of the virtual touchpad conforms to ergonomics, reducing the user's touch complexity, and guaranteeing the user's input efficiency and comfort.

[0013] As one possible implementation, the above-mentioned adaptive adjustment of the virtual touchpad based on the second position further includes: adjusting the width of the virtual touchpad to a standard width when the target height meets the fourth condition. In this way, the lateral operable space can be dynamically adjusted based on the vertical operable space of the virtual touchpad to ensure that the size of the virtual touchpad conforms to ergonomics, reducing the user's touch complexity and ensuring the user's input efficiency and comfort.

[0014] As one possible implementation, the aforementioned adjustment of the virtual touchpad further includes: determining the virtual touchpad's display-to-control ratio based on one or more of the following: target height, the height of the electronic device's display screen (such as a first display screen), touch pressure of the second operation, and touch gesture of the second operation; wherein the display-to-control ratio is inversely related to the target height, the display screen is used to display the virtual input panel, and the display-to-control ratio is positively related to the height of the display screen; the second operation is the user's input operation on the virtual touchpad, and the display-to-control ratio is positively related to the touch pressure of the second operation. In this way, when the vertical maneuverable space of the virtual touchpad is limited, the cursor control difficulty coefficient of the virtual touchpad can be reduced, and the cursor control efficiency of the virtual touchpad, such as movement efficiency and positioning efficiency, can be improved.

[0015] As an example, a virtual touchpad may also use a fixed display ratio.

[0016] As one possible implementation, the above-mentioned adaptive adjustment of the virtual touchpad according to the second position further includes: when the virtual touchpad is hidden or displayed in a minimized state, stopping the provision of touchpad input function or providing touchpad input function through a first area, the first area being located in the area where the virtual keyboard is located; when the virtual touchpad only includes touchpad buttons, providing touchpad input function through the first area. Thus, by reusing the area where the virtual keyboard is located as the touchpad input hot zone, the actual input hot zone of the virtual touchpad can be increased when the vertically operable space is limited, ensuring that the size of the virtual touchpad conforms to ergonomics, reducing the complexity of touchpad input for users, and ensuring the efficiency and comfort of touchpad input for users.

[0017] As one possible implementation, the method further includes: the electronic device displaying a region prompt for the first area. This prompts the user to select a hotspot for touchpad input, making the user more psychologically comfortable and confident in using the touchpad to input data within the indicated hotspot, thus improving the ease of operation and enhancing the user experience.

[0018] As one possible implementation, the above-described method of displaying the virtual touchpad in a minimized state includes: displaying touchpad function icons; the method further includes: in response to a user clicking the touchpad function icons, displaying the virtual touchpad with a standard height and width; or, in response to a user clicking the touchpad function icons, providing touchpad input functionality through a first area. This provides users with the ability to quickly pull up the virtual touchpad, or to reuse the area where the virtual keyboard is located as a touchpad input hotspot, meeting users' personalized usage needs, ensuring the virtual touchpad size conforms to ergonomics, reducing the complexity of touchpad input for users, and ensuring touchpad input efficiency and comfort.

[0019] As one possible implementation, the width of the touchpad buttons is less than a width threshold, and / or the height of the touchpad buttons is less than a height threshold. The method further includes: when a user clicks a touchpad button, the touchpad button displays one or more of the following animation effects: display animation effects, vibration animation effects, and sound animation effects. Display animation effects include one or more of the following: widening, heightening, transparency changes, contrast changes, color changes, flashing, blurring button edges, and hotspot indicators. This allows users to feel more accepting and confident when using the touchpad.

[0020] In a second aspect, an electronic device is provided, comprising: a display screen for displaying an interface; a memory for storing computer program instructions; and a processor for executing the computer program instructions to support the electronic device in implementing the methods as described in any possible implementation of the first aspect.

[0021] Thirdly, a readable storage medium is provided that stores program instructions that, when executed by a device, can implement the methods in any possible implementation of the first aspect.

[0022] Fourthly, a program product containing instructions is provided, which, when run on a device, enables the device to perform methods as described in any possible implementation of the first aspect.

[0023] Fifthly, a chip system is provided, comprising processing circuitry and a storage medium storing program instructions; when executed by the processing circuitry, the program instructions can implement the methods described in any possible implementation of the first aspect. The chip system may be composed of chips or may include chips and other discrete devices. Attached Figure Description

[0024] Figure 1 These are schematic diagrams of several virtual input panel display schemes;

[0025] Figure 2A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;

[0026] Figure 3 The method flow for displaying a virtual input panel provided in the embodiments of this application Figure 1 ;

[0027] Figure 4 A schematic diagram of a virtual input panel provided in an embodiment of this application;

[0028] Figure 5 Schematic diagrams of several virtual input panels provided in the embodiments of this application;

[0029] Figure 6 The method flow for displaying a virtual input panel provided in the embodiments of this application Figure 2 ;

[0030] Figure 7 The method flow for displaying a virtual input panel provided in the embodiments of this application Figure 3 ;

[0031] Figure 8 Schematic diagram of virtual input panel display changes provided in embodiments of this application Figure 1 ;

[0032] Figure 9 Schematic diagram of virtual input panel display changes provided in embodiments of this application Figure 2 ;

[0033] Figure 10 Schematic diagram of virtual input panel display changes provided in embodiments of this application Figure 3 ;

[0034] Figure 11 This is a schematic diagram of the reuse of the lower display area provided in an embodiment of this application;

[0035] Figure 12 Schematic diagram of virtual input panel display changes provided in embodiments of this application Figure 4 . Detailed Implementation

[0036] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0037] In the following text, the terms "first," "second," etc., are used only to distinguish different descriptive objects and do not limit the position, order, priority, quantity, or content of the described objects. For example, if the described object is a "field," then the ordinal numbers before "field" in "first field" and "second field" do not limit the position or order of the "fields." "First" and "second" do not limit whether the "fields" they modify are in the same message, nor do they restrict the order of "first field" and "second field." Similarly, if the described object is a "level," then the ordinal numbers before "level" in "first level" and "second level" do not limit the priority of the "levels." Furthermore, the quantity of described objects is not limited by ordinal numbers and can be one or more; for example, in "first device," the number of "devices" can be one or more. In addition, objects modified by different prefixes can be the same or different. For example, if the described object is "device," then "first device" and "second device" can be devices of the same type or different types. Similarly, if the described object is "information," then "first information" and "second information" can be information with the same content or information with different content. In summary, the use of ordinal numbers and other prefixes used to distinguish the described objects in the embodiments of this application does not constitute a limitation on the described objects. The description of the described objects is given in the claims or the context of the embodiments, and the use of such prefixes should not constitute an unnecessary limitation.

[0038] Furthermore, in the embodiments of this application, "connection" can be a direct connection or an indirect connection; in addition, it can refer to an electrical connection or a communication connection; for example, the connection of two electrical components A and B can refer to A and B being directly connected, or it can refer to A and B being indirectly connected through other electrical components or connection media, or it can refer to A and B being indirectly connected through other communication devices or communication media, as long as it enables communication between A and B.

[0039] As described in the background section, conventional virtual input panel display solutions can only provide a few fixed display formats and cannot make more granular adjustments to the display layout according to user needs. Therefore, they cannot meet user needs in many cases.

[0040] As an example, with Figure 1 Taking the laptop computer 100 shown as an example, as Figure 1 As shown in (a), the laptop computer 100 includes two display areas 101 (also commonly referred to as the "B-side") and 102 (also commonly referred to as the "C-side"). Display area 101 is used for content display, and display area 102 is used for virtual input panel display. For example, users can switch the functions of the virtual input panel, such as switching the virtual input panel to keyboard-only mode, touchpad-only mode, and keyboard and mouse co-operation mode.

[0041] As an example, the display layout on the display area 102 of a laptop 100 in keyboard-only mode might be as follows: Figure 1 As shown in (b), the display layout on the display area 102 of the laptop 100 in touchpad-only mode may be as follows: Figure 1 As shown in (c), the display layout on the display area 102 of the laptop 100 in keyboard and mouse collaboration mode may be as follows: Figure 1 As shown in (d) in the figure.

[0042] Figure 1 Although the display area 102 of the laptop 100 shown can be used for display, it is mainly used for displaying the virtual input panel. Even if the user does not need to input, this display area cannot be reused for content display. If this shortcoming is optimized, it will greatly improve the flexibility of the display area layout, meet more diverse user needs, and improve the user experience.

[0043] In order to solve similar Figure 1 The aforementioned drawbacks of the laptop 100 in use are addressed in some solutions where the electronic device can provide a combined display mode of content and virtual input panel on the display area 102. In this mode, a portion of the display area 102 is used for content display, and another portion for virtual input panel display. However, in this solution, the display areas for content and virtual input panel cannot be adjusted to finer-grained layouts according to user needs, thus failing to meet user requirements in many situations. Furthermore, while this solution increases the size of the content display area, it encroaches on the size of the virtual input panel. In scenarios where users have high demands for the virtual input panel, this can lead to an ergonomically unfriendly virtual input panel size, restricting user input operations and affecting input efficiency and comfort.

[0044] Alternatively, in some solutions, the electronic device can allow the user to adjust the size of the virtual input panel displayed on the display area 102, so that the display area 102 can display content in areas not used for displaying the virtual input panel. However, this solution requires the user to manually adjust the ratio between the content display area and the virtual input panel display area on the display area 102. The effect of manual adjustment may result in the size of the virtual input panel not conforming to ergonomics, affecting input efficiency and input comfort.

[0045] To ensure good input efficiency and comfort for users while providing them with the freedom to allocate the display area and input panel area ratio according to their needs, and to meet more diverse user requirements, this application provides a method for displaying a virtual input panel. This method adaptively adjusts the size of the virtual touchpad on the virtual input panel based on the user's adjustment of the virtual keyboard position, to meet the user's personalized usage needs for the display area (denoted as the first display area). For example, the first display area can be used to display content in full screen, display the virtual input panel in full screen, or display both content and the virtual input panel in split-screen mode. Simultaneously, when the virtual input panel is displayed on the first display area, the size of the virtual input panel is ensured to conform to ergonomics, guaranteeing the user's input efficiency and comfort.

[0046] The electronic device described in this application includes one or more displays. For example, the electronic device may include, but is not limited to, smartphones, netbooks, tablets, smart drawing tablets, handwriting tablets, PDAs, in-vehicle computers, personal computers (PCs) (such as laptops), personal digital assistants (PDAs), portable multimedia players (PMPs), augmented reality (AR) / virtual reality (VR) devices, smart TVs, projection devices, or motion-sensing game consoles in human-computer interaction scenarios, etc., devices with display functions. Alternatively, the electronic device may also be other types or structures of electronic devices, which are not limited in this application.

[0047] In some embodiments, the electronic device can function as a peripheral to other devices, such as a keyboard input and / or touchpad input device for other devices.

[0048] In some embodiments, the electronic device can function as a content display device and support users to display corresponding content through virtual keyboard input and / or virtual touchpad input.

[0049] The embodiments of this application do not limit the specific functions, usage scenarios, and roles of electronic devices.

[0050] As an example, please refer to Figure 2 , Figure 2 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application is shown.

[0051] like Figure 2As shown, the electronic device includes a processor 210, a memory (including an external memory interface 220 and an internal memory 221), a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, a headphone jack 270D, a sensor module 280, buttons 290, a motor 291, indicator lights 292, a camera 293, a display screen 294, etc.

[0052] The sensor module 280 includes a touch sensor 280A and a pressure sensor 280B. In some embodiments, the sensor module 280 may also include, but is not limited to, one or more of the following: a temperature sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer, a distance sensor, a proximity sensor, a fingerprint sensor, an ambient light sensor, a bone conduction sensor, etc.

[0053] Processor 210 includes one or more processing units. For example, processor 210 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a flight controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0054] The processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. This memory can store instructions or data that the processor 210 has just used or that are used repeatedly. If the processor 210 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.

[0055] In some embodiments of this application, the processor 210 can adjust the position of the virtual keyboard accordingly when the user performs a first operation on the virtual keyboard, and adaptively adjust the virtual touchpad according to the adjusted position of the virtual keyboard, such as adjusting the display layout and / or functions of the virtual touchpad.

[0056] For example, the processor 210 can calculate the maximum height of the touchpad that can be accommodated on the virtual input panel, i.e., the target height, based on the position of the adjusted virtual keyboard. When threshold 2 ≤ target height < threshold 1, the height of the virtual touchpad is adjusted to the target height; or when the target height ≥ threshold 1, the height of the virtual touchpad is adjusted to the standard height; or when the target height < threshold 2, the virtual touchpad is hidden (i.e., the virtual touchpad is not displayed) or displayed in a minimized state; or when the target height < threshold 3, the virtual touchpad only includes touchpad buttons.

[0057] In some embodiments, the processor 210 can also adaptively adjust the width of the virtual touchpad according to the target height after adjusting the height of the virtual touchpad to the target height, such as gradually increasing the width of the virtual touchpad when the target height gradually decreases, and gradually decreasing the width of the virtual touchpad when the target height gradually increases.

[0058] The wireless communication function of the electronic device can be realized through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor and baseband processor, etc.

[0059] In some embodiments of this application, the electronic device can communicate with other devices through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor, and baseband processor.

[0060] For example, when an electronic device is used as a peripheral for other devices, the electronic device can transmit input signals to other devices through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor, and baseband processor.

[0061] Display screen 294 includes a display panel. As an example, the display panel may be a low-temperature poly-silicon (LTPS) display, a low-temperature polycrystalline oxide (LTPO) display, a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) display, a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc.

[0062] In this embodiment of the application, the electronic device may include one or more displays 294.

[0063] Electronic devices implement display functions through GPUs, displays 294, and APs. A GPU is a microprocessor for image processing, connected to both the display 294 and the AP. The GPU performs mathematical and geometric calculations for drawing, rendering, or compositing graphics. Processor 210 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0064] In some embodiments of this application, the electronic device can perform related processing of interfaces such as virtual input panels (including virtual keyboards and / or virtual touchpads) and content pages through AP, GPU, etc., and display the virtual input panels, content pages and other interfaces through the display screen 294.

[0065] In this embodiment, the sensor module 280 may include, but is not limited to, one or more of the following: touch sensor 280A, pressure sensor 280B.

[0066] Touch sensor 280A, also known as a "touch panel," is used to detect touch operations applied to or near it. The touch sensor can transmit raw information, such as touch location, touch pressure, touch area, and touch duration, to the processor for subsequent operation information acquisition, input event generation, and processing. In some embodiments, the processor can provide visual output related to the touch operation through display screen 294. Touch operations, such as clicks and swipes, are not limited to any particular type.

[0067] Pressure sensor 280B is used to sense pressure signals and convert them into electrical signals. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may consist of at least two parallel plates made of conductive material. When a force is applied to the pressure sensor, the capacitance between the electrodes changes. The electronic device determines the pressure intensity based on the change in capacitance. When a touch operation is applied to the display screen 294, the electronic device can detect the touch force, etc., through the pressure sensor. The electronic device can also calculate the touch position based on the detection signal from pressure sensor 280B.

[0068] In this embodiment, the sensor module 280, such as touch sensor 280A and / or pressure sensor 280B, can be used to detect one or more of the following user operations: pulling operation on the edge of the virtual keyboard, clicking operation on touchpad buttons, clicking operation on virtual keys on the virtual keyboard, sliding operation on the virtual touchpad, etc.

[0069] The external memory interface 220 can be used to connect external memory cards, such as Micro SD cards, to expand the storage capacity of electronic devices. The external memory card communicates with the processor 210 through the external memory interface 220 to perform data storage.

[0070] Internal memory 221 can be used to store computer executable program code. Exemplarily, the computer program may include an operating system program and application programs. The executable program code includes instructions. Processor 210 executes various functional applications and data processing of the electronic device by running the instructions stored in internal memory 221. Internal memory 221 may include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function, etc. The data storage area may store data created during the use of the electronic device, etc. Furthermore, internal memory 221 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 210 executes various functional applications and data processing of the electronic device by running instructions stored in internal memory 221 and / or instructions stored in memory disposed within the processor.

[0071] Electronic devices can perform audio functions through audio modules 270, speakers 270A, receivers 270B, microphones 270C, and access points (APs), such as music playback and recording.

[0072] about Figure 2The descriptions of the charging management module 240, power management module 241, battery 242, motor 291, indicator light 292, etc. shown can be found in conventional technology and will not be elaborated here.

[0073] This application Figure 2 The illustrated structure does not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0074] Please refer to Figure 3 , Figure 3 A flowchart illustrating a method for displaying a virtual input panel according to an embodiment of this application is shown. Figure 3 As shown, the virtual input panel display method provided in this application embodiment can be implemented based on S301-S303:

[0075] S301: Electronic device displays a virtual input panel, which includes a virtual keyboard and a virtual touchpad.

[0076] As an example, the electronic device includes a first screen display area, such as a first display screen, for displaying a virtual input panel. Exemplarily, the electronic device may include, but is not limited to, a tablet computer, a foldable screen device in an unfolded state, a smart drawing board, a writing tablet, and so on.

[0077] As an example, such as Figure 4 As shown, the virtual input panel is displayed in full screen on the first display screen.

[0078] As an example, the virtual input panel is displayed in a non-full-screen manner on the first display screen. For instance, the non-full-screen virtual input panel might be... Figure 5 The virtual input panel shown in (a) is in a display state where the bottom edge is close to the bottom edge of the first display screen, the left edge is close to the left edge of the first display screen, the right edge is close to the right edge of the first display screen, and the top edge is not close to the bottom edge of the first display screen; for example, a virtual input panel that is not displayed in full screen may be... Figure 5 The virtual input panel shown in (b) is in a display state where the top edge is close to the top edge of the first display screen, the left edge is close to the left edge of the first display screen, the right edge is close to the right edge of the first display screen, and the bottom edge is not close to the bottom edge of the first display screen; for example, a virtual input panel that is not displayed in full screen may be... Figure 5 The virtual input panel shown in (c) is in a display state where the top edge is close to the top edge of the first display screen, the left edge is close to the left edge of the first display screen, the bottom edge is close to the bottom edge of the first display screen, and the right edge is not close to the right edge of the first display screen; for example, a virtual input panel that is not displayed in full screen may be... Figure 5 The virtual input panel shown in (d) has its top edge close to the top edge of the first display screen, its right edge close to the right edge of the first display screen, its bottom edge close to the bottom edge of the first display screen, and its left edge not close to the left edge of the first display screen; for example, a non-full-screen virtual input panel might be... Figure 5 The virtual input panel shown in (e) is in a display state where the top, bottom, left, and right edges are not close to the edge of the first display screen. Alternatively, the virtual input panel may also be in other non-full-screen display states, such as: the top and bottom edges are close to the edge of the first display screen, while the left and right edges are not; the top and left edges are close to the edge of the first display screen, while the bottom and right edges are not; the top and right edges are close to the edge of the first display screen, while the bottom and left edges are not; the top, bottom, and left edges are close to the edge of the first display screen, while the right edge is not; the top, bottom, and right edges are close to the edge of the first display screen, while the left edge is not; the top, left, and right edges are close to the edge of the first display screen, while the bottom edge is not; the bottom, left, and right edges are close to the edge of the first display screen, while the top edge is not, etc. This application does not limit the specific display position of the virtual input panel on the first display screen.

[0079] As an example, in addition to a virtual input panel, an electronic device also displays a content page (denoted as the "first content page"). Exemplarily, the first content page includes, but is not limited to, one or more of the following: application page, mini-program page, etc. For example, in... Figure 5 (a) Figure 5 (b) Figure 5 (c) Figure 5 (d) and Figure 5 In the example shown in (e), the area on the first display screen other than the virtual input panel may display a content page (i.e., the first content page). The first content page may include a complete page or multiple independent pages without limitation; the multiple independent pages may belong to the same application or different applications without limitation.

[0080] As an example, in addition to a first display screen, the electronic device may also include a second screen display area, such as a second display screen, for displaying a content page (denoted as "second content page"). Exemplarily, the electronic device may include, but is not limited to, foldable laptops, dual-screen laptops, and so on.

[0081] The embodiments of this application do not limit the specific input function areas included on the virtual input panel. For example, in some embodiments, the virtual input panel may also include one or more other input function areas such as a virtual scroll wheel and an input status indicator, which may be determined according to the device function, application function, user settings, etc.

[0082] S302: The electronic device receives a first operation from the user on the virtual keyboard, the first operation being used to adjust the position of the virtual keyboard.

[0083] As an example, the first action is the user dragging the edge of the virtual keyboard to adjust its position.

[0084] For example, the first operation is a user pulling down on the edge of the virtual keyboard, which moves the virtual keyboard down; another example is a user pulling up on the edge of the virtual keyboard, which moves the virtual keyboard up; yet another example is a user pulling right on the edge of the virtual keyboard, which moves the virtual keyboard to the right; and yet another example is a user pulling left on the edge of the virtual keyboard, which moves the virtual keyboard to the left.

[0085] As one possible implementation, when a user performs a first operation on an electronic device, the electronic device can acquire the touch signal of the first operation. For example, it can detect the touch signal acting on the display screen through a sensor module (including but not limited to touch sensors and / or pressure sensors), identify the user's touch gesture based on the touch signal of the first operation, and determine the user's operation intention and control space based on the touch gesture. For example, if the first operation is identified as a user pulling down on the edge of the virtual keyboard, the user's operation intention is determined to move the virtual keyboard down; if the first operation is identified as a user pulling up on the edge of the virtual keyboard, the user's operation intention is determined to move the virtual keyboard up; if the first operation is identified as a user pulling right on the edge of the virtual keyboard, the user's operation intention is determined to move the virtual keyboard right; and if the first operation is identified as a user pulling left on the edge of the virtual keyboard, the user's operation intention is determined to move the virtual keyboard left.

[0086] The first operation in this application embodiment may be used directly to adjust the position of the virtual keyboard, or it may be used indirectly to adjust the position of the virtual keyboard.

[0087] For example, the first operation might trigger the addition of other input controls to the virtual input panel, which would cause (e.g., cause obstruction) the position of the virtual keyboard. For instance, the first operation could be a user dragging the edge of the virtual keyboard, clicking (e.g., single click, double click, or long press), which would trigger the addition of other input controls to the virtual input panel, causing (e.g., cause obstruction) the position of the virtual keyboard to shift downwards.

[0088] For example, the first operation might be used to trigger other input controls to disappear from the virtual input panel, causing the position of the virtual keyboard to change. For instance, the first operation could be a user dragging the edge of the virtual keyboard, clicking (e.g., single click, double click, or long press), which triggers other input controls to disappear from the virtual input panel, causing the virtual keyboard to move upwards.

[0089] S303: In response to the first operation, the electronic device adjusts the position of the virtual keyboard and adaptively adjusts the virtual touchpad.

[0090] As an example, in response to a first operation, the electronic device obtains a virtual keyboard position adjustment scheme based on the operation intent and control space of the first operation and makes corresponding adjustments, such as adjusting the position of the virtual keyboard from a first position to a second position.

[0091] As one possible implementation, the electronic device can determine and adjust the position of the virtual keyboard based on the operation intent and control space of the first operation, and calculate the target size of the virtual touchpad, such as the target height of the virtual touchpad, based on the adjusted keyboard position. For example, the target height is the maximum height of the touchpad that can be accommodated on the virtual input panel after the virtual keyboard position is adjusted.

[0092] In this embodiment, the height of the touchpad refers to the distance between the top and bottom edges of the virtual touchpad; the width of the virtual touchpad refers to the distance between the left and right edges of the virtual touchpad. In some scenarios, the top edge of the virtual touchpad may be the bottom edge of the virtual keyboard.

[0093] In some embodiments, the electronic device adaptively adjusts the virtual touchpad, such as by adjusting the display layout and / or functionality of the virtual touchpad according to a second position adjusted by the virtual keyboard.

[0094] like Figure 3As shown, after the electronic device adaptively adjusts the display layout of the virtual touchpad, the following situations may occur: the virtual touchpad height is the standard height, the virtual touchpad height is the target height, the virtual touchpad is not displayed, the virtual touchpad is displayed in a minimized state, and the virtual touchpad only includes touchpad buttons. For example, the minimized state includes, but is not limited to, not displaying the virtual touch area but only displaying touchpad function icons, etc.

[0095] As an example, when the target height meets the first condition, the electronic device adjusts the height of the virtual touchpad to the target height; or, when the target height meets the second condition, the virtual touchpad is hidden or displayed in a minimized state; or, when the target height meets the third condition, the virtual touchpad only includes touchpad buttons; or, when the target height meets the fourth condition, the electronic device adjusts the height of the virtual touchpad to the standard height.

[0096] As an example, if the target height meets the first condition, such as threshold 2 ≤ target height < threshold 1, then the electronic device will adjust the height of the virtual touchpad to the target height; or, if the target height meets the second condition, such as target height < threshold 2, then the electronic device will hide the virtual touchpad (i.e., the virtual touchpad is not displayed) or display the virtual touchpad in a minimized state; or, if the target height meets the third condition, such as target height < threshold 3, then the virtual touchpad of the electronic device will only include touchpad buttons, i.e., the electronic device will not display the virtual touch area and will only display the touchpad buttons (i.e., the virtual touchpad only includes touchpad buttons), where threshold 3 is different from threshold 2; or, if the target height meets the fourth condition, such as target height ≥ threshold 1, then the electronic device will adjust the height of the virtual touchpad to the standard height.

[0097] As an example, assuming threshold 2 ≤ target height < threshold 1, the electronic device not only adjusts the height of the virtual touchpad to the target height, but also adaptively adjusts the width of the virtual touchpad according to the target height. Conversely, assuming the target height ≥ threshold 1, the electronic device not only adjusts the height of the virtual touchpad to the standard width, but also adjusts the width of the virtual touchpad to the standard width. This ensures that the size of the virtual touchpad conforms to ergonomics, reduces the complexity of touch operation for the user, and guarantees the user's input efficiency and comfort.

[0098] For example, assuming the intent of the first operation includes moving the virtual keyboard down, if threshold 2 ≤ target height < threshold 1, the electronic device can reduce the height of the virtual touchpad based on the virtual keyboard position (e.g., adjust it to the target height) and adaptively increase the width of the virtual touchpad according to the target height. This ensures that the size of the virtual touchpad conforms to ergonomics when the vertical operable space of the virtual touchpad is limited due to the downward movement of the virtual keyboard, thereby reducing the user's touch complexity and ensuring the user's input efficiency and input comfort.

[0099] For example, suppose the intention of the first operation includes moving the virtual keyboard up. If threshold 2 ≤ target height < threshold 1, the electronic device can increase the height of the virtual touchpad based on the position of the virtual keyboard (e.g., adjust it to the target height) and adaptively reduce the width of the virtual touchpad according to the target height to ensure that the size of the virtual touchpad conforms to ergonomics, reduce the user's touch complexity, and ensure the user's input efficiency and input comfort.

[0100] For example, the standard height is the default height of the touchpad, such as the height value of the virtual touchpad when the virtual input panel is displayed in full screen on the first display screen as set by the system; the standard width is the default width of the touchpad, such as the width value of the virtual touchpad when the virtual input panel is displayed in full screen on the first display screen as set by the system. Alternatively, the standard height and standard width may also be user-defined values ​​or other values ​​determined based on other principles, without limitation.

[0101] In some embodiments, such as Figure 3 As shown, assuming the target height is less than a threshold of 3, the electronic device displays the virtual touchpad at the target height. The electronic device adaptively adjusts the virtual touchpad's functionality, such as by no longer providing touchpad input. In this case, the virtual touchpad can exist in a smaller form, without occupying too much display area.

[0102] In some embodiments, if the electronic device hides the virtual touchpad (i.e., the virtual touchpad is not displayed), the electronic device may no longer provide touchpad input functionality. Alternatively, the electronic device may provide touchpad input functionality to the user by reusing the area where the virtual keyboard is located (such as part or all of the area). For example, the electronic device may provide touchpad input functionality through a first area located in the area where the virtual keyboard is located. The first area can serve as both a keyboard input hotspot and a touchpad input hotspot.

[0103] In this context, the hot zone refers to the area capable of sensing input signals. In some embodiments of this application, the touchpad input hot zone coincides with the area of ​​the displayed virtual touchpad; touchpad operation can only be sensed when the user touches a location within the virtual touchpad area. In some embodiments of this application, the touchpad input hot zone may not perfectly coincide with the area of ​​the virtual touchpad; for example, it may be larger than the virtual touchpad area. Even if the user does not touch the area of ​​the virtual touchpad but touches outside the edge of that area, it can still be recognized as a touchpad operation targeting the virtual touchpad.

[0104] As an example, the electronic device does not display a virtual touchpad. Instead, it provides touchpad input functionality through a first area located within the virtual keyboard area. For instance, the electronic device can display a content page and a virtual input panel. The virtual input panel includes a virtual keyboard and a multiplexing toggle button, but does not include a virtual touchpad. The multiplexing toggle button switches the function of the virtual keyboard area to keyboard input or touchpad input. As another example, the electronic device can display a content page and a virtual input panel, including a virtual keyboard but not a virtual touchpad. The electronic device can determine whether the virtual keyboard area functions as keyboard input or touchpad input based on the type of user operation. For example, if the user's operation is a click, the electronic device provides keyboard input functionality through the virtual keyboard area; if the user's operation is a swipe, the electronic device provides touchpad input functionality through the virtual keyboard area.

[0105] In some embodiments, if the electronic device displays a virtual touchpad in its minimized state, it is possible that the electronic device no longer provides touchpad input functionality through the virtual input panel, or the electronic device can provide touchpad input functionality to the user through a first area located in the area where the virtual keyboard is located. Furthermore, the electronic device can support the user to re-raise the virtual touchpad via a touchpad function icon, for example, in response to the user clicking the touchpad function icon, displaying the virtual touchpad at a standard height and width; or the electronic device can support the user to provide touchpad input functionality to the user via a reused virtual keyboard through a touchpad function icon, for example, in response to the user clicking the touchpad function icon, the electronic device reuses the area where the virtual keyboard is located to provide touchpad input functionality. For a related introduction on reusing the virtual keyboard to provide touchpad input functionality to the user, please refer to the above description, which will not be repeated here.

[0106] In some embodiments, the electronic device provides touchpad input functionality via touchpad buttons, and / or the electronic device can support providing touchpad input functionality to the user through a first area, the first area being located in the area where the virtual keyboard is located. For example, the width of the touchpad buttons is less than a width threshold (e.g., the width threshold may range from 5cm to 10cm, without limitation), and / or the height of the touchpad buttons is less than a height threshold (e.g., the height threshold may range from 2mm to 5mm, without limitation). The touchpad buttons can visually indicate their approximate location to the user in a small form (e.g., a narrow strip with a height of 2mm) without occupying display area.

[0107] As an example, the electronic device can provide touchpad input functionality via touchpad buttons when the target height of the virtual touchpad is small, such as when the target height meets a third condition (e.g., target height < threshold 3), and / or the electronic device can support providing touchpad input functionality to the user through a first area located in the area where the virtual keyboard is located.

[0108] In this embodiment, the first operation may be a continuous process. The electronic device can continuously analyze the received first operations to obtain corresponding size adjustment schemes and make corresponding size adjustments. For example, the electronic device can follow the continuous first operation and continuously execute S302-S303 to achieve the effect that the virtual keyboard and virtual touchpad display layout changes in real time with the user's operation.

[0109] For example, suppose an electronic device receives a continuous first operation to move the virtual keyboard down. Initially, the target height is greater than or equal to threshold 1, and the electronic device displays the virtual touchpad with a standard height and width. As the first operation continues, the target height gradually decreases until it meets the condition that threshold 2 ≤ target height < threshold 1. The electronic device then gradually decreases the height of the virtual touchpad and gradually increases its width. When the target height gradually decreases until it meets the condition that target height < threshold 2, the electronic device hides the virtual touchpad or displays it in a minimized state.

[0110] For example, suppose an electronic device receives a continuous first operation to move the virtual keyboard upwards. Initially, when the target height is less than threshold 2, the electronic device displays the virtual keyboard and hides or minimizes the virtual touchpad. As the first operation continues, the target height gradually increases until it satisfies threshold 2 ≤ target height < threshold 1. The electronic device then gradually increases the height of the virtual keyboard and virtual touchpad and gradually decreases the width of the virtual touchpad. When the target height gradually increases until it satisfies target height ≥ threshold 1, the electronic device displays the virtual touchpad at the standard height and width.

[0111] based on Figure 3 The virtual input panel display method shown allows the electronic device to adaptively adjust the size of the virtual touchpad on the virtual input panel based on the user's adjustment of the virtual keyboard position, in order to meet the user's personalized usage needs for the display area where the virtual input panel is located. For example, the virtual touchpad can be hidden when the user does not need to input with the touchpad, displayed in a minimized state, or only include touchpad buttons to provide more display area for content display. Alternatively, when the virtual input panel is displayed on the display area, the size of the virtual input panel can be ensured to conform to ergonomics, thus ensuring the user's input efficiency and input comfort.

[0112] In some embodiments, the height of the virtual touchpad is a target height, and the electronic device can also set the display and control parameters of the virtual touchpad. As an example, the display and control parameters may include, but are not limited to, the control-to-control ratio, such as the control-to-display-gain transfer function.

[0113] The control-to-display gain (CD gain) refers to the transmission relationship between movement in the control space and the display space. It is generally defined as the ratio of movement speed in the control space to movement speed in the display space. Specifically, CD gain is the ratio between movement in the control space (e.g., a finger actually sliding on a touchpad) and movement in the display space (e.g., the cursor moving on the screen). In some embodiments, CD gain varies with different control movement speeds. For example, a faster control speed results in a higher CD gain (e.g., when a finger wants to move the cursor faster, a higher CD gain helps the finger control the cursor to move quickly); a slower control speed results in a lower CD gain, indicating that the finger is controlling the cursor to approach the target and wants to precisely control the cursor to stop in the display space. A lower CD gain helps the finger precisely control the cursor's landing point.

[0114] In some embodiments, the virtual touchpad of an electronic device may use a fixed display ratio, including a vertical display ratio and / or a horizontal display ratio.

[0115] As an example, assume the target height satisfies the first condition, such as threshold 2 ≤ target height < threshold 1. Figure 3 The S303 shown can be used Figure 6 The S303A substitution shown in (a) is as follows:

[0116] S303A: In response to the first operation, the electronic device adjusts the position of the virtual keyboard, adaptively adjusts the height of the virtual touchpad to the target height, and adjusts the width of the virtual touchpad according to the target height, setting the same display control ratio for virtual touchpads of any height.

[0117] For example, an electronic device can adjust the height of the virtual touchpad to the target height and gradually widen the width of the virtual touchpad according to the target height value when the target height changes from threshold 2 to threshold 1, and use a fixed display ratio, including vertical display ratio and / or horizontal display ratio, during the change process; or, an electronic device can adjust the height of the virtual touchpad to the target height and gradually decrease the width of the virtual touchpad according to the target height value when the target height changes from threshold 1 to threshold 2, and use a fixed display ratio, including vertical display ratio and / or horizontal display ratio, during the change process.

[0118] As an example, suppose the target height satisfies the fourth condition, such as target height ≥ threshold 1. Figure 3 The S303 shown can be used Figure 6 The S303A replacement shown in (b) is as follows:

[0119] S303B: In response to the first operation, the electronic device adjusts the position of the virtual keyboard, adjusts the height of the virtual touchpad to the standard height, adjusts the height of the virtual touchpad to the standard width, and sets the same display control ratio for virtual touchpads of any height.

[0120] For example, when the target height increases from threshold 2 to threshold 1, the electronic device can adjust the height of the virtual touchpad to the standard height and the height of the virtual touchpad to the standard width, and maintain the standard height and standard width of the virtual touchpad unchanged during the subsequent increase, and use a fixed display ratio, including the vertical display ratio and / or the horizontal display ratio, during the change; or, the electronic device can maintain the standard height and standard width of the virtual touchpad unchanged during the decrease of the target height from greater than threshold 1 to threshold 2, and use a fixed display ratio, including the vertical display ratio and / or the horizontal display ratio, during the change.

[0121] In some embodiments, Figure 6 (a) and Figure 6 The virtual touchpad shown in (b) includes touchpad buttons to support user actions such as moving the cursor, clicking (e.g., single click, double click, etc.) or right-clicking the object.

[0122] In some embodiments, the virtual touchpad of an electronic device may use a dynamically varying display ratio, including a vertical display ratio and / or a horizontal display ratio.

[0123] As an example, an electronic device may determine the display-to-control ratio of a virtual touchpad based on one or more of the following: target height, height of the electronic device’s display screen (such as a first display screen), touch pressure of the second operation, and touch gesture of the second operation; wherein the first display screen is used to display a virtual input panel, and the second operation is an input operation by the user on the virtual touchpad.

[0124] As an example, assume the target height satisfies the first condition, such as threshold 2 ≤ target height < threshold 1. Figure 3 The S303 shown can be used Figure 7 The S303C substitution shown in (a) is as follows:

[0125] S303C: In response to the first operation, the electronic device adjusts the position of the virtual keyboard, adaptively adjusts the height of the virtual touchpad to the target height, adjusts the width of the virtual touchpad according to the target height, and sets the display control ratio of the virtual touchpad according to predefined rules.

[0126] For example, when the target height changes from threshold 2 to threshold 1, the electronic device can adjust the height of the virtual touchpad to the target height and gradually widen the width of the virtual touchpad according to the target height value. During the change, the device can set the display ratio of the virtual touchpad according to predefined rules, including the vertical display ratio and / or the horizontal display ratio. Alternatively, when the target height changes from threshold 1 to threshold 2, the electronic device can adjust the height of the virtual touchpad to the target height and gradually decrease the width of the virtual touchpad according to the target height value. During the change, the device can set the display ratio of the virtual touchpad according to predefined rules, including the vertical display ratio and / or the horizontal display ratio.

[0127] In some embodiments, in response to the first operation, the electronic device may also adjust the position of the virtual keyboard, adaptively adjust the height of the virtual touchpad to a target height, and adjust the width of the virtual touchpad according to the target height. In some embodiments, the electronic device is capable of setting the vertical display ratio of the virtual touchpad according to predefined rules, and setting the same fixed horizontal display ratio for virtual touchpads of any height.

[0128] In some embodiments, in response to the first operation, the electronic device may also adjust the position of the virtual keyboard, adaptively adjust the height of the virtual touchpad to a target height and adjust the width of the virtual touchpad according to the target height, set the horizontal display ratio of the virtual touchpad according to a predefined rule, and set the same fixed vertical display ratio for virtual touchpads of any height.

[0129] As an example, suppose the target height satisfies the fourth condition, such as target height ≥ threshold 1. Figure 3 The S303 shown can be used Figure 7 The S303D replacement shown in (b) is as follows:

[0130] S303D: In response to the first operation, the electronic device adjusts the position of the virtual keyboard, adjusts the height of the virtual touchpad to the standard height, adjusts the height of the virtual touchpad to the standard width, and sets the display ratio of the virtual touchpad according to predefined rules.

[0131] For example, when the target height increases from threshold 2 to threshold 1, the electronic device can adjust the height of the virtual touchpad to the standard height and the height of the virtual touchpad to the standard width. As the target height continues to increase from threshold 1, the standard height and standard width of the virtual touchpad remain unchanged. During the change, the display ratio of the virtual touchpad is set according to predefined rules, including the vertical display ratio and / or the horizontal display ratio. Alternatively, the electronic device can maintain the standard height and standard width of the virtual touchpad unchanged as the target height decreases from above threshold 1 to threshold 2. During the change, the display ratio of the virtual touchpad is set according to predefined rules, including the vertical display ratio and / or the horizontal display ratio.

[0132] In some embodiments, in response to the first operation, the electronic device may also adjust the position of the virtual keyboard, adjust the height of the virtual touchpad to a standard height, adjust the height of the virtual touchpad to a standard width, set the vertical display ratio of the virtual touchpad according to a predefined rule, and set the same horizontal display ratio for virtual touchpads of any height.

[0133] In some embodiments, in response to the first operation, the electronic device may also adjust the position of the virtual keyboard, adjust the height of the virtual touchpad to a standard height, adjust the height of the virtual touchpad to a standard width, set the horizontal display ratio of the virtual touchpad according to a predefined rule, and set the same vertical display ratio for virtual touchpads of any height.

[0134] For example, predefined rules, but not limited to one or more of the following:

[0135] 1) The display-to-control ratio is inversely related to the target height. For example, the smaller the target height, the larger the longitudinal and / or lateral display-to-control ratio; the larger the target height, the smaller the longitudinal and / or lateral display-to-control ratio.

[0136] 2) The display ratio is positively correlated with the height of the screen display area (such as the first display screen). For example, the larger the height of the screen display area, the greater the vertical display ratio and / or the horizontal display ratio; the smaller the height of the screen display area, the smaller the vertical display ratio and / or the horizontal display ratio.

[0137] 3) The display-to-control ratio is related to (e.g., positively correlated) the touch pressure of the user's second operation, which is the user's input on the virtual touchpad. For example, the lower the user's touch pressure, the lower the vertical and / or horizontal display-to-control ratio; the higher the user's touch pressure, the higher the vertical and / or horizontal display-to-control ratio. As an example, the user's touch pressure can be estimated from the contact area of ​​the touch point and / or determined based on other touch-related information, without limitation.

[0138] 4) The display-to-control ratio is related to the user's second touch gesture. For example, different touch gestures correspond to different display-to-control ratios, such as two-finger swipe operations and single-finger swipe operations, which correspond to different vertical and / or horizontal display-to-control ratios.

[0139] The predefined rules mentioned above are merely examples. In practical applications, the display ratio of the virtual touchpad may be dynamically set based on other rules. This application does not limit this.

[0140] In some embodiments, Figure 7 (a) and Figure 7 The virtual touchpad shown in (b) includes touchpad buttons to support user actions such as moving the cursor, clicking (e.g., single click, double click, etc.) or right-clicking the object.

[0141] pass Figure 7 (a) and Figure 7 As shown in (b), dynamically setting the display-to-control ratio of the virtual touchpad can reduce the difficulty coefficient of cursor control of the virtual touchpad and improve the cursor control efficiency of the virtual touchpad, such as movement efficiency and positioning efficiency, when the vertical operable space of the virtual touchpad is limited. It can also ensure that the size of the virtual touchpad conforms to ergonomics, reduce the user's touch complexity, and ensure the user's input efficiency and input comfort.

[0142] The index of difficulty (ID) represents the difficulty level of the cursor operation task. For example, the difficulty level of a clicking task is related to the distance between the cursor's starting point and the target to be clicked in the display space, as well as the size of the target to be clicked (width along the movement direction). Similarly, the difficulty level of a tracing task is related to the path width and the distance between the starting point and the ending point.

[0143] In some embodiments, assuming the target height is less than a threshold of 3, the virtual touchpad of the electronic device only includes touchpad buttons, that is, the electronic device does not display a virtual touch area but only displays touchpad buttons. The electronic device may provide touchpad input functionality by displaying the area corresponding to the touchpad buttons, and / or the electronic device may provide touchpad input functionality by extending a first area, the first area being located in the area where the virtual keyboard is located.

[0144] For example, when an electronic device displays only touchpad buttons and not a virtual touch area, the device provides touchpad input functionality by displaying the corresponding area of ​​the touchpad buttons.

[0145] For example, when an electronic device displays only touchpad buttons and not a virtual touch area, the electronic device provides touchpad input functionality by displaying the corresponding area of ​​the touchpad buttons. In response to the user's touchpad button operation, the electronic device uses the first area as an extended hotspot of the touchpad buttons, including a sliding hotspot and a button hotspot, to provide touchpad input functionality.

[0146] By displaying only the touchpad buttons when vertical maneuverability is limited, the size of the virtual keyboard input hot zone can be ensured to conform to ergonomics, reducing the complexity of keyboard input for users and ensuring keyboard input efficiency and comfort.

[0147] Furthermore, by reusing the area where the virtual keyboard is located as the touchpad input hotspot, the actual input hotspot of the virtual touchpad can be increased when the vertically operable space is limited. This ensures that the size of the virtual touchpad conforms to ergonomics, reduces the complexity of touchpad input for users, and guarantees touchpad input efficiency and comfort. For example, when reusing the area where the virtual keyboard is located (such as part or all of it) as the touchpad input hotspot, as an example, the electronic device can recognize swipe gestures whose start or end point falls within the touchpad button area as cursor control gestures and respond to touchpad input.

[0148] In some embodiments, the touchpad buttons can also display one or more animation effects based on the user's operation.

[0149] As an example, the touchpad buttons can also display display effects based on user actions. For instance, when the user does not click the touchpad button, the width of the touchpad button is less than a width threshold (e.g., the width threshold may range from 5cm to 10cm, without limitation), and / or the height of the touchpad button is less than a height threshold (e.g., the height threshold may range from 2mm to 5mm, without limitation). When the user clicks the touchpad button, the touchpad button can display one or more of the following visual effects: widening, heightening (e.g., displaying at a height of 10mm), changes in transparency, changes in contrast, color changes, flashing, blurring button edges, hotspot indicators, etc., to prompt the user about the touchpad input hotspot when the touchpad button is displayed in a small form (e.g., a narrow strip with a height of 2mm), making the user more psychologically accepting and confident in using the touchpad. For example, by displaying hotspot prompts, users can be prompted to select the hotspot for touchpad input, making them more psychologically accepting and confident in using the indicated hotspot for touchpad input; by displaying widening and / or heightening animations, users can be prompted to indicate the vertical and / or horizontal expansion of the touchpad input hotspot, making them more psychologically accepting and confident in using the extended area around the touchpad buttons for touchpad input.

[0150] As an example, when a user clicks a touchpad button, the touchpad button can display other animations, such as vibration and / or sound effects, to indicate the touchpad input hotspot, making the user more psychologically accepting and confident in using the touchpad.

[0151] It should be noted that the embodiments of this application do not limit the specific shape and size of the touchpad buttons, which can be determined according to the type, function, model and user preferences of the electronic device.

[0152] As an example, an electronic device can acquire touch operation signals from a user within the touchpad's input area. Based on the number and location of contact points over a period of time, the displacement of the contact points during the contact process, and whether the contact points leave the surface within a certain timeframe, it can identify whether the touch operation is a click or a swipe (including single-finger swipes, multi-finger swipes, etc.). If a click is identified, touchpad button-related animations are provided, such as one or more of the following: display animations, vibration animations, sound animations, etc.; if a swipe is identified, touchpad cursor movement-related animations are provided.

[0153] The following will describe in detail the method for displaying a virtual input panel provided in the embodiments of this application, with reference to specific examples and accompanying drawings.

[0154] With electronic devices Figure 8 , Figure 9 , Figure 10 , Figure 12 The example shown is a laptop computer that includes a first display screen and a second display screen. Figure 8 (a) Figure 9 As shown in (a) in the middle, Figure 10 (a) or Figure 12 As shown in (a), at the initial moment, the electronic device displays a first interface and a second interface. The first interface includes a virtual input panel, which includes a virtual keyboard and a virtual touchpad. The second interface displays a content page.

[0155] Upon receiving a pull-down operation from the user on the upper edge of the virtual keyboard, the electronic device acquires the touch signal of the pull-down operation. For example, it detects the touch signal acting on the first display screen using a sensor module (including but not limited to touch sensors and / or pressure sensors). Based on the touch signal, it identifies the user's touch gesture and determines that the user's intention is to move the virtual keyboard down. Furthermore, the electronic device adjusts the position of the virtual keyboard based on the user's intention and the available control space. Based on the adjusted position, it calculates the maximum height of the touchpad that can be accommodated on the virtual input panel after the keyboard position adjustment, such as a target height.

[0156] As an example, such as Figure 8As shown in (b), assuming the target height is greater than or equal to the threshold 1, the electronic device adjusts the position of the virtual keyboard, adjusts the height of the virtual touchpad to the standard height, and adjusts the width of the virtual touchpad to the standard width.

[0157] As an example, such as Figure 9 As shown in (b), assuming threshold 2 ≤ target height < threshold 1, the electronic device adjusts the position of the virtual keyboard, adjusts the height of the virtual touchpad to the target height, and adaptively adjusts the width of the virtual touchpad according to the target height (e.g., ...). Figure 9 (b) shows the widened version.

[0158] In some embodiments, in the presence of Figure 8 (a) in Figure 8 During the process of change in (b) of the middle, or in the process of change from Figure 9 (a) in Figure 9 During the change in (b) of the process, the electronic device can use a fixed display ratio for the virtual touchpad, including a portrait display ratio and / or a landscape display ratio. In some embodiments, when the virtual touchpad is controlled by... Figure 8 (a) in Figure 8 During the process of change in (b) of the middle, or in the process of change from Figure 9 (a) in Figure 9 During the change in (b) of the above, the electronic device may use a dynamically changing display ratio for the virtual touchpad according to predefined rules, including the vertical display ratio and / or the horizontal display ratio. No limitations are imposed.

[0159] As an example, such as Figure 10 As shown in (b), assuming the target height is less than a threshold of 2, the electronic device either does not display the virtual touchpad or displays it in a minimized state (e.g., ...). Figure 10 (As shown in (b) above, only the touchpad function icons are displayed, not the virtual touch area.) Figure 10 The touchpad function icons shown in (b) are for illustrative purposes only. The specific location, shape, and size of the touchpad function icons are not limited in the embodiments of this application.

[0160] In some embodiments, Figure 10 In the example shown in (b), the electronic device can support the user to re-launch the virtual touchpad via the touchpad function icon, or the electronic device can support the user to trigger touchpad input functionality through a first area within the virtual keyboard area via the touchpad function icon. When providing touchpad input functionality through the first area, in some embodiments, such as... Figure 11 As shown, the electronic device can display a region indicator of the touchpad input hotspot (such as the first region) to prompt the user to perform touchpad input within that region.

[0161] As an example, such as Figure 12 As shown in (b), assuming the target height is less than the threshold 3, the electronic device does not display the virtual touch area but only the touchpad buttons, which are used to support the user to click (such as single click, double click, etc.) or right click on the object pointed to by the cursor. The touchpad buttons can visually indicate the approximate location of the touchpad buttons in a small form without occupying the display area.

[0162] In some embodiments, Figure 12 In the example shown in (b), the electronic device may provide touchpad input functionality by displaying the corresponding area of ​​the touchpad button, or the electronic device may provide touchpad input functionality by extending the first area of ​​the virtual keyboard area.

[0163] In some embodiments, Figure 12 In the example shown in (b), the touchpad buttons can also display animations based on the user's operation, including but not limited to one or more of the following: display animations, vibration animations, sound animations, etc.

[0164] according to Figure 8 , Figure 9 , Figure 10 , Figure 12 The process shows that initially, the electronic device displays the virtual touchpad with a standard width. As the virtual keyboard moves down, compressing the virtual touchpad's target height beyond threshold 1, the electronic device gradually reduces the virtual touchpad's height and widens it from the standard width. This is to ensure the virtual touchpad's size conforms to ergonomics by increasing its lateral operable space when the vertical operable space is limited, thus reducing the user's touch complexity and ensuring input efficiency and comfort. As the virtual keyboard continues to move down, compressing the virtual touchpad's target height beyond threshold 2, the electronic device hides the virtual touchpad or displays it in a minimized state. Alternatively, as the virtual keyboard continues to move down, compressing the virtual touchpad's target height beyond threshold 3, the electronic device only displays the touchpad buttons.

[0165] Similarly, suppose the user's action is used to... Figure 12 In the state shown in (b), moving the virtual keyboard up may cause the electronic device to exhibit the reverse process used for the next step described above.

[0166] For example, at the initial moment, the electronic device displays... Figure 12As shown in (b) of the diagram, as the virtual keyboard moves upwards, causing the target height of the virtual touchpad to exceed threshold 2, the electronic device gradually increases the height of the virtual touchpad and gradually decreases it. As the virtual keyboard continues to move upwards, causing the target height of the virtual touchpad to exceed threshold 1, the electronic device displays the virtual touchpad at standard width and standard height. For details regarding the display-to-control ratio settings during the virtual keyboard's upward movement, please refer to [reference needed]. Figures 8-12 This will not be repeated here.

[0167] This application provides a method for displaying a virtual input panel. This method adaptively adjusts the size of the virtual touchpad on the virtual input panel based on the user's adjustment of the virtual keyboard position, to meet the user's personalized usage needs for the display area (denoted as the first display area). For example, the first display area can be used to display content in full screen, display the virtual input panel in full screen, or display both content and the virtual input panel in split-screen mode. Simultaneously, when the virtual input panel is displayed on the first display area, the size of the virtual input panel is ensured to conform to ergonomics, guaranteeing the user's input efficiency and comfort.

[0168] It should be understood that the various solutions in the embodiments of this application can be used in a reasonable combination, and the explanations or descriptions of the various terms appearing in the embodiments can be referenced or explained to each other in the various embodiments, without limitation.

[0169] It should also be understood that, in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0170] It is understood that, in order to achieve the functions of any of the above embodiments, the electronic device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0171] This application embodiment can divide electronic devices into functional modules. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0172] It should also be understood that the various modules in an electronic device can be implemented in software and / or hardware, without specific limitations. In other words, an electronic device is presented in the form of functional modules. Here, "module" can refer to application-specific integrated circuits (ASICs), circuits, processors and memories that execute one or more software or firmware programs, integrated logic circuits, and / or other devices that can provide the above functions.

[0173] In an alternative approach, when data transmission is implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are implemented. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disk (DVD)), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0174] The steps of the methods or algorithms described in the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, portable hard disk, CD-ROM, or any other form of storage medium known in the art. One exemplary embodiment couples a storage medium to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and storage medium can reside in an ASIC. Alternatively, the ASIC can reside in an electronic device. Of course, the processor and storage medium can also exist as discrete components.

[0175] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

Claims

1. A method for displaying a virtual input panel, characterized in that, The method includes: The electronic device displays a virtual input panel, which includes a virtual keyboard and a virtual touchpad; The electronic device receives a first operation from the user on the virtual keyboard, the first operation being used to adjust the position of the virtual keyboard; In response to the first operation, the electronic device adjusts the position of the virtual keyboard from a first position to a second position, and adaptively adjusts the virtual touchpad according to the second position.

2. The method according to claim 1, characterized in that, Adjusting the virtual touchpad includes adjusting the display layout and / or functions of the virtual touchpad.

3. The method according to claim 1 or 2, characterized in that, The step of adaptively adjusting the virtual touchpad according to the second position includes: Based on the second position, the maximum height of the virtual touchpad that can be accommodated on the virtual input panel is determined as the target height; When the target height meets the first condition, the height of the virtual touchpad is adjusted to the target height; or, when the target height meets the second condition, the virtual touchpad is hidden or displayed in a minimized state; or, when the target height meets the third condition, the virtual touchpad only includes touchpad buttons.

4. The method according to claim 3, characterized in that, The step of adaptively adjusting the virtual touchpad according to the second position further includes: When the target height meets the first condition, the width of the virtual touchpad is adjusted according to the target height.

5. The method according to claim 4, characterized in that, Adjusting the width of the virtual touchpad according to the target height includes: As the target height gradually decreases, the width of the virtual touchpad increases; or, as the target height gradually increases, the width of the virtual touchpad decreases.

6. The method according to any one of claims 1-5, characterized in that, The virtual touchpad uses a fixed display-to-control ratio; or, The adjustment of the virtual touchpad further includes: determining the display-to-control ratio of the virtual touchpad according to one or more of the following: the target height, the height of the display screen of the electronic device, the touch pressure of the second operation, and the touch gesture of the second operation; The display control ratio is inversely related to the target height. The display screen is used to display the virtual input panel. The display control ratio is positively related to the height of the display screen. The second operation is the user's input operation on the virtual touchpad. The display control ratio is positively related to the touch pressure of the second operation.

7. The method according to any one of claims 3-6, characterized in that, The step of adaptively adjusting the virtual touchpad according to the second position further includes: When the virtual touchpad is hidden or displayed in a minimized state, the touchpad input function is stopped or the touchpad input function is provided through a first area, which is located in the area where the virtual keyboard is located; When the virtual touchpad only includes the touchpad buttons, touchpad input functionality is provided through the first area.

8. The method according to claim 7, characterized in that, The method further includes: The electronic device displays a region prompt for the first area.

9. The method according to claim 7 or 8, characterized in that, The method of displaying the virtual touchpad in a minimized state includes: displaying touchpad function icons; the method further includes: In response to a user clicking the touchpad function icon, the virtual touchpad is displayed with standard height and standard width; or, In response to a user clicking the touchpad function icon, the touchpad input function is provided through the first area.

10. The method according to any one of claims 7-9, characterized in that, The touchpad button's width is less than a width threshold, and / or the touchpad button's height is less than a height threshold; the method further includes: When a user clicks the touchpad button, the touchpad button displays one or more of the following animation effects: display animation effects, vibration animation effects, and sound animation effects. The display animation effects include one or more of the following: widening, heightening, transparency change, contrast change, color change, flashing, blurring the button edges, and hot zone indication.

11. The method according to any one of claims 1-10, characterized in that, The electronic device includes a first display screen, on which the virtual input panel and a first content page are displayed.

12. The method according to claim 11, characterized in that, The electronic device also includes a second display screen on which a second content page is displayed.

13. An electronic device, characterized in that, The electronic device includes: A display screen is used to display the interface. Memory is used to store computer program instructions; A processor for executing the computer program instructions to support the electronic device in implementing the method as described in any one of claims 1-12.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions that, when executed by a processing circuit, implement the method as described in any one of claims 1-12.

15. A computer program product containing instructions, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1-12.

Images