Touch operation response method, electronic device and readable storage medium
By displaying a touchpad-simulated interface on foldable electronic devices and using multiple components to process user operations, the problem of limited touch operation on foldable screens at different angles is solved, resulting in richer and more accurate response methods and improved user interaction experience.
Patent Information
- Application Number
- PCT/CN2024/098262
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-06-07
- Publication Date
- 2025-12-11
AI Technical Summary
In existing technologies, foldable screen electronic devices have a single touch operation response mode at different folding angles, which lacks richness and diversity, resulting in a poor user interaction experience.
The system displays a touchpad simulation interface and a second application interface on the foldable screen. It obtains touch coordinates by receiving capacitance data and accurately identifies and processes user operations using components such as a touch driver module, a coordinate calculation module, and an event distribution module, thereby achieving multiple touch response modes.
It improves the responsiveness and richness of touch operation, enhances the flexibility and convenience of user interaction, and adapts to functional needs under different folding angles.
Smart Images

Figure CN2024098262_11122025_PF_FP_ABST
Abstract
Description
Response method of touch operation, electronic device and readable storage medium TECHNICAL FIELD
[0001] The present application relates to the technical field of terminals, in particular to a response method of touch operation, an electronic device and a readable storage medium. BACKGROUND
[0002] With the development of terminal technology, in order to meet people's use requirements of different screen sizes, more and more electronic devices begin to use folding display screens, referred to as folding screens. The folding screen can be folded to different angles, and the display mode of the electronic device can change when the folding angle of the folding screen is in different angle ranges. That is, the picture displayed in the folding screen of the electronic device will change due to different folding angles.
[0003] Among them, when the display mode of the electronic device changes, the response mode of the electronic device to the touch operation on the folding screen also changes.
[0004] SUMMARY
[0005] The present application provides a response method of touch operation, an electronic device and a readable storage medium, which can improve the richness and diversity of the response mode of touch operation. The technical solution is as follows:
[0006] In a first aspect, a response method of touch operation is provided, applied to an electronic device with a folding screen, the method comprising: the folding screen displays a first application interface; in response to a first user operation, the folding screen displays a second application interface and a touchpad simulation interface, wherein the touchpad simulation interface includes a touchpad simulation area and / or at least one touch control, and the touchpad simulation area is used to simulate a touchpad; in response to a second user operation, the electronic device receives a value data; in response to receiving the value data, the second user operation on the folding screen is obtained according to the value data; in response to the touch coordinates being located in the touchpad simulation area, a third application interface is displayed, or in response to the touch coordinates being located in the position range of any one of the at least one touch control, the touchpad simulation interface is updated.
[0007] It should be noted that the first application interface and the second application interface can be an interface of the same application interface processed by the electronic device in different ways. Alternatively, the first application interface and the second application interface are application interfaces of two different application programs. Alternatively, the first application interface and the second application interface can be different application interfaces of the same application program.
[0008] As an example, the second application interface and the touchpad simulation interface can be displayed in a split screen in the folding screen; or the second application interface is displayed full screen in the folding screen, the touchpad simulation interface is displayed in a floating window, and the floating window is displayed on the second application interface; or the touchpad simulation interface is displayed full screen in the folding screen, and the second application interface is displayed in a floating window, and the floating window is displayed in the touchpad simulation interface.
[0009] In this way, the touchpad simulation interface and the second application interface can be displayed in the folding screen, and the user can control the second application interface through the touchpad simulation interface, thereby increasing the richness of the touch operation response mode on the basis of increasing the use function of the folding screen.
[0010] As an example of the present application, the electronic device includes a touch driving module, a touch chip, and a coordinate calculation module;
[0011] Based on this, in response to the second user operation, the electronic device receives the operation of the capacitance value data, which includes:
[0012] In response to the second user operation, the touch chip triggers an interrupt and sends the capacitance value data to the touch driving module; the touch driving module receives the capacitance value data.
[0013] In response to receiving the capacitance value data, the operation of obtaining the touch coordinates of the second user operation on the folding screen according to the capacitance value data includes:
[0014] The touch driving module sends the capacitance value data to the coordinate calculation module in response to receiving the capacitance value data; the coordinate calculation module determines the touch coordinates according to the capacitance value data; the coordinate calculation module sends the touch coordinates to the touch driving module; and the touch driving module receives the touch coordinates.
[0015] In this way, the coordinate calculation module can determine the touch position of the second user operation in the folding screen, thereby improving the accuracy of responding to the second user operation.
[0016] As an example of the present application, the touchpad simulation interface further includes a target area, which is an area in the touchpad simulation interface that cannot respond to the second user operation;
[0017] Based on this, after obtaining the touch coordinates of the second user operation on the folding screen according to the capacitance value data in response to receiving the capacitance value data, in response to the touch coordinates being located in the target area, the touch coordinates are discarded.
[0018] In this way, by discarding the touch coordinates that cannot be responded to, the response error of the touch operation is avoided.
[0019] As an example of the present application, the electronic device includes a touch driving module and an event dispatching module;
[0020] Based on this, in response to the touch coordinates being located in the touchpad simulation area, before the third application interface is displayed, the touch driver module sends the touch coordinates to the event dispatch module; the event dispatch module, in response to receiving the touch coordinates, determines the area of the touch coordinates in the foldable screen.
[0021] In response to touch coordinates being located in the simulated area of the touchpad, the operations for displaying a third application interface include:
[0022] In response to the touch coordinates being located in the touchpad simulation area, the event dispatch module sends the touch coordinates to the target application;
[0023] The target application responds to the received touch coordinates by displaying a third application interface.
[0024] In this way, by determining the area of the touch coordinates in the foldable screen through the event distribution module, the touch coordinates are accurately distributed, thereby improving the accuracy of responding to touch operations.
[0025] As an example of this application, the electronic device includes a touch driver module, an event dispatch module, and a window management module;
[0026] Based on this, the operation of updating the touchpad simulation interface in response to the touch coordinates being located within the position range of any one of the at least one touch controls includes:
[0027] In response to the touch coordinates being located within the range of any touch control, the event dispatch module sends the touch coordinates to the window management module; upon receiving the touch coordinates, the window management module updates the display range of the touchpad simulation area.
[0028] As an example of this application, after the window management module receives the touch coordinates and updates the display range of the touchpad simulation area, it can generate updated touchpad status information. The window management module sends the updated touchpad status information to the touch driver module through the first communication interface. The touch driver module parses the updated touchpad status information to obtain the updated touchpad display range. The touch driver module sends the updated touchpad display range to the coordinate calculation module through the second communication interface. In response to receiving the touchpad display range, the coordinate calculation module updates the stored touchpad display range.
[0029] In this way, by promptly notifying the coordinate calculation module to update the stored display range of the touchpad simulation area, the subsequent event distribution module can determine whether to discard the touch coordinates.
[0030] As an example of this application, the first user operation is a folding operation on the foldable screen;
[0031] In response to the first user operation, the operation of the folding screen displaying the second application interface and the trackpad simulation interface includes:
[0032] In response to the folding operation, the folding angle of the folding screen is monitored; in response to the folding angle of the folding screen being located within a preset angle range, display information of the folding screen is acquired; and in response to the display information indicating that the second application interface is displayed in the folding screen, the trackpad simulation interface and the second application interface are displayed in the folding screen in a split-screen mode.
[0033] In this way, by monitoring the folding angle, the corresponding function of the folding screen can be accurately implemented, and the timeliness of interaction with the user is improved.
[0034] As an example of the present application, the first user operation is a triggering operation on the trackpad control;
[0035] In response to the triggering operation on the trackpad control, the folding screen displays the second application interface and the trackpad simulation interface in a split-screen mode.
[0036] It should be noted that when the trackpad control is triggered to display the trackpad simulation interface, the folding screen can be in a full-screen unfolded state, thereby improving the richness of the display scenario of the trackpad simulation interface.
[0037] In this way, the display of the trackpad simulation interface is triggered in different ways, thereby improving the richness of the interaction and enriching the use scenarios of the display of the trackpad simulation interface.
[0038] As an example of the present application, the second application interface is any one application interface of a target application program, and the target application program is any one application program in a preset white list.
[0039] In this way, by setting the preset white list, the display of the trackpad simulation interface is more targeted.
[0040] As an example of the present application, in response to the touch coordinates being located in the trackpad simulation area, the operation of displaying the third application interface includes:
[0041] In response to the touch coordinates being located in the trackpad simulation area, if the mouse icon is not displayed in the second application interface, the third application interface is displayed, the third application interface being the second application interface displaying the mouse icon; or,
[0042] In response to the touch coordinates being located in the trackpad simulation area, if the mouse icon is displayed in the second application interface and the position of the mouse icon is the position of any one operation control in the second application interface, in response to the second user operation being a click operation or a long press operation, the second application interface is switched to the third application interface, the third application interface being other application interface of the target application program except the second application interface; or,
[0043] In response to the touch coordinates being located in the touchpad simulation area, if the mouse icon is displayed in the second application interface and there is no operation control capable of responding at the position of the mouse icon in the second application interface, in response to the second user operation being a click operation or a long press operation, a third application interface is displayed, the third application interface being the same as the second application interface; or,
[0044] In response to the touch coordinates being located in the touchpad simulation area, if the mouse icon is displayed in the second application interface, in response to the second user operation being a sliding operation, a third application interface is displayed, the position of the mouse icon in the third application interface being different from the position of the mouse icon in the second application interface.
[0045] In this way, different application interfaces are displayed according to the display position of the mouse icon and the operation type of the second user operation, and the accuracy of responding to the touch operation is improved.
[0046] In a second aspect, an electronic device is provided, which includes a processor and a memory in its structure, the memory being configured to store a program supporting the electronic device to execute the touch operation response method provided in the first aspect and store data related to the touch operation response method provided in the first aspect. The processor is configured to execute the program stored in the memory. The electronic device can further include a communication bus configured to establish a connection between the processor and the memory.
[0047] In a third aspect, a computer readable storage medium is provided, which stores instructions, when the instructions are executed on a computer, causing the computer to execute the touch operation response method provided in the first aspect.
[0048] In a fourth aspect, a computer program product is provided, which includes instructions, when the instructions are executed on a computer, causing the computer to execute the touch operation response method provided in the first aspect.
[0049] The technical effects obtained by the second aspect, the third aspect and the fourth aspect are similar to the technical effects obtained by the corresponding technical means in the first aspect, and thus are not described herein. BRIEF DESCRIPTION OF DRAWINGS
[0050] FIG. 1 is a schematic diagram of an electronic device with a folding screen according to an embodiment of the present application;
[0051] FIG. 2 is a structural schematic diagram of an electronic device according to an embodiment of the present application;
[0052] FIG. 3 is a block diagram of a software system of an electronic device according to an embodiment of the present application;
[0053] FIG. 4 is a schematic diagram of an application scenario according to an embodiment of the present application;
[0054] FIG. 5 is a schematic diagram of another application scenario according to an embodiment of the present application;
[0055] FIG. 6 is a schematic diagram of another application scenario according to an embodiment of the present application;
[0056] FIG. 7 is a schematic diagram of another application scenario according to an embodiment of the present application;
[0057] FIG. 8 is a schematic diagram of another application scenario according to an embodiment of the present application;
[0058] FIG. 9 is a schematic diagram of another application scenario according to an embodiment of the present application;
[0059] FIG. 10 is a schematic diagram of another application scenario according to an embodiment of the present application;
[0060] FIG. 11 is a schematic diagram of another application scenario according to an embodiment of the present application;
[0061] FIG. 12 is a schematic diagram of another application scenario according to an embodiment of the present application;
[0062] FIG. 13 is a schematic diagram of another application scenario according to an embodiment of the present application;
[0063] FIG. 14 is a schematic diagram of a response method of a touch operation according to an embodiment of the present application;
[0064] FIG. 15 is a schematic diagram of another response method of a touch operation according to an embodiment of the present application;
[0065] FIG. 16 is a schematic diagram of another response method of a touch operation according to an embodiment of the present application;
[0066] FIG. 17 is a schematic diagram of another response method of a touch operation according to an embodiment of the present application. DETAILED DESCRIPTION
[0067] In order to make the purpose, technical scheme and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the drawings.
[0068] It should be understood that every monetary unit referred to by the application refers to two or more. In the description of the application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" herein only describes the relationship between the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone. In addition, in order to clearly describe the technical solutions of the application, the same items or similar items with basically the same function and role are distinguished by using "first", "second" and the like. Those skilled in the art can understand that "first", "second" and the like do not limit the quantity and execution order, and "first", "second" and the like do not necessarily mean different.
[0069] In the description of the application, the reference to "one embodiment" or "some embodiments" means that the specific features, structures or characteristics described in connection with the embodiment are included in one or more embodiments of the application. Therefore, the statements "in one embodiment", "in some embodiments", "in other some embodiments", "in other some embodiments" and the like appearing in different places in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized. The terms "include", "contain", "have" and their variants mean "include but not limited to", unless otherwise specifically emphasized.
[0070] In a possible scenario, in the process in which a user uses an electronic device with a folding screen, in order to enable the electronic device to implement different functions, the folding screen is usually folded, and in this process, the electronic device performs different operations according to the change of the folding angle. For example, the electronic device is a mobile phone with a folding screen. In the case where the folding screen of the mobile phone is in a closed state, if the user wants to watch a video through a large screen, the user can perform an unfolding operation on the folding screen. In the process in which the folding screen is unfolded under the operation of the user, the mobile phone can detect the folding angle of the folding screen, and in the case where it is detected that the folding angle of the folding screen is greater than or equal to a preset first angle, the folding screen is lighted up; in the case where it is detected that the folding screen is completely unfolded, that is, in the case where it is detected that the folding angle of the folding screen is 180 degrees, the desktop of the mobile phone is displayed full screen on the folding screen; the user can trigger a video application program on the desktop of the mobile phone, so that the mobile phone plays a video through the folding screen. If the user performs a closing operation on the folding screen, in the process in which the folding screen is closed, in the case where it is detected that the folding angle of the folding screen is a preset second angle, for example, in the case where the folding angle is 90 degrees, the mobile phone enters a picture hovering mode. Therefore, it is illustrated that the picture displayed in the folding screen of the electronic device changes due to different folding angles. In the case where the display mode of the electronic device changes, the response mode of the electronic device to the touch operation acting on the folding screen also changes.
[0071] It should be noted that the folding screen is usually an inner screen of the electronic device, and the content display area of the folding screen is usually divided into a first display area and a second display area by a folding shaft in the folding process. The folding angle of the folding screen generally refers to the folding angle between the first display area and the second display area.
[0072] In order to improve the richness and diversity of the response to the touch operation, the present application provides a response method of a touch operation, which can be applied to an electronic device with a folding screen. Under the operation of the user, a touchpad simulation interface and a second application interface can be displayed in the folding screen. If the user performs a second user operation on the folding screen, the electronic device can receive capacitance data. In this case, the touch coordinate of the touch operation on the folding screen can be obtained according to the capacitance data. If the touch coordinate is located in a touchpad simulation area in the touchpad simulation interface, the electronic device can display a third application interface. In the present application, the touchpad simulation interface and the second application interface can be displayed in the folding screen. The user can control the second application interface through the touchpad simulation interface, thereby increasing the richness of the response mode of the touch operation on the basis of increasing the use function of the folding screen.
[0073] Before the method provided by the present application is described in detail, the execution subject involved in the present application is introduced.
[0074] Please refer to FIG. 1. The method can be applied to an electronic device with a folding screen. FIG. 1 is a schematic diagram of an electronic device with a folding screen according to an example embodiment. FIG. 1(a) is a schematic diagram of the electronic device in an unfolded state (folding angle is 180 degrees); FIG. 1(b) is a schematic diagram of the electronic device in a closed state (folding angle is 0 degrees); and FIG. 1(c) is a schematic diagram of the electronic device in a folding state (folding angle is between 0 degrees and 180 degrees), which is between the closed state and the unfolded state. In the example embodiment, the folding angle is 90 degrees.
[0075] As shown in FIG. 1(a), the folding screen of the electronic device is an inner screen of the electronic device, and the content display area of the folding screen is divided into a first display area 01 and a second display area 02 by a folding shaft 03, and the first display area 01 and the second display area 02 can be closed and unfolded along the folding shaft 03.
[0076] FIG. 2 is a structural schematic diagram of an electronic device according to an example embodiment. As shown in FIG. 2, the electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0077] It can be understood that the structure shown in the example embodiment does not constitute a specific limitation on the electronic device 100. In other example embodiments, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware.
[0078] The processor 110 can include one or more processing units such as: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.
[0079] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.
[0080] The memory in the processor 110 can also be configured to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or repeatedly uses. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. Avoiding repeated access, reducing the waiting time of the processor 110, thus improving the efficiency of the system.
[0081] In some embodiments, the processor 110 can include one or more interfaces, such as: can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0082] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 100. In some other embodiments of the present application, the electronic device 100 can also use different interface connection modes or a combination of multiple interface connection modes.
[0083] The wireless communication function of the electronic device 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like.
[0084] The electronic device 100 realizes the display function through the GPU, the display screen 194, and the application processor, and the like. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.
[0085] The display screen 194 is used to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diode (QLED), and the like. In some embodiments, the electronic device 100 can include one or N display screens 194, and N is an integer greater than 1.
[0086] The electronic device 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, and the like.
[0087] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to realize the expansion of the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, music, video, and the like are saved in the external memory card.
[0088] The internal memory 121 can be used to store computer executable program codes including instructions. The processor 110 performs various functional applications of the electronic device 100 and data processing by executing the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program (such as a sound play function, an image play function, etc.) required by a function, etc. The data storage area can store data (such as audio data, a phone book, etc.) created by the electronic device 100 during use, etc. In addition, the internal memory 121 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0089] The electronic device 100 can implement an audio function such as music play, recording, etc. through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc.
[0090] The pressure sensor 180A is used to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. There are many types of pressure sensors 180A, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. The capacitive pressure sensor can include at least two parallel plates with conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a pressure threshold is applied to a short message application icon, an instruction to view a short message is executed. When a touch operation with a touch operation intensity greater than or equal to the pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.
[0091] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake photography. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of shaking of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and lets the lens offset the shaking of the electronic device 100 by reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and motion sensing game scenarios.
[0092] The acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. The acceleration sensor 180E can also be used to identify the posture of the electronic device 100, and can be applied to landscape / portrait switching, pedometer applications, and the like.
[0093] The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 together form a touch screen, also referred to as a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor 180K can pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.
[0094] Next, the software system of the electronic device 100 is described.
[0095] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. The embodiments of the present application take the Android system with a layered architecture as an example to exemplarily describe the software system of the electronic device 100.
[0096] FIG. 3 is a block diagram of a software system of an electronic device 100 according to an embodiment of the present application. Referring to FIG. 3, the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the hardware abstraction layer (Hardware Abstraction Layer, HAL), and the kernel layer.
[0097] The application program layer can include a series of application packages. As shown in FIG. 3, the application packages can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, and the like.
[0098] The application framework layer provides an application programming interface (API) and a programming framework for the application programs of the application program layer. The application framework layer includes some pre-defined functions. As shown in FIG. 3, the application framework layer can include a window management module. The window management module is used to manage window programs. The window management module can acquire a display screen size, determine whether there is a status bar, lock a screen, and the like.
[0099] As an example, the window management module can receive display information sent by an application program in the application program layer, and generate touchpad state information according to the display information in a case where a folding angle of the folding screen is detected to be located in a preset angle range, the touchpad state information being used to describe a state of a touchpad simulation interface, and send the touchpad state information to the HAL layer.
[0100] As a first example, the application framework layer can further include an input event management module. In a case where the input event management module receives touch coordinates of a touch operation sent by the kernel layer, the input event management module can send the touch coordinates to a corresponding module, so that the corresponding module responds to the touch operation in a case where the corresponding module receives the touch coordinates. For example, in a case where the touch coordinates indicate that an application program responds to the touch operation, the input event management module can send the touch coordinates to the corresponding application program. In a case where the touch coordinates indicate that the window management module responds to the touch operation, the input event management module can send the touch coordinates to the window management module.
[0101] The HAL layer can include various communication interfaces, such as a first touch interface (which can also be referred to as a first communication interface) and a second touch interface (which can also be referred to as a second communication interface). The first touch interface can be a Touch Panel (TP) AIDL, and the second touch interface can be a TP HAL. The TP AIDL can receive touchpad state information sent by the window management module, and send the touchpad state information to the TP HAL. In a case where the TP HAL receives the touchpad state information, the TP HAL can send the touchpad state information to the kernel layer.
[0102] As an example, the HAL layer can further include a coordinate calculation module, such as AP TOUCH DAEMON. The coordinate calculation module can receive the capacitance value data sent by the kernel layer, and determine the touch coordinates of the touch operation according to the capacitance value data in the case of receiving the capacitance value data. Then the touch coordinates are sent to the kernel layer.
[0103] The kernel layer is a layer between hardware and software. The kernel layer at least contains display driver, camera driver, audio driver, sensor driver.
[0104] As an example, the kernel layer can further include a touch driver module, such as TP Driver. The touch driver module can receive the touchpad state information sent by the TP HAL, and parse the touchpad state information to obtain the switch state of the touchpad simulation interface (whether the touchpad simulation interface is opened or closed) and the touchpad simulation area information (including the size and position of the touchpad simulation area and the like) ; and send the parsed touchpad state information to the coordinate calculation module.
[0105] In addition, the touch driver module sends the capacitance value data sent by the touch chip in the hardware layer to the coordinate calculation module.
[0106] It should be noted that the touch chip can send the capacitance value data to the touch driver module after triggering the interrupt in the case of the user performing the touch operation on the folding screen.
[0107] As an example, the touch driver module can also receive the touch coordinates sent by the coordinate calculation module according to the capacitance value data, and the touch driver module can send the touch coordinates to the input event management module in the case of receiving the touch coordinates.
[0108] Next, the application scenario of the embodiment of the present application is introduced, and the electronic device is taken as a folding screen mobile phone as an example for description.
[0109] Please refer to FIG. 4, which is a schematic diagram of an application scenario of a response method of a touch operation according to an embodiment of the present application. In a possible scenario, a user can fold the folding screen of an electronic device with a folding screen at different angles during use of the electronic device to achieve different functions of the folding screen. As shown in (a) of FIG. 4, the user can fold the electronic device to free his hands and facilitate video watching during display of a video playing interface by a video application. In response to the folding operation of the folding screen, the electronic device displays a video recommendation interface S1 of the video application in a first display area 01 of the folding screen and a trackpad simulation interface S2 in a second display area 02 of the folding screen, as shown in (b) of FIG. 4. The trackpad simulation interface S2 includes a trackpad simulation area S20 that can simulate a real trackpad. The user controls the interface displayed in the first display area 01 by performing a touch operation in the trackpad simulation area S20. For example, the user can touch the trackpad simulation area S20. In response to the touch operation of the user in the trackpad simulation area S20, a mouse icon S3 is displayed in the video recommendation interface S1, as shown in (c) of FIG. 4. After the user touches the trackpad simulation area S20, the user can perform a sliding operation in the trackpad simulation area S20. In response to the sliding operation, the electronic device controls the mouse icon S3 to move in the video recommendation interface S1. The trajectory of the mouse icon S3 along with the sliding operation is shown in (d) of FIG. 4. When the mouse icon S3 moves to a video option S4 to be played, the user stops moving and double-taps the trackpad simulation area S20, as shown in (e) of FIG. 4. In response to the double-tapping operation of the trackpad simulation area, the electronic device displays a selected video playing interface S5 in the first display area 01, as shown in (f) of FIG. 4.
[0110] It should be noted that, as shown in (a) of FIG. 5, in addition to the trackpad simulation area S20, the trackpad simulation interface S2 can also display a plurality of operation controls, such as a trackpad folding control 21, a brightness adjustment control 22, a volume adjustment control 23, a screenshot control 24, an application search control 25, a mode switching control 26, and the like.
[0111] For example, if the user touches the trackpad folding control 21, in response to the touch operation of the trackpad folding control 21, the electronic device folds the trackpad simulation interface S2, as shown in (b) of FIG. 5. If the user touches the area of the trackpad simulation interface S2 after the trackpad simulation interface S2 is folded, the electronic device does not respond.
[0112] In some embodiments, the video playing interface S5 can be displayed in full screen when the phone is in the case of the touchpad simulation interface S2. No interface can also be displayed, or a return control can be displayed, which is used to return to display the touchpad simulation interface. The present embodiments do not make a specific limitation on this. The present embodiments are described by taking the example of displaying the video playing interface S5 in full screen in the accompanying drawings.
[0113] For example, if the user touches the brightness adjustment control 22, referring to (c) of FIG. 5, the phone reduces the display range of the touchpad simulation area S20 and displays the brightness adjustment slide bar 221 in response to the touch operation on the brightness adjustment control 22. In some embodiments, a control related to brightness can also be displayed. The present embodiments do not make a specific limitation on this.
[0114] For example, if the user touches the volume adjustment control 23, referring to (d) of FIG. 5, the phone reduces the display range of the touchpad simulation area S20 and displays the volume adjustment slide bar 231 in response to the touch operation on the volume adjustment control 23.
[0115] For example, if the user touches the screenshot control 24, referring to (e) of FIG. 5, the phone takes a screenshot of the display content of the first display area and displays the screenshot image S6 in the first display area 01 in response to the touch operation on the screenshot control 24.
[0116] For example, if the user touches the application search control 25, referring to (f) of FIG. 5, the phone displays the application search interface S7 in the second display area 02 in response to the touch operation on the application search control 25. The user can search for an application to be opened in the application search interface S7.
[0117] It should be noted that the application interface of the application program opened in the application search interface S7 is displayed in the second display area 02. In this case, the application interface in the first display area 01 and the application interface in the second display area 02 are displayed in split screen.
[0118] For example, if the user touches the mode switching control 26, referring to (g) of FIG. 5, the touchpad simulation interface S2 is no longer displayed in the second display area 02, and the touch control interface S8 is displayed in response to the touch operation on the mode switching control 26. The functions of the touch controls in the touch control interface S8 coincide with the functions of part of the controls in the application interface displayed in the first display area 01. For example, in the case of displaying the video playing interface S5 in the first display area 01, the touch controls in the touch control interface S8 include the fast forward control 81, the fast backward control 82, the next video playing control 83, the pause / play control 84, the playing progress bar 85, and the like.
[0119] In some embodiments, the touch interface S8 can also include a mode switching control 26. If the mode switching control 26 in the touch interface S8 is touched, the phone can switch from the touch interface S8 to the touchpad simulation interface S2 in the second display area 02 in response to the touch operation on the touch switching control 26.
[0120] In another application scenario, the phone can not only exit the touchpad simulation interface S2 in the above manner, but also in other manners. For example, referring to (a) in FIG. 6, the user can perform an unfolding operation on the phone. In response to the unfolding operation on the phone, the phone displays the content displayed in the first display area in full screen, i.e., displays the video playing interface S5 in full screen, when it is detected that the folding angle of the phone is greater than a third angle (e.g., the third angle can be 100 degrees, 120 degrees, etc.). The folding screen is unfolded to 180 degrees in the drawings of the embodiments of the present application.
[0121] In another application scenario, the phone can not only respond to the touch operation triggered by the user through the touchpad simulation interface S2, but also respond to the touch operation triggered by the user in the first display area 01. For example, referring to (a) in FIG. 7, when the video recommendation interface S1 is displayed in the first display area 01, the user can click the video option S4 of the target video. In response to the clicking operation on the video option S4, the phone displays the video playing interface S5 of the target video in the first display area 01, as shown in (b) in FIG. 7.
[0122] In another application scenario, referring to (a) in FIG. 8, there can be some blank areas in the second display area 02 that neither display touch controls nor belong to the touchpad simulation area. Sometimes, the user can touch the blank area, for example, by clicking the blank area. Referring to (b) in FIG. 8, the phone does not respond to the touch operation.
[0123] In another application scenario, referring to (a) in FIG. 9, the video recommendation interface S1 is displayed in the first display area 01, the touchpad simulation interface S2 is displayed in the second display area 02, and the phone has other application programs running in the background. In this case, the user can perform a screen switching operation (e.g., a diagonal right sliding operation from the bottom center of the video recommendation interface S1) in the video recommendation interface S1. In response to the screen switching operation, the phone switches the video recommendation interface S1 to an application interface S9 of a calendar application in the first display area 01, which is the interface of the calendar application running in the background.
[0124] In another application scenario, as shown in (a) of FIG. 10, the video recommendation interface S1 is displayed in the first display area 01, the touchpad simulation interface S2 is displayed in the second display area 02, and other application programs are running in the background of the mobile phone. In this case, the user can perform a screen switching operation in the video recommendation interface S1. In response to the screen switching operation, if the mobile phone does not support displaying the touchpad simulation interface S2 while displaying the application program after screen switching, the application interface of the application program after screen switching is displayed in full screen. For example, as shown in (b) of FIG. 10, in response to the screen switching operation, the mobile phone can switch the video recommendation interface to the application interface S9 of the calendar application program. However, the mobile phone does not support displaying the touchpad simulation interface S2 while displaying the calendar application program, and thus the application interface S9 of the calendar application program is displayed in full screen. Of course, the mobile phone can display the application interface S9 of the calendar application program in full screen in the manner shown in (b) of FIG. 10, or can display the application interface S9 of the calendar application program in full screen in another display manner, as shown in (c) of FIG. 10.
[0125] It should be noted that only the screen switching operation shown in FIG. 9 or FIG. 10 is taken as an example for description in the embodiments of the present application, and the screen switching operation can also be another operation manner, which is not limited in the embodiments of the present application. In addition, when the application interface of one application program is displayed in full screen in the embodiments of the present application, the full screen display manner can be the manner shown in (b) or (c) of FIG. 10, or can be another full screen display manner, which is also not limited in the embodiments of the present application.
[0126] In another application scenario, as shown in (a) of FIG. 11, the video recommendation interface S1 is displayed in the first display area 01, the touchpad simulation interface S2 is displayed in the second display area 02, and the user can operate the mobile phone to exit the video application program in the case that the mobile phone maintains the current folding mode. In response to the exit operation of the video application program, if the mobile phone supports displaying the touchpad simulation interface S2 while displaying the desktop S10, as shown in (b) of FIG. 11, the mobile phone can display the desktop S10 in the first display area 01 and display the touchpad simulation interface S2 in the second display area 02. The user can touch the application icon of the calendar application program in the desktop. If the mobile phone supports displaying the touchpad simulation interface S2 while displaying the application interface S9 of the calendar application program, as shown in (c) of FIG. 11, the mobile phone can display the application interface S9 of the calendar application program in the first display area 01 and display the touchpad simulation interface S2 in the second display area 02. If the mobile phone does not support displaying the touchpad simulation interface S2 while displaying the application interface S9 of the calendar application program, as shown in (d) of FIG. 11, the mobile phone can cancel the display of the touchpad simulation interface S2 and display the application interface S9 of the calendar application program in full screen.
[0127] It should be noted that the exit operation of the video application can be triggered in the video recommendation interface S1, or triggered through the touchpad simulation area, and the present embodiment does not make a specific limitation.
[0128] In another application scenario, referring to (a) of FIG. 12, the video recommendation interface S1 is displayed in the first display area 01, and the touchpad simulation interface S2 is displayed in the second display area 02, and in the case that the current folding mode of the mobile phone is maintained, the user can operate the mobile phone to exit the video application. In response to the exit operation of the video application, if the mobile phone does not support displaying the touchpad simulation interface S2 in the case that the desktop S10 is displayed, referring to (b) of FIG. 12, the mobile phone cancels the display of the touchpad simulation interface S2, and displays the desktop S10 of the mobile phone in full screen. The user can touch the application icon of the calendar application in the desktop S10, and if the mobile phone supports displaying the touchpad simulation interface S2 in the case that the application interface of the calendar application is displayed, referring to (c) of FIG. 12, the mobile phone can display the application interface S9 of the calendar application in the first display area 01, and display the touchpad simulation interface S2 in the second display area 02. If the mobile phone does not support displaying the touchpad simulation interface S2 in the case that the application interface of the calendar application is displayed, referring to (d) of FIG. 12, the mobile phone can display the application interface S9 of the calendar application in full screen.
[0129] In another application scenario, referring to (a) of FIG. 13, the video recommendation interface S1 is displayed in the first display area 01, and the touchpad simulation interface S2 is displayed in the second display area 02, and in the case that the current folding mode of the mobile phone is maintained, the user can change the placement direction of the electronic device, for example, exchange the directions of the first body (the body corresponding to the first display area) and the second body (the body corresponding to the second display area 02) of the electronic device. In this way, the gravity sensor in the mobile phone detects that the direction of the body changes, and in this case, referring to (b) of FIG. 13, the display content of the first display area 01 and the display content of the second display area 02 are exchanged.
[0130] It should be noted that only the above application scenarios shown in FIGS. 4-13 are taken as examples for description in the present embodiment, and the present embodiment is not limited thereto.
[0131] Based on the execution subject provided in the above embodiment, the response method of the touch operation provided in the present embodiment will be introduced next. Please refer to FIG. 14, which is a flow diagram of a touch operation response method according to an example, which is taken as an example and not as a limitation, and the method is taken as an example of the interaction of the modules in FIG. 3 for description, and the method can include the following parts or all of the content:
[0132] Step 1401: The window management module determines the folding angle of the electronic device in the case of listening to the change of the posture of the electronic device.
[0133] In the process of using the electronic device with the folding screen, the user may change the form of the electronic device in order to realize various functions of the electronic device. For example, in the case that the folding screen of the electronic device is in an unfolded state, such as the hinge angle (or folding screen folding angle) of the electronic device is 180 degrees, the user can perform a folding operation on the electronic device. Alternatively, in the case that the folding screen of the electronic device is in a closed state, such as the hinge angle of the electronic device is 0 degrees, the user can perform an unfolding operation on the electronic device. In the case that the user changes the form of the electronic device, the window management module can listen to the change of the form of the electronic device, and determine the folding angle of the electronic device in the case of listening to the change of the form of the electronic device.
[0134] It should be noted that the folding operation of the electronic device involved in the embodiments of the present application can be an inner folding operation, and does not exclude the implementation of the technical solutions of the embodiments of the present application through an outer folding operation.
[0135] In some embodiments, the window management module can determine the folding angle of the electronic device in various ways, such as obtaining acceleration data collected by an acceleration sensor and angular velocity data collected by a gyroscope sensor, and determining the folding angle of the electronic device according to the acceleration data and the angular velocity data. Alternatively, at least two Hall sensors are arranged in the first display area and / or the second display area of the electronic device, and at least one magnetic field generating device is installed in the electronic device, each magnetic field generating device in the at least one magnetic field generating device is not in the same display area as the corresponding Hall sensor, and the window management module can sense the magnetic field intensity of the corresponding magnetic field generating device through each Hall sensor; and determine the folding angle of the electronic device according to the magnetic field intensity sensed by each Hall sensor.
[0136] Step 1402: In the case that the folding angle is in a preset angle range, the window management module controls the folding screen to display the touchpad simulation interface and the application interface of the target application program in split screen mode according to the display information.
[0137] Since the electronic device can realize different functions in different folding angles, after determining the folding angle, the window management module can determine the angle range in which the folding angle is located. In the case that the folding angle is in a preset angle range, the window management module can control the folding screen to display the touchpad simulation interface and the application interface of the target application program in split screen mode according to the display information.
[0138] As an example, the preset angle range can be set in advance according to requirements, for example, the preset angle range can be 70-100 degrees, 75-100 degrees, 80-95 degrees, etc., and the embodiments of the present application do not make specific limitations thereto.
[0139] It should be noted that the display information includes information indicating the interface displayed in the folding screen of the electronic device, and the display information is obtained by the window management module from an application program to which the application interface currently displayed by the electronic device belongs. The application interface is an application interface displayed by the electronic device before being folded to the folding angle. The application interface can be a desktop, any application interface of any application program, an application background interface, etc. That is, if the application interface of the target application program is currently displayed, the display information is sent by the target application program to the window management module.
[0140] Exemplarily, before the folding screen of the electronic device is folded, a video recommendation interface is displayed in the folding screen, and then the window management module can receive display information sent by the video application program, the display information being used to indicate that the currently displayed interface is a video recommendation interface; in the case where the folding angle is within the preset angle range, the window management module controls the folding screen to display the touchpad simulation interface and the video recommendation application interface in split screen mode. This scenario can be referred to the application scenario shown in FIG. 4. Before the folding screen of the electronic device is folded, a desktop is displayed in the folding screen of the electronic device, and then the window management module can receive display information sent by the desktop application, the display information being used to indicate that the currently displayed interface is a desktop; in the case where the folding angle is within the preset angle range, the window management module controls the folding screen to display the touchpad simulation interface and the desktop in split screen mode.
[0141] In some embodiments, the window management module, in the case where the display information is received, can further determine whether the target application program is located in a preset white list; in the case where the target application program is located in the preset white list and the folding angle of the folding screen is within the preset angle range, the window management module controls the folding screen to display the touchpad simulation interface and the application interface of the target application program in split screen mode. In the case where the target application program is not located in the preset white list and the folding angle of the folding screen is within the preset angle range, the folding screen still displays the application interface of the target application program in full screen mode.
[0142] It should be noted that the preset white list is a preset white list, and the application programs in the preset white list support the picture hovering function and support the display of the touchpad simulation interface.
[0143] Step 1403: The window management module sends the touchpad state information to the first touch interface.
[0144] It should be noted that the touchpad state information is used to indicate the on-off state of the touchpad simulation interface and the area information (which can also be referred to as touchpad virtual area information) of the touchpad virtual area in the touchpad virtual interface, and the area information includes the position and size of the touchpad virtual area in the touchpad virtual interface.
[0145] Since the touchpad simulation interface can include other areas in addition to the touchpad virtual area, in this case, the touchpad state information can not only indicate the on-off state of the touchpad simulation interface and the area information of the touchpad virtual area, but also indicate the information of other areas in the touchpad simulation interface.
[0146] As an example, the first touch control interface can be the TP AIDL interface shown in FIG. 3, or can be another interface, and the embodiments of the present application do not make specific limitations thereto.
[0147] Step 1404: If the touchpad state information is different from the touchpad state information sent to the second touch control interface last time, the first touch control interface sends the touchpad state information to the second touch control interface.
[0148] It should be noted that the second touch control interface can be the TP HAL interface shown in FIG. 3, or can be another interface, and the embodiments of the present application do not make specific limitations thereto.
[0149] Since the window management module will keep sending touchpad state information to the underlying layer while maintaining the same form, the modules in the underlying layer can repeatedly execute the same operation, which can increase the power consumption of the electronic device. The underlying layer refers to the layer below the layer where the window management module is located in the software architecture of the electronic device, such as the HAL layer, the kernel layer, etc. Therefore, in order to avoid repeatedly executing the same instructions and to reduce the power consumption of the electronic device, the first touch control interface can filter out the repeated touchpad state information when receiving the touchpad state information, and send the touchpad state information to the second touch control interface when the touchpad state information is different from the touchpad state information sent to the second touch control interface last time.
[0150] In some embodiments, the first touch control interface filtering the repeated touchpad state information means that the first touch control interface discards the repeated touchpad state information.
[0151] It should be noted that after the first touch control interface discards the repeated touchpad state information, it no longer performs the operations of the following steps 1405-1408.
[0152] In some embodiments, the first touch control interface can compare the currently received touchpad state information with the touchpad state information sent to the second touch control interface last time, discard the currently received touchpad state information in a case where the currently received touchpad state information is the same as the touchpad state information sent to the second touch control interface last time, and send the currently received touchpad state information to the second touch control interface in a case where the currently received touchpad state information is different from the touchpad state information sent to the second touch control interface last time.
[0153] It should be noted that the case where the currently received touchpad state information is the same as the touchpad state information sent to the second touch control interface last time includes the case where both the touchpad simulation functions are turned on (i.e., the folding screen displays the touchpad simulation interface), and the touchpad simulation region size is the same, the touchpad simulation region position is the same, etc. The case where the currently received touchpad state information is different from the touchpad state information sent to the second touch control interface last time includes the case where the touchpad simulation function last time is not turned on, the touchpad simulation function currently is turned on, or the touchpad simulation function last time is turned on, the touchpad simulation function currently is not turned on, or both the touchpad simulation functions are turned on, and the touchpad simulation region size or position last time is different from the touchpad simulation region size or position currently, etc. In the embodiments of the present application, the case where the touchpad simulation function last time is not turned on and the touchpad simulation function currently is turned on is taken as an example for description.
[0154] Step 1405: The second touch control interface sends the touchpad state information to the touch driving module.
[0155] Step 1406: The touch driving module, in a case where the touchpad state information is received, analyzes the touchpad state information to obtain touchpad simulation region information.
[0156] Since the touchpad state information received by the touch driving module this time is different from the touchpad state information received last time, it is indicated that the state of the touchpad simulation interface can have changed, and therefore, in order to accurately respond to the touch operation, the touch driving module can analyze the touchpad state information to obtain the touchpad simulation region information.
[0157] It should be noted that the touchpad simulation region information includes the touchpad simulation region size, position, etc.
[0158] In some embodiments, since the touchpad state information can also include the region information of other regions of the touchpad simulation interface, in this case, after the touch driving module analyzes the touchpad state information, the region information of the other regions can also be obtained.
[0159] Step 1407: The touch driving module sends the touchpad simulation region information to the coordinate calculation module.
[0160] In the case that the area information of other areas is also obtained, the area information of other areas can also be sent to the coordinate calculation module.
[0161] Step 1408: The coordinate calculation module stores the touchpad simulation area information in the case that the touchpad simulation area information is received.
[0162] It should be noted that the coordinate calculation module can also store the area information of other areas if the area information of other areas is also received.
[0163] In the case that the touchpad simulation interface is displayed, the user can perform a touch operation in the touchpad simulation interface to control the interface of the target application. Of course, in the case that the touchpad simulation interface is displayed, the user can perform a touch operation in the touchpad simulation area of the touchpad simulation interface, or can perform a touch operation in other areas of the foldable screen. According to the different touch operation positions, the ways of responding to the touch operation are also different. Next, taking the case that the user performs a touch operation on the electronic device in the case that the touchpad simulation interface is displayed as an example, the method is described. Please refer to FIG. 15, which includes the following steps:
[0164] Step 1501: The touch chip reports the capacitance value data to the touch driving module in the case that an interrupt is triggered.
[0165] Since the user can perform a touch operation on the foldable screen in the process of using the electronic device. In the case that the user touches the foldable screen, the touch chip can trigger an interrupt. In the case that the touch chip triggers an interrupt, the touch chip can report the capacitance value data to the touch driving module.
[0166] As an example, in the case that the user performs a touch operation on the foldable screen, the touch chip can detect that the capacitance value at the user touch position on the foldable screen changes. In the case that the change of the capacitance value exceeds the capacitance threshold value, the touch chip can trigger an interrupt. The capacitance threshold value can be set in advance according to requirements.
[0167] It should be noted that the folding screen can be divided into a first display area and a second display area by the folding shaft. In a case where the folding angle of the folding screen is within a preset angle range, the application interface of the target application program can be displayed in the first display area, and the touchpad simulation interface can be displayed in the second display area. Alternatively, the application interface of the target application program can be displayed in the second display area, and the touchpad simulation interface can be displayed in the first display area. In this embodiment of the present application, the application interface of the target application program is displayed in the first display area, and the touchpad simulation interface is displayed in the second display area. In a case where the touchpad simulation interface is displayed in the second display area, the entire area of the second display area can be a touchpad simulation area, that is, the entire touchpad simulation interface is a touchpad simulation area. Alternatively, part of the touchpad simulation interface is a touchpad simulation area, and part of the touchpad simulation interface is a blank area (the blank area is an area that cannot respond to touch operations). For example, the touchpad simulation interface can refer to the touchpad simulation interface S2 shown in (b) of FIG. 4.
[0168] As an example, in a case where a user performs a touch operation on the folding screen, the touch operation can act on the touchpad simulation area, can act on any operation control in the touchpad simulation interface, can act on the blank area in the touchpad simulation interface, or can act on the application interface displayed in split screen with the touchpad simulation interface. That is, the touch operation can be an operation on any position on the folding screen. In addition, the touch operation can be various types of operations, such as a sliding operation, a clicking operation, a long-pressing operation, and the like.
[0169] It should be noted that the capacitance data includes a capacitance array of the folding screen, and the capacitance array is composed of a capacitance value at each node in the plurality of nodes of the folding screen. Each node is a position in the folding screen that can cause a change in the capacitance value.
[0170] Step 1502: The touch driving module sends the capacitance data to the coordinate calculation module.
[0171] In order to determine the touch position of the touch operation, the touch driving module can forward the capacitance data to the coordinate calculation module.
[0172] Step 1503: The coordinate calculation module determines the touch coordinates of the position acted on by the touch operation according to the capacitance data.
[0173] Since the capacitance data includes a capacitance array, generally, the capacitance value at each position in the capacitance array is fixed, thus, the coordinate calculation module can determine the position in the capacitance array where the capacitance value changes according to the capacitance data, and determine the touch coordinate of the position where the touch operation acts according to the position where the capacitance value changes.
[0174] Step 1504: The coordinate calculation module sends the touch coordinate to the input event management module through the touch driving module.
[0175] As an example, in order to enable the input event management module to accurately determine the object responding to the touch operation, the coordinate calculation module can not only send the touch coordinate to the input event management module, but also send information related to the touchpad simulation interface, such as touchpad simulation region information, region information of other regions (including position information of each touch control, region information of the target region, etc.), to the input event management module.
[0176] It should be noted that the coordinate calculation module can send the information related to the touchpad simulation interface to the input event management module at the same time when sending the touch coordinate to the input event management module, or send the information related to the touchpad simulation interface to the input event management module after step 1408, that is, the application embodiment does not make specific limitation on the timing of the coordinate calculation module sending the information related to the touchpad simulation interface to the input event management module.
[0177] In some embodiments, since the window management module and the input event management module are in the same software architecture layer, that is, the window management module and the input event management module are in the application program framework layer, the input event management module can also obtain the information related to the touchpad simulation interface from the window management module, and the application embodiment does not make specific limitation on this.
[0178] Step 1505: The input event management module determines the object responding to the touch operation according to the touch coordinate after receiving the touch coordinate.
[0179] As known from the above, the touch operation can act on the touchpad simulation region, can act on any operation control in the touchpad simulation interface, or can act on the application interface displayed in split screen with the touchpad simulation interface, and the object responding to the touch operation is different according to the position where the touch operation acts. Therefore, the input event management module needs to determine the object responding to the touch operation according to the touch coordinate.
[0180] As an example, the input event management module can determine that the touch operation is invalid in a case where the coordinate range in which the touch coordinates are located is a blank region coordinate range, and thus the input event management module can discard the touch coordinates. The input event management module can determine that the object responding to the touch operation is the window management module in a case where the coordinate range in which the touch coordinates are located is a coordinate range of a position of any one touch control in the touchpad simulation interface. The input event management module can determine that the object responding to the touch operation is the target application in a case where the coordinate range in which the touch coordinates are located is a coordinate range of a position of an application interface of the target application or a coordinate range of a position of the touchpad simulation region.
[0181] Step 1506: In a case where the object responding to the touch operation is the target application, the input event management module sends the touch coordinates to the target application.
[0182] Step 1507: In a case where the target application receives the touch coordinates, the target application responds to the touch operation according to the touch coordinates.
[0183] As an example, the target application is a video application, and the video recommendation interface and the touchpad simulation interface are displayed in a split screen in the folding screen. In a case where the touch operation of the user acts on the touchpad simulation region, the target application can display a mouse icon in the video recommendation interface in response to the touch operation. In this case, if the user continues to perform the touch operation in the touchpad simulation interface, the operations of steps 1501-1507 are repeatedly performed, and in the operation of step 1507, if the touch operation is a sliding operation, the target application can control the mouse icon to move in the video recommendation interface in response to the sliding operation. This scenario can be referred to the application scenarios shown in (b) and (c) of FIG. 4. If the touch operation is a click operation at the same position, the target application responds to the click operation, and if the mouse icon is located at a first operation control, the target application performs a function corresponding to the first operation control. For example, if the first operation control is a video option of a target video, the target application switches the video recommendation interface to a video playing interface in response to the click operation, and the video playing interface is an interface for playing the target video. This scenario can be referred to the application scenarios shown in (e) and (f) of FIG. 4.
[0184] As an example, the video recommendation interface and the touchpad simulation interface are displayed in a split screen in the folding screen, and in a case where the touch operation of the user acts on the video recommendation interface, the target application responds to the touch operation to implement a function of a second operation control in a case where the touch operation acts on the second operation control. For example, the second operation control can be a video option of a target video, and this scenario can be referred to the application scenario shown in FIG. 7.
[0185] As described above, the touch operation can not only be an operation of switching the application interface of the target application program, but also an operation of switching the application interface between different application programs. For example, when the touch operation is an operation of exiting the target application program or a screen switching operation, the application interface of the target application program can be switched to the application interface of another application program. The other application program can support the hovering function or can not support the hovering function. In the case where the other application program does not support the hovering function, the window management module can close the touchpad simulation interface after receiving the display information sent by the target application program. Alternatively, the other application program supports the hovering function but does not support displaying the touchpad simulation interface. In this case, the window management module can close the touchpad simulation interface after obtaining the display information sent by the target application program. For example, the scenario can refer to the application scenarios shown in (c) of FIG. 10, (b) of FIG. 11 or (b) of FIG. 12. In the case where the other application program supports the hovering function and supports displaying the touchpad simulation interface, the touchpad simulation interface and the application interface of the other application program can be displayed in the folding screen. For example, the scenario can refer to the application scenarios shown in (a) of FIG. 9, (b) of FIG. 11 or (c) of FIG. 12.
[0186] Step 1508: In the case where the object responding to the touch operation is the window management module, the event management module sends the touch coordinates to the window management module.
[0187] Step 1509: In the case where the window management module receives the touch coordinates, the window management module responds to the touch operation according to the touch coordinates.
[0188] As described above, in the case where the window management module responds to the touch coordinates, the display of the touchpad simulation interface can be updated or can not be updated. In the case where the window management module updates the display of the touchpad simulation interface, the window management module can update the touchpad state information.
[0189] After the window management module updates the touchpad state information, the underlying module of the electronic device also needs to perform related operations. Referring to FIG. 16, the method includes the following steps:
[0190] Step 1601: The target application program sends display information to the window management module.
[0191] Step 1602: In the case where the window management module receives the display information, the window management module updates the touchpad state information.
[0192] Step 1603: The window management module sends the updated touchpad state information to the first touch interface.
[0193] Step 1604: The first touch interface sends the touchpad state information to the second touch interface if the updated touchpad state information is different from the touchpad state information sent to the second touch interface last time.
[0194] It should be noted that if the updated touchpad state information is the same as the touchpad state information sent to the second touch interface last time, the updated touchpad state information is discarded, and the following steps 1605-1608 are not performed.
[0195] Step 1605: The second touch interface sends the updated touchpad state information to the touch driving module.
[0196] Step 1606: The touch driving module analyzes the updated touchpad state information to obtain updated touchpad analog area information if the updated touchpad state information is received.
[0197] Step 1607: The touch driving module sends the updated touchpad analog area information to the coordinate calculation module.
[0198] Step 1608: The coordinate calculation module stores the updated touchpad analog area information if the updated touchpad analog area information is received.
[0199] It should be noted that the coordinate calculation module can replace the touchpad analog area information stored last time with the updated touchpad analog area.
[0200] In the embodiment of the present application, in the case of displaying the touchpad analog interface and the application interface of the target application in the folding screen, since the touchpad analog interface has an area that can simulate a real touchpad, the user can control the application interface through the touchpad analog interface, thereby increasing the richness of the touch operation response mode on the basis of increasing the use function of the folding screen.
[0201] It should be noted that the above is an example of displaying information by the electronic device through the interaction of the plurality of modules shown in FIG. 3. Next, in order to further understand the embodiment of the present application, the method is taken as an example to be executed by the electronic device with a folding screen, please refer to FIG. 17, which is a flowchart of a touch operation response method according to another example embodiment. As an example but not limited to, the method can include the following part or all of the contents:
[0202] Step 1701: The folding screen displays a first application interface.
[0203] Step 1702: in response to the first user operation, the folding screen displays the second application interface and the touchpad simulation interface.
[0204] It should be noted that the touchpad simulation interface includes a touchpad simulation area for simulating a touchpad and / or at least one touch control.
[0205] In one possible case, the first application interface and the second application interface can be interfaces of the same application interface displayed by the electronic device in different ways. For example, the first application interface can be an application interface A displayed in full screen on the folding screen, and the first application interface occupies the first display area and the second display area; the second application interface is the application interface A displayed in split screen, and the second application interface is displayed in the first display area or the second display area of the folding screen. Alternatively, the first application interface is the application interface A displayed in full screen on the folding screen, and the second application interface is the application interface A displayed in a floating window.
[0206] In another possible case, the first application interface and the second application interface are application interfaces of two different application programs, for example, the first application interface is a desktop, and the second application interface is a video recommendation interface of a video application program.
[0207] In yet another possible case, the first application interface and the second application interface can be different application interfaces of the same application program, for example, the first application interface can be a video recommendation interface of a video application program, and the second application interface can be a video playback interface of the video application program.
[0208] Since the folding screen displays the first application interface, the user can perform some operations on the electronic device, so that the content displayed on the folding screen of the electronic device changes. For example, the user performs a first user operation on the electronic device, and the electronic device displays a second application interface and a touchpad simulation interface in the folding screen in response to the first user operation.
[0209] It should be noted that the second application interface and the touchpad simulation interface can be displayed in split screen in the folding screen; alternatively, the second application interface is displayed in full screen in the folding screen, and the touchpad simulation interface is displayed in a floating window, and the floating window is displayed on the second application interface; or the touchpad simulation interface is displayed in full screen in the folding screen, and the second application interface is displayed in a floating window, and the floating window is displayed in the touchpad simulation interface. The display mode of the folding screen for displaying the second application interface and the touchpad simulation interface in the embodiments of the present application is only an example, and the display mode of the second application interface and the touchpad simulation interface is not limited.
[0210] In a possible implementation, the first user operation can be a folding operation on the folding screen; in this way, the electronic device can monitor the folding angle of the folding screen in response to the folding operation; in response to monitoring that the folding angle of the folding screen is within a preset angle range, the display information of the folding screen is acquired; and in response to the display information indicating that the second application interface is displayed in the folding screen, the touchpad simulation interface and the second application interface are displayed in the folding screen in a split-screen mode.
[0211] In the process of using the electronic device with the folding screen, the user can change the form of the electronic device in order to realize multiple functions of the electronic device. For example, when the electronic device is playing a video in full screen, the user can fold the electronic device into a notebook form in order to facilitate the support of the electronic device. Because the electronic device can realize different functions in different folding angles, the electronic device can determine the angle range of the folding angle when the user folds the electronic device. In the case where the folding angle is within the preset angle range, the display information of the folding screen is acquired.
[0212] It should be noted that the display information includes information indicating the interface displayed in the folding screen of the electronic device.
[0213] As an example, the electronic device can monitor the folding angle of the folding screen through the window management module, which can refer to the operation of step 1401 described above, and the embodiments of the present application will not be repeated here.
[0214] In some embodiments, the window management module can acquire the display information from the target application program when it is monitored that the folding angle is within the preset angle range. Of course, in some possibilities, the window management module can also acquire the display information in real time, that is, the target application program can send the display information to the window management module in real time, so that the touchpad simulation interface and the second application interface can be directly displayed in the folding screen in a split-screen mode when the electronic device monitors that the folding angle is within the preset angle range.
[0215] It should be noted that the second application interface can be an application interface of the target application program, and the target application program can be any one of the application programs installed in the electronic device, such as a desktop application program, a payment application program, a video application program, a shopping application program, a social application program, etc.
[0216] As an example, the target application program can also be any one of the application programs in the preset white list. The preset white list is a pre-set white list, and the application programs in the preset white list support the picture hovering function and support the display of the touchpad simulation interface.
[0217] It should be noted that by setting the preset whitelist, the display of the trackpad simulation interface is more targeted.
[0218] In some embodiments, the electronic device can display the trackpad simulation interface and the application interface of the target application in a split screen in the folding screen through the window management module. That is, when the display information indicates that the application interface of the target application is displayed in the folding screen, the window management module can determine whether the target application is located in the preset whitelist; in the case that the target application is located in the preset whitelist, the window management module controls the folding screen to display the trackpad simulation interface and the application interface of the target application in a split screen. In the case that the target application is not located in the preset whitelist, the application interface of the target application is still displayed in full screen in the folding screen.
[0219] In some embodiments, after the electronic device displays the trackpad simulation interface and the application interface of the target application in a split screen in the folding screen, the electronic device can also store the size and position of the trackpad simulation area and other information, that is, the electronic device can store the trackpad simulation area information.
[0220] Exemplarily, the electronic device can store the trackpad simulation area information through the operations of steps 1403-1408 described above, and the embodiments of the present application will not be repeated here.
[0221] It should be noted that when the folding angle of the folding screen is within the preset angle range, the electronic device can display the second application interface and the trackpad simulation interface in a split screen, and of course, the second application interface and the trackpad simulation interface can also be displayed in other ways, which are not limited in the embodiments of the present application.
[0222] In another possible implementation, the first user operation can be a trigger operation on a trackpad control; in this way, the electronic device displays the second application interface and the trackpad simulation interface in a split screen in the folding screen in response to the trigger operation on the trackpad control. The trackpad control is a control in the folding screen for displaying the trackpad simulation interface.
[0223] Exemplarily, the electronic device displays the second application interface and the trackpad simulation interface in a split screen in the folding screen in response to the trigger operation on the trackpad control.
[0224] In some embodiments, the electronic device can respond to the trigger operation on the trackpad control through the window management module.
[0225] In some embodiments, in response to the triggering operation of the trackpad control, the second application interface and the trackpad simulation interface can not only be displayed in a split screen in the folding screen, but also can be displayed in other manners. For example, the folding screen displays the second application interface in full screen, and displays a floating window in the second application interface, and the trackpad simulation interface is displayed in the floating window. Alternatively, the folding screen displays the trackpad simulation interface in full screen, and displays a floating window in the trackpad simulation interface, and the trackpad simulation interface is displayed in the floating window. Alternatively, the first application interface and the second application interface are application interfaces of different applications. Thus, the folding screen displays the second application interface and the first application interface in a split screen, and a floating window is displayed on the first application interface or the second application interface, and the trackpad simulation interface is displayed in the floating window. The embodiments of the present application do not make specific limitations in this regard.
[0226] It should be noted that when the trackpad control is triggered to display the trackpad simulation interface, the folding screen can be in a full-screen unfolded state, thereby improving the richness of the display scenario of the trackpad simulation interface.
[0227] It should be noted that the display of the trackpad simulation interface is triggered in different manners, thereby improving the richness of the interaction and enriching the use scenarios of the display of the trackpad simulation interface.
[0228] Step 1703: In response to the second user operation, the electronic device receives the capacitance value data.
[0229] It should be noted that the capacitance value data is generated when the user performs a second user operation on the folding screen. The capacitance value data includes a capacitance value array of the folding screen, which is composed of the capacitance values at each node of the plurality of nodes of the folding screen, and each node is a position in the folding screen that can generate a change in the capacitance value. The second user operation can be a touch operation on the folding screen, such as a click operation, a sliding operation, a long press operation, etc.
[0230] Since the user may perform a second user operation on the folding screen during use of the electronic device, in this case, the electronic device can detect a change in the capacitance value data at the position of the second user operation on the folding screen, i.e., the electronic device can obtain the capacitance value data at the position of the second user operation.
[0231] As described above, the electronic device can include a touch driving module, a touch chip, and a coordinate calculation module. Based on this, in response to the second user operation, the operation of receiving the capacitance value data by the electronic device includes: in response to the second user operation, the touch chip triggers an interrupt and sends the capacitance value data to the touch driving module; and the touch driving module receives the capacitance value data.
[0232] Since the touch driving module is located in the kernel layer of the electronic device, the electronic device can receive the capacitance data through the kernel layer.
[0233] Step 1704: In response to receiving the capacitance data, obtaining, according to the capacitance data, a touch coordinate of the second user operation on the fold.
[0234] Since the electronic device responds to the second user operation according to the touch position, the electronic device needs to obtain the touch coordinate of the second user operation on the fold screen according to the capacitance data.
[0235] In some embodiments, in response to receiving the capacitance data, the touch driving module sends the capacitance data to the coordinate calculation module; the coordinate calculation module determines the touch coordinate according to the capacitance data; the coordinate calculation module sends the touch coordinate to the touch driving module; and the touch driving module receives the touch coordinate.
[0236] As an example, since the capacitance data includes a capacitance array, generally, the capacitance value at each position in the capacitance array is fixed, therefore, the coordinate calculation module can determine the position in the capacitance array where the capacitance value changes according to the capacitance data, and determine the touch coordinate of the position acted on by the second user operation according to the position where the capacitance value changes.
[0237] Step 1705: In response to the touch coordinate being located in the touchpad simulation area, displaying a third application interface.
[0238] Since the touchpad simulation area is used to simulate a touchpad, the user performs the second user operation in the touchpad simulation area to manipulate the second application interface.
[0239] It should be noted that, in the case where the touch coordinate is located in the touchpad simulation area, the second user operation can be a click operation, a long press operation, a sliding operation, etc. acting on the touchpad simulation area.
[0240] As an example, the third application interface can be the same as the second application interface, or can be different from the second application interface.
[0241] Illustratively, in the case where the touch coordinate is located in the touchpad simulation area, if the mouse icon is not displayed in the second application interface, in response to the second user operation, the mouse icon is displayed in the second application interface, and in this case, the third application interface is the second application interface with the mouse icon displayed.
[0242] Exemplarily, if a mouse icon is displayed in the second application interface, the electronic device moves the mouse icon in the second application interface according to the operation track of the second user operation in response to the second user operation, i.e., the operation type of the mouse icon is the same as the operation type of the second user operation. In the case where the second user operation is a click operation, the mouse icon performs a click operation at the current position, and if the position of the mouse icon is the position of an operation control in the second application interface, the electronic device displays a third application interface (the third application interface is different from the second application interface) in response to the second user operation; if there is no operation control that can be responded to at the position of the mouse icon, the third application interface (the third application interface is the same as the second application interface) is displayed. In the case where the second user operation is a sliding operation, the mouse icon performs a sliding operation, and the sliding direction of the mouse icon is the same as the sliding direction of the second user operation, and the ratio between the sliding distance of the mouse icon and the sliding distance of the second user operation is a preset ratio. In the case where the second user operation is a long-press operation, the mouse icon performs a long-press operation at the current position. In this case, the third application interface is the second application interface in which the position of the mouse icon is moved.
[0243] In order to prompt the position in the second application interface that can be acted on by the second user operation, the mouse icon can be displayed in the second application interface in the case where the user performs the second user operation in the touchpad simulation area, regardless of the operation of the second user operation, i.e., regardless of which one of the click operation, the sliding operation, and the long-press operation is the touch operation.
[0244] Since the second user operation performed by the user in the touchpad simulation area this time can be the first touch operation performed by the electronic device after the touchpad simulation interface is displayed this time, or the second user operation performed by the user in the touchpad simulation area this time is discontinuous with the last touch operation performed in the touchpad simulation area, i.e., the user's finger is away from the touchpad simulation area for a long time after the last touch operation is performed in the touchpad simulation area, and then the touch operation this time is performed in the touchpad simulation area, in the case where the touch coordinates of the second user operation performed this time are located in the touchpad simulation area, the electronic device displays the mouse icon in the second application interface in response to the second user operation. Then, if the user continues to perform the second user operation in the touchpad simulation area, the moving track of the mouse icon in the second application interface is the same as the operation track of the user in the touchpad simulation area.
[0245] It should be noted that the case that the user continuously performs the second user operation in the touchpad simulation area refers to that the user's finger does not leave the touchpad simulation area after the user performs touch in the touchpad simulation area, for example, the user performs a sliding operation, a long press operation, etc. in the touchpad simulation area; or the user's finger leaves the touchpad simulation area for a short time after the user performs touch in the touchpad simulation area, and then the user performs touch in the touchpad simulation area again, that is, the time interval between two adjacent touch operations in the touchpad simulation area is less than a preset time interval, which can be 100 ms, 200 ms, etc.
[0246] As an example, the electronic device fails to receive the touch operation of the user in the touchpad simulation area again within a preset time interval after the electronic device displays the mouse icon in the second application interface, and the electronic device can cancel the display of the mouse icon.
[0247] As an example, in the case that the mouse icon is not displayed in the second application interface, the electronic device can display the mouse icon at a central position of the second application interface, or at any position in the display range of the second application interface, or at a position where the mouse icon disappeared last time in the second application interface. The embodiments of the present application do not make specific limitations in this regard.
[0248] As described above, the electronic device includes a touch driving module and an event dispatching module; in this way, the touch driving module can send the touch coordinates to the event dispatching module; the event dispatching module determines the area of the touch coordinates in the folding screen in response to receiving the touch coordinates; in response to the touch coordinates being located in the touchpad simulation area, the event dispatching module can send the touch coordinates to the target application program; and the target application program responds to the touch operation in response to receiving the touch coordinates.
[0249] It should be noted that the area of the touch coordinates in the folding screen is determined by the event dispatching module, so that the touch coordinates are accurately dispatched, and the accuracy of responding to the touch operation is improved.
[0250] In some embodiments, the touchpad simulation interface can not only include the touchpad simulation area, but also include a target area, which is an area in the touchpad simulation interface that cannot respond to the second user operation. Since the touchpad simulation interface can include the target area, the user can perform the second user operation in the target area, and since the target area is an area that cannot respond to the second user operation, the electronic device can discard the touch coordinates in the case that the touch coordinates are located in the target area.
[0251] It should be noted that by discarding the touch coordinates that cannot be responded to, the error in responding to the touch operation is avoided.
[0252] Step 1706: in response to the touch coordinates being located in the position range of any one of the at least one touch control, updating the touchpad simulation interface.
[0253] In some embodiments, the touchpad simulation interface can further include at least one touch control in addition to the touchpad simulation area and the target area, and the user can perform a second user operation on any one of the at least one touch control. In this case, the touch coordinates are located in the position range of the touch control touched by the user, and the electronic device can respond to the second user operation in the touchpad simulation interface.
[0254] Since the at least one touch control is displayed in the touchpad simulation interface, the at least one touch control is not set for a specific application, but is set for the touchpad simulation interface. Each touch control corresponds to a function related to the system function of the electronic device, and therefore the electronic device can respond to the second user operation in the touchpad simulation interface.
[0255] As an example, in the case where the touch coordinates are located in the position range of the touch control touched by the user, the electronic device can update the touchpad simulation interface according to the function of the touch control.
[0256] It should be noted that the at least one touch control can include: a touchpad retracting control, a brightness adjusting control, a volume adjusting control, a screenshot control, an application searching control, a mode switching control, and the like. In a case where the touchpad retracting control is triggered, the electronic device can cancel the display of the touchpad simulation area; in a case where the brightness adjusting control is triggered, the electronic device can display a brightness adjusting interface, such as the brightness adjusting slide bar shown in (c) of FIG. 5, and the user can adjust the display brightness of the foldable screen through the brightness adjusting interface, and the electronic device can reduce the display range of the touchpad simulation area in a case where the brightness adjusting interface is displayed; in a case where the volume adjusting control is triggered, the electronic device can display a volume adjusting interface, such as the volume adjusting slide bar shown in (d) of FIG. 5, and the electronic device can reduce the display range of the touchpad simulation area in a case where the volume adjusting slide bar is displayed to adjust the volume (usually referring to the media volume, such as the audio / video playing volume); in a case where the screenshot control is triggered, the electronic device can take a screenshot of the displayed application interface; in a case where the application searching control is triggered, the electronic device can switch the touchpad simulation interface to an application searching interface, and the application interface of the triggered application program in the application searching interface can be displayed in split screen with the application interface of the target application program. In a case where the mode switching control is triggered, the electronic device can cancel the display of the touchpad simulation interface, and display other interfaces, such as a touch interface that can also control the application interface of the target application program, and the touch function of the touch interface corresponds to the application interface of the target application program, that is, according to the difference of the displayed application program, or the difference of the application interface of the application program, the touch interface is also different.
[0257] As an example, the electronic device can respond to the second user operation in the touchpad simulation interface through the touch driving module, the event dispatching module, and the window management module. Illustratively, in a case where the touch coordinates are located in the position range of any one of the at least one touch control, the event dispatching module can send the touch coordinates to the window management module; in a case where the window management module receives the touch coordinates, the window management module updates the touchpad simulation interface.
[0258] As can be seen from the above, the at least one touch control can include a plurality of different touch controls, and different touch controls can implement different functions, so that in a case where the touch control operated by the touch operation is different, the operation of the electronic device to update the touchpad simulation interface is also different.
[0259] Exemplarily, the operation of the window management module updating the touchpad simulation interface includes: closing the touchpad simulation interface; or displaying an interface of the touched touch control in the touchpad simulation interface, and updating the display range of the touchpad simulation area. The operation of updating the display range of the touchpad simulation area includes: reducing the display range of the touchpad simulation area from the first display range to the second display range.
[0260] It should be noted that the second user operation is a touch operation on the touch control A, and the electronic device displays an interface of the touched touch control A in the touchpad simulation interface and reduces the display range of the touchpad simulation area from the first display range to the second display range in response to the touch operation on the touch control A. In a possible case, the user continues to touch the touch control A, and the electronic device can restore the display range of the touchpad simulation area from the second display range to the first display range in response to the touch operation on the touch control A. In another possible case, the user touches another touch control B, and the electronic device displays an interface of the touch control B and updates the display range of the touchpad simulation area from the second display range to a third display range in response to the touch operation on the touch control B.
[0261] It should be noted that the touchpad simulation interface is updated, thereby ensuring the accuracy of the folding screen interface display.
[0262] In some embodiments, after updating the touchpad simulation interface, the window management module can further generate updated touchpad state information; the window management module sends the updated touchpad state information to the touch driving module through the first communication interface; the touch driving module analyzes the updated touchpad state information to obtain updated touchpad display range; the touch driving module sends the updated touchpad display range to the coordinate calculation module through the second communication interface; and the coordinate calculation module updates the stored touchpad display range in response to receiving the touchpad display range.
[0263] In the embodiments of the present application, the touchpad simulation interface and the second application interface can be displayed in the folding screen, and the user can control the second application interface through the touchpad simulation interface, thereby increasing the richness of the touch operation response mode on the basis of increasing the use function of the folding screen.
[0264] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general purpose computer, a special purpose computer, a computer network or other programmable apparatus. The computer instructions can be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, such as the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer readable storage medium can be any available medium accessible by a computer, or a data storage device such as a server, data center, etc. integrated with one or more available media. The available media can be magnetic media (such as floppy disk, hard disk, magnetic tape), optical media (such as digital versatile disc (DVD)) or semiconductor media (such as solid state disk (SSD)) and the like.
[0265] The above is an optional embodiment provided by the present application, and is not used to limit the present application. Any modification, equivalent replacement, improvement, etc. made within the technical scope disclosed by the present application shall be included in the protection scope of the present application.
Claims
1. A method for responding to touch operations, characterized in that, The method is applied to an electronic device with a folding screen, and the method comprises the following steps: The folding screen displays a first application interface; In response to a first user operation, the folding screen displays a second application interface and a touchpad simulation interface, wherein the touchpad simulation interface comprises a touchpad simulation area and / or at least one touch control, and the touchpad simulation area is used for simulating a touchpad; In response to a second user operation, the electronic device receives capacitance data; In response to receiving the capacitance data, the electronic device acquires touch coordinates of the second user operation on the folding screen according to the capacitance data; In response to the touch coordinates being located in the touchpad simulation area, a third application interface is displayed, or in response to the touch coordinates being located in a position range of any one of the at least one touch control, the touchpad simulation interface is updated.
2. The method of claim 1, wherein, The electronic device comprises a touch driving module, a touch chip and a coordinate calculation module; In response to the second user operation, the electronic device receives capacitance data, which comprises the following steps: In response to the second user operation, the touch chip triggers an interrupt and sends the capacitance data to the touch driving module; The touch driving module receives the capacitance data; In response to receiving the capacitance data, the touch driving module sends the capacitance data to the coordinate calculation module; The coordinate calculation module determines the touch coordinates according to the capacitance data; The coordinate calculation module sends the touch coordinates to the touch driving module; The touch driving module receives the touch coordinates. The touchpad simulation interface further comprises a target area, which is an area of the touchpad simulation interface that cannot respond to the second user operation; 3. The method of claim 1 or 2, wherein, In response to receiving the capacitance data, the electronic device acquires touch coordinates of the second user operation on the folding screen according to the capacitance data, which further comprises the following steps: In response to the touch coordinates being located in the target area, the touch coordinates are discarded. The electronic device comprises a touch driving module and an event dispatching module; 4. The method of claim 1, wherein, In response to the touch coordinates being located in the touchpad simulation area, the third application interface is displayed, which further comprises the following steps: The touch driving module sends the touch coordinates to the event dispatching module; The event dispatching module determines an area of the touch coordinates in the folding screen in response to receiving the touch coordinates; In response to the touch coordinates being located in the touchpad simulation area, the event dispatching module sends the touch coordinates to the target application program; The target application program displays the third application interface in response to receiving the touch coordinates. The electronic device comprises the touch driving module, the event dispatching module and a window management module; 5. The method of claim 1, wherein, The updating the touchpad simulation interface in response to the touch coordinates being located in the position range of any one of the at least one touch control comprises: The event distribution module sends the touch coordinates to the window management module in response to the touch coordinates being located in the position range of the any one touch control; The window management module updates the display range of the touchpad simulation area in response to receiving the touch coordinates.
6. The method of claim 5, wherein, The window management module, after updating the display range of the touchpad simulation area in response to receiving the touch coordinates, further comprises: The window management module generates updated touchpad state information; The window management module sends the updated touchpad state information to the touch driving module through a first communication interface; The touch driving module parses the updated touchpad state information to obtain the updated touchpad display range; The touch driving module sends the updated touchpad display range to the coordinate calculation module through a second communication interface; The coordinate calculation module updates the stored touchpad display range in response to receiving the touchpad display range.
7. The method of any one of claims 1-6, wherein, The first user operation is a folding operation on the folding screen; The folding screen displays a second application interface and a touchpad simulation interface in response to the first user operation, comprising: Monitoring the folding angle of the folding screen in response to the folding operation; Obtaining display information of the folding screen in response to the folding angle of the folding screen being located within a preset angle range; Displaying the touchpad simulation interface and the second application interface in a split screen in the folding screen in response to the display information indicating that the second application interface is displayed in the folding screen.
8. The method of any one of claims 1-6, wherein, The first user operation is a trigger operation on a touchpad control; The folding screen displays a second application interface and a touchpad simulation interface in response to the first user operation, comprising: The folding screen displays the second application interface and the touchpad simulation interface in a split screen in response to the trigger operation on the touchpad control.
9. The method of any one of claims 1-8, wherein, The first application interface, the second application interface, and the third application interface are different application interfaces of a target application program, the first application interface is displayed full screen in the folding screen, and the second application interface and the third application interface are displayed half screen in the folding screen; The target application program is any one application program in a preset white list.
10. The method of claim 1, wherein, The displaying a third application interface in response to the touch coordinates being located in the touchpad simulation area comprises: In response to the touch coordinates being located in the touchpad simulation area, if a mouse icon is not displayed in the second application interface, the third application interface is displayed, the third application interface being the second application interface displaying the mouse icon; or, In response to the touch coordinates being located in the trackpad simulation area, if the mouse icon is displayed in the second application interface and the position of the mouse icon is a position of any operation control in the second application interface, in response to the second user operation being a click operation or a long press operation, the second application interface is switched to a third application interface, the third application interface being an application interface other than the second application interface in the target application program; or, In response to the touch coordinates being located in the trackpad simulation area, if the mouse icon is displayed in the second application interface and there is no operation control capable of responding in the position of the mouse icon in the second application interface, in response to the second user operation being a click operation or a long press operation, the third application interface is displayed, the third application interface being the same as the second application interface; or, In response to the touch coordinates being located in the trackpad simulation area, if the mouse icon is displayed in the second application interface, in response to the second user operation being a sliding operation, the third application interface is displayed, the position of the mouse icon in the third application interface being different from the position of the mouse icon in the second application interface.
11. An electronic device, comprising: The structure of the electronic device comprises a processor and a memory; The memory is used to store a program supporting the electronic device to execute the method in any one of claims 1-10.
12. A computer-readable storage medium, characterized in that, The computer readable storage medium stores instructions, when the instructions are run on the computer, the computer executes the method in any one of claims 1-10.
Citation Information
Patent Citations
Display method applied to electronic equipment with folding screen and electronic equipment
CN114787773A
Application control method and device, terminal, storage medium and computer program product
CN116107482A
Game adaptation method and device, electronic equipment and computer readable storage medium
CN117398677A
Screen display control method and electronic device
WO2020155876A1