Application control methods, devices, terminals, storage media, and computer program products

By receiving and mapping touch operations from the first screen area to the second screen area for application control while the foldable screen terminal is hovering, the problems of poor application control flexibility and device stability are solved, resulting in more efficient application operation and a more stable user experience.

CN116107482BActive Publication Date: 2026-04-03GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-08
Publication Date
2026-04-03

AI Technical Summary

Technical Problem

Foldable screen devices have poor application control flexibility during use, and are prone to tipping over when hovering due to direct touch operation, which affects the user experience.

Method used

In the hovering state, the first screen area of ​​the foldable terminal receives touch operations and maps them to the second screen area for application control, realizing the separation of application interface display and control, improving operational flexibility and enhancing device stability.

Benefits of technology

By controlling applications on the second screen area through touch operations on the first screen area, the flexibility of application control is improved, the probability of the foldable screen terminal tipping over when hovering is reduced, and the user experience is enhanced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116107482B_ABST
    Figure CN116107482B_ABST
Patent Text Reader

Abstract

This application discloses an application control method, device, terminal, storage medium, and computer program product, belonging to the field of human-computer interaction. The method includes: displaying the application interface of an application in a second screen area while hovering; wherein, in the hovering state, the angle between the first screen area and the second screen area is less than a first angle threshold and greater than a second angle threshold; and controlling the application based on a touch operation received on the first screen area. Using the solution provided by this application, users can control the application without performing touch operations on the screen area displaying the application interface, thus improving the flexibility of application control.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of human-computer interaction, and in particular to an application control method, device, terminal, storage medium, and computer program product. Background Technology

[0002] With the continuous development of terminal screen manufacturing technology, more and more foldable screen terminals are emerging. Because the screen of a foldable screen terminal is foldable, it has the advantages of both large-screen display and portability.

[0003] However, the flexibility of application control is poor when running applications on foldable screen terminals. Summary of the Invention

[0004] This application provides an application control method, device, terminal, storage medium, and computer program product. The technical solution is as follows:

[0005] On one hand, embodiments of this application provide an application control method for a foldable screen terminal, wherein the foldable screen of the foldable screen terminal includes a first screen area and a second screen area, and the method includes:

[0006] In the hover state, the application interface of the application is displayed in the second screen area. In the hover state, the angle between the first screen area and the second screen area is less than a first angle threshold and greater than a second angle threshold.

[0007] Upon receiving a touch operation on the first screen area, the application is controlled based on the touch operation.

[0008] On the other hand, embodiments of this application provide an application control device for a foldable screen terminal, wherein the foldable screen of the foldable screen terminal includes a first screen area and a second screen area, and the device includes:

[0009] The display module is used to display the application interface of the application in the second screen area in the hover state, wherein in the hover state, the angle between the first screen area and the second screen area is less than a first angle threshold and greater than a second angle threshold.

[0010] The control module is used to control the application based on the touch operation when a touch operation is received on the first screen area.

[0011] On the other hand, embodiments of this application provide a terminal, the terminal including a processor and a memory; the memory stores at least one instruction, the at least one instruction being executed by the processor to implement the application control method as described above.

[0012] On the other hand, a computer-readable storage medium is provided that stores at least one instruction, which is executed by a processor to implement the application control method as described above.

[0013] On the other hand, embodiments of this application provide a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the application control method provided in the above aspects.

[0014] The beneficial effects of the technical solutions provided in this application embodiment may include:

[0015] In this embodiment, when the foldable screen terminal is in a hovering state, the application interface of the terminal control application is only displayed in the second screen area, and receives touch operations applied to the first screen area, thereby controlling the application displayed in the second screen area based on the touch operations. Using the solution provided in this embodiment, users do not need to perform touch operations on the screen area displaying the application interface to achieve application control, improving the flexibility of application control. Furthermore, compared to directly performing touch operations in the second screen area, performing touch operations in the first screen area helps improve the stability of the foldable screen terminal in the hovering state and reduces the probability of the foldable screen terminal tipping over during touch operations. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments of this application will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This invention provides a structural block diagram of a terminal according to an exemplary embodiment of the present application.

[0018] Figure 2 A structural block diagram of a terminal provided in another exemplary embodiment of this application is shown;

[0019] Figure 3 This invention provides a schematic diagram of the structure of a foldable screen terminal according to an exemplary embodiment of the present application.

[0020] Figure 4 A schematic diagram of the structure of a foldable screen terminal provided in another exemplary embodiment of this application is shown;

[0021] Figure 5This is a flowchart illustrating an exemplary embodiment of the application control method of this application;

[0022] Figure 6 This is a schematic diagram illustrating an exemplary embodiment of the video application control process of this application;

[0023] Figure 7 This is an exemplary embodiment of the present application illustrating the process of switching from an unfolded state to a hovering state;

[0024] Figure 8 This is an exemplary embodiment of the present application illustrating the process of switching from a folded state to a hovering state;

[0025] Figure 9 This is a schematic diagram illustrating different display modes of the application interface under different postures, as shown in an exemplary embodiment of this application;

[0026] Figure 10 This is a flowchart illustrating an application control method in another exemplary embodiment of this application;

[0027] Figure 11 This is a schematic diagram illustrating the coordinate mapping relationship between a first screen area and a second screen area, as shown in an exemplary embodiment of this application.

[0028] Figure 12 This is a schematic diagram illustrating an anti-accidental touch area in an exemplary embodiment of this application;

[0029] Figure 13 This is a schematic diagram illustrating a touch area division method in an exemplary embodiment of this application;

[0030] Figure 14 This is a schematic diagram illustrating an exemplary embodiment of the touch mapping mode state switching process of this application;

[0031] Figure 15 The present application provides a schematic diagram illustrating the application interface adaptation process in an exemplary embodiment.

[0032] Figure 16 A structural block diagram of an application control device provided in an exemplary embodiment of this application is shown. Detailed Implementation

[0033] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0034] refer to Figure 1 and Figure 2The diagram illustrates a structural block diagram of a terminal 100 provided in an exemplary embodiment of this application. The terminal 100 may be a smartphone, tablet computer, e-reader, etc. The terminal 100 in this application may include one or more components such as a processor 110, a memory 120, and a display screen 130.

[0035] Processor 110 may include one or more processing cores. Processor 110 connects to various parts within terminal 100 using various interfaces and lines, and performs various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in memory 120, and by calling data stored in memory 120. Optionally, processor 110 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). Processor 110 may integrate one or more of a Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content required to be displayed on the touch screen 130; and the modem handles wireless communication. It is understood that the modem may also not be integrated into processor 110 and may be implemented as a separate chip.

[0036] The memory 120 may include random access memory (RAM) or read-only memory (ROM). Optionally, the memory 120 may include a non-transitory computer-readable storage medium. The memory 120 may be used to store instructions, programs, code, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the various method embodiments described below, etc.; the data storage area may store data created according to the use of the terminal 100 (such as audio data, phone book, etc.).

[0037] Taking the Android operating system as an example, the programs and data stored in the memory 120 are as follows: Figure 1 As shown, memory 120 stores the Linux kernel layer 220, system runtime library layer 240, application framework layer 260, and application layer 280. The Linux kernel layer 220 provides low-level drivers for various hardware components of the terminal 100, such as display drivers, audio drivers, camera drivers, Bluetooth drivers, Wi-Fi drivers, and power management. The system runtime library layer 240 provides support for key Android features through several C / C++ libraries. For example, the SQLite library provides database support, the OpenGL / ES library provides 3D graphics support, and the Webkit library provides browser kernel support. The system runtime library layer 240 also provides the Android Runtime, which mainly provides core libraries that allow developers to write Android applications using Java. The application framework layer 260 provides various Application Programming Interfaces (APIs) that may be used when building applications. Developers can also use these APIs to build their own applications, such as activity management, window management, view management, notification management, content providers, package management, call management, resource management, and location management. At least one application runs in the application layer 280. These applications can be built-in contact programs, SMS programs, clock programs, camera applications, etc., or they can be applications developed by third-party developers, such as instant messaging programs, photo enhancement programs, etc.

[0038] Taking the operating system as an example (iOS), the programs and data stored in memory 120 are as follows: Figure 2As shown, the iOS system includes: Core OS layer 320, Core Services layer 340, Media layer 360, and Cocoa Touch layer 380. Core OS layer 320 includes the operating system kernel, drivers, and low-level program frameworks. These low-level program frameworks provide hardware-level functionality for use by the program frameworks located in Core Services layer 340. Core Services layer 340 provides system services and / or program frameworks required by applications, such as Foundation framework, account framework, advertising framework, data storage framework, network connectivity framework, geolocation framework, motion framework, etc. Media layer 360 provides applications with audiovisual interfaces, such as interfaces related to graphics and images, audio technology, video technology, and AirPlay (wireless playback of audio and video transmission technologies). Cocoa Touch layer 380 provides various commonly used interface-related frameworks for application development and is responsible for user touch interaction on terminal 100. Examples include local notification services, remote push services, advertising frameworks, game tool frameworks, message user interface (UI) frameworks, UIKit frameworks, map frameworks, and so on.

[0039] exist Figure 2 The framework shown includes, but is not limited to, the base framework in the core service layer 340 and the UIKit framework in the touchable layer 380. The base framework provides many basic object classes and data types, offering the most basic system services to all applications, and is independent of the UI. The UIKit framework, on the other hand, provides a basic UI class library for creating touch-based user interfaces. iOS applications can use the UIKit framework to provide their UI, thus providing the application's infrastructure for building user interfaces, drawing, handling user interaction events, responding to gestures, and so on.

[0040] The display screen 130 is used to display the application interface of each application; when the display screen 130 also has a touch function, it is also used to receive touch operations by the user using a finger, stylus or any suitable object on or near it.

[0041] In this embodiment, the display screen 130 is a foldable screen, including a first screen area and a second screen area. Optionally, when the terminal is an inward-folding screen terminal, the first screen area and the second screen area are the two screen areas of the inward-folding screen. When the inward-folding screen terminal is in the unfolded state, both the first screen area and the second screen area are exposed; when the inward-folding screen terminal is in the folded state, neither the first screen area nor the second screen area is exposed.

[0042] In this embodiment, the hovering state is an intermediate state between the unfolded state and the folded state. In some application scenarios, the foldable screen terminal in the hovering state is usually positioned with the housing corresponding to one side of the screen area horizontally placed, while the housing corresponding to the other side of the screen area is in a vertical state. That is, the two screen areas have an included angle, which can be an angle greater than 0 degrees and less than 180 degrees.

[0043] In one possible implementation, the foldable screen terminal can control the foldable screen to maintain any angle or a specific angle by means of a hinge located at the pivot, thereby maintaining a hovering state.

[0044] Indicative, such as Figure 3 As shown, when the inward-folding screen terminal is in the unfolded state, both the first screen area 301 and the second screen area 302 are exposed; when the inward-folding screen terminal is in the folded state, both the first screen area 301 and the second screen area 302 are closed; when the angle between the first screen area 301 and the second screen area 302 is 120°, the foldable screen terminal is in a hovered state. Users can switch the foldable screen between the unfolded and folded states according to their usage needs. For example, when the user does not need to use the terminal, the terminal can be folded to make it more portable. As another example, when the user needs to watch videos, the terminal can be unfolded or hovered.

[0045] In one possible implementation, the foldable screen terminal includes, in addition to the foldable screen, an auxiliary display screen independent of the foldable screen. In some embodiments, the auxiliary display screen is positioned back-to-back with the foldable screen, the size of the auxiliary display screen is smaller than the size of the foldable screen in its unfolded state, and the auxiliary display screen does not support folding. For example, the auxiliary display screen is positioned back-to-back with either the first screen area or the second screen area of ​​the foldable screen, and the size of the auxiliary display screen is less than or equal to the size of either the first or second screen area.

[0046] Optionally, the secondary display screen remains exposed in all states. (Illustrative example, such as...) Figure 4 As shown, when the foldable screen terminal is in the unfolded state, the first screen area 401, the second screen area 402, and the auxiliary display screen 403 are all exposed; when the foldable screen terminal is in the folded state, the first screen area 401 and the second screen area 402 are in the closed state, and the auxiliary display screen 403 is exposed.

[0047] Optionally, the foldable screen and the secondary display screen support independent display. In some embodiments, when the foldable screen terminal is in a folded state, images can be displayed through the secondary display screen (the foldable screen does not display); when the foldable screen terminal is in an unfolded or hovered state, images can be displayed through the foldable screen (the secondary display screen does not display). To achieve screen folding, in one possible implementation, the foldable screen is made of a flexible material (with a certain degree of stretchability), or the bending area of ​​the foldable screen is made of a flexible material.

[0048] Figure 3 and Figure 4 In this embodiment, only the shape (folded) of the display screen 130 is illustrated. In some other possible implementations, the display screen 130 may contain n (n≥3) screen areas, thereby realizing an n-1 folded screen terminal. This embodiment does not limit this.

[0049] Optionally, the terminal 100 may also include at least one other component, including a camera, a fingerprint sensor, a proximity sensor, a distance sensor, etc. In some embodiments, the at least one other component may be located on the front, side, or back of the terminal 100, for example, the fingerprint sensor may be located on the back cover or side, and the camera may be located on one side of the display screen 130.

[0050] In other embodiments, at least one additional component may be integrated inside or beneath the display screen 130. In some embodiments, a bone conduction earpiece is disposed inside the terminal 100; other components on the front panel of a conventional terminal are integrated into all or part of the display screen 130, for example, the photosensitive element in a camera is divided into multiple photosensitive pixels, and each photosensitive pixel is integrated into the black area of ​​each display pixel in the display screen 130, enabling the display screen 130 to have image acquisition capabilities. Because at least one additional component is integrated inside or beneath the display screen 130, the terminal 100 has a higher screen-to-body ratio.

[0051] In addition, those skilled in the art will understand that the structure of the terminal 100 shown in the above figures does not constitute a limitation on the terminal 100. The terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements. For example, the terminal 100 may also include radio frequency circuits, input units, audio circuits, a Wireless Fidelity (WiFi) module, a power supply, a Bluetooth module, and other components, which will not be described in detail here.

[0052] Please refer to Figure 5The document illustrates a flowchart of an application control method according to an embodiment of this application. This embodiment uses the application control method for a foldable screen terminal, where the foldable screen of the foldable screen terminal includes a first screen area and a second screen area, as an example for explanation. The method includes the following steps.

[0053] Step 501: In the hover state, the application interface of the application is displayed in the second screen area. In the hover state, the angle between the first screen area and the second screen area is less than the first angle threshold and greater than the second angle threshold.

[0054] In one possible implementation, the foldable screen terminal displays the application interface in other states, and when switching from other states to a hover state, the foldable screen terminal controls a second screen area to display the application interface. These other states can be an unfolded state or a folded state.

[0055] In one possible implementation, in the hovering state, one part of the foldable screen terminal can be laid flat on a table or similar surface, while the other part is upright, meaning the two parts form an angle. This angle can be greater than 0 degrees and less than 180 degrees. In this case, the foldable screen terminal displays the application interface on the upright part and not on the flat part. Typically, the foldable screen terminal identifies the screen area of ​​the upright part as the second screen area and the screen area of ​​the flat part as the first screen area.

[0056] Optionally, the application can be any application, or an application that supports display in a hover state, and the application type can be video playback type, music playback type, photo album type, reading type, etc., which is not limited in this embodiment.

[0057] In some embodiments, when the angle between the first screen area and the second screen area is greater than or equal to a first angle threshold, the foldable screen terminal is in an unfolded state; when the angle between the first screen area and the second screen area is less than or equal to a second angle threshold, the foldable screen terminal is in a folded state; when the angle between the first screen area and the second screen area is greater than the second angle threshold and less than the first angle threshold, the foldable screen terminal is in a hovered state. For example, the first angle threshold is 120° or 150°, etc., and the second angle threshold is 60°, 30°, etc., but this application embodiment does not limit this.

[0058] Optionally, the angle between the first screen area and the second screen area can be measured by an angle sensor in the hinge connecting the two screen areas, or by introducing an infrared measuring device. This application embodiment does not limit this.

[0059] Step 502: Upon receiving a touch operation on the first screen area, control the application based on the touch operation.

[0060] In related technologies, when a user wants to control an application, they need to perform touch operations on the screen area displaying the application. In the hover state, the second screen area displaying the application is in portrait mode, and directly operating this second screen area can easily cause the foldable screen terminal to tip over, affecting the user experience. However, the first screen area, when laid flat, is more stable, and touch operations on this first screen area are less likely to cause the foldable screen terminal to tip over. Therefore, in this embodiment, the foldable screen terminal can receive touch operations through the first screen area and map the received touch operations to the second screen area, thereby enabling control of applications in the second screen area through touch operations within the first screen area.

[0061] Furthermore, users can still directly touch the second screen area to control applications. These two touch operation methods cater to different user needs, improve application control flexibility, and allow for application control without obstructing the application interface while hovering, making the foldable screen terminal more appealing to users in this mode.

[0062] Optionally, the touch operation can be a click, long press, swipe, or other touch operation, and this application embodiment does not limit this.

[0063] It should be noted that, unlike touchpads on devices such as laptops, which are used to control specific objects on the display screen, such as controlling cursor movement or clicking, in this embodiment, the touch functionality of the second screen area is copied and transferred to the first screen area, and touch operations in the first screen area are mapped to touch operations in the second screen area, rather than controlling specific objects based on touch operations in the first screen area. Furthermore, unlike a touchpad where the same touch operation in different touch areas achieves the same function (i.e., the function controlled by the touch operation is independent of the touch area), in this embodiment, the function controlled by the touch operation is related to the touch area; that is, the same touch operation in different touch areas of the first screen area may achieve different functions.

[0064] In some embodiments, when the application is a multimedia application, upon receiving a horizontal swipe operation on the first screen area, the foldable screen terminal controls the multimedia playback progress of the multimedia application based on the swipe direction and swipe distance. Optionally, when the swipe direction is a first horizontal swipe direction (e.g., consistent with the forward direction of the progress bar), the foldable screen terminal controls the multimedia application to fast forward; when the swipe direction is a second horizontal swipe direction (opposite to the first horizontal swipe direction), the foldable screen terminal controls the multimedia application to rewind; and the fast-forward or rewind duration is positively correlated with the swipe distance.

[0065] Upon receiving a vertical swipe operation on the first screen area, the foldable screen terminal controls the multimedia playback parameters of the multimedia application based on the swipe direction and swipe distance. These multimedia playback parameters include at least one of playback volume or display brightness. Optionally, when the vertical swipe operation is located in a first sub-area of ​​the first screen area (e.g., the left side area), the vertical swipe operation is used to control the playback volume; when the vertical swipe operation is located in a second sub-area of ​​the first screen area (e.g., the right side area), the vertical swipe operation is used to control the display brightness, and the adjustment range of the playback parameters is positively correlated with the swipe distance.

[0066] Upon receiving a click operation on the first screen area, the foldable screen terminal controls the multimedia state based on the click operation. The multimedia state includes a playback state and a paused state. Specifically, when the multimedia application is in playback state, the foldable screen terminal sets the multimedia application to a paused state based on the click operation; when the multimedia application is in a paused state, the foldable screen terminal sets the multimedia application to playback state based on the click operation.

[0067] Upon receiving a long-press operation on the first screen area, the foldable screen terminal controls the multimedia playback speed based on the long-press operation. Optionally, the foldable screen terminal can adjust the multimedia playback speed according to a fixed ratio, such as adjusting the multimedia playback speed to 3 times; or, the foldable screen terminal can dynamically adjust the change ratio of the multimedia playback speed according to the duration of the long press.

[0068] Indicative, such as Figure 6 As shown, when the application is a video application, swiping up and down on the left side of the first screen area 601 can adjust the brightness of the video displayed in the second screen area 602; swiping up and down on the right side of the first screen area 601 can adjust the volume of the video displayed in the second screen area 602; and swiping left and right on the first screen area 601 can adjust the progress of the video displayed in the second screen area 602.

[0069] It should be noted that the above-described touch operations and touch functions are for illustrative purposes only. The same touch operation can achieve different touch functions in different types of applications, and different types of applications can correspond to different touch operations. This embodiment does not limit this.

[0070] In summary, in this embodiment, when the foldable screen terminal is in a hovering state, the application interface of the terminal control application is only displayed in the second screen area, and receives touch operations applied to the first screen area, thereby controlling the application displayed in the second screen area based on the touch operation. Using the solution provided in this embodiment, users do not need to perform touch operations on the screen area displaying the application interface to achieve application control, improving the flexibility of application control. Furthermore, compared to directly performing touch operations in the second screen area, performing touch operations in the first screen area helps improve the stability of the foldable screen terminal in the hovering state and reduces the probability of the foldable screen terminal tipping over during touch operations.

[0071] In one possible application scenario, when the folding screen of the folding terminal is an inward folding screen, in the unfolded state, the folding screen terminal displays the application interface of the application in the first screen area and the second screen area. In the unfolded state, the angle between the first screen area and the second screen area is greater than a first angle threshold.

[0072] When switching from the unfolded state to the hovered state, since the first screen area and the second screen area are not on the same plane in the hovered state, continuing to display the application interface in full screen would cause image distortion. Therefore, when the switch to the hovered state is detected, the foldable screen terminal controls the second screen area to continue displaying the application interface and controls the first screen area to stop displaying the application interface (i.e., the foldable screen terminal only displays the application interface on half screen).

[0073] It should be noted that the application interface displayed in the second screen area has been adapted to match the size of the second screen area and ensure the integrity of the displayed content.

[0074] Indicative, such as Figure 7 As shown, in the unfolded state, the first screen area 601 and the second screen area 602 of the foldable screen display the video playback interface in full screen; when the user folds the foldable screen from the unfolded state to the hovered state, the second screen area 602 continues to display the video playback interface, while the first screen area 601 stops displaying the video playback interface.

[0075] In another possible application scenario, the foldable screen terminal has an auxiliary display screen independent of the foldable screen. In the folded state, the application interface is displayed on the auxiliary display screen. In the folded state, the auxiliary display screen is exposed, and the angle between the first screen area and the second screen is less than a second angle threshold.

[0076] When switching from a folded state to a hovered state, it indicates that the user expects to view the content through the folded screen rather than through the secondary display screen. Therefore, the folded screen terminal displays the application interface in the second screen area and controls the secondary display screen to stop displaying the application interface.

[0077] Indicative, such as Figure 8 As shown, in the folded state, the first screen area 601 and the second screen area 602 of the foldable screen are not exposed, and the foldable screen terminal displays the video playback interface through the auxiliary display screen 603. When the user unfolds the foldable screen terminal from the folded state to the hovered state, the second screen area 602 continues to display the video playback interface, the first screen area 601 does not display the video playback interface, and the auxiliary display screen 603 is in a screen-off state.

[0078] In one possible implementation, the first screen area is the screen area in a flat position during the hovering state, while the second screen area is the screen area in a portrait position during the hovering state. Accordingly, in the hovering state, the foldable screen terminal needs to determine the screen area for displaying the application interface and the screen area for touch operation based on the current posture. Optionally, the process by which the foldable screen terminal determines the screen areas for interface display and touch mapping may include the following steps.

[0079] 1. In the hovering state, obtain the pose of the first screen area and the pose of the second screen area.

[0080] In one possible implementation, the foldable screen terminal can determine the respective postures of the first screen area and the second screen area based on the gravitational acceleration data collected by the built-in gravity sensor (e.g., determining the posture based on the direction of gravitational acceleration). This posture can be a portrait posture or a flat posture. This application does not limit the method for determining the posture of the screen areas.

[0081] The flat position is the state where the angle between the screen area and the plane is less than the angle threshold (e.g., 10°), while the portrait position is the state where the angle between the screen area and the plane is greater than the angle threshold.

[0082] Indicative, such as Figure 7 As shown in Figure 8, in the hover state, the first screen area 601 is in a flat state, while the second screen area 602 is in a portrait state.

[0083] 2. When the first screen area is in a flat position and the second screen area is in a portrait position, the application interface is displayed in the second screen area.

[0084] When users are using a foldable screen device in a hovering state, they usually want the foldable screen device to display content through the screen area in portrait mode. Therefore, when it is detected that the first screen area is in a flat position and the second screen area is in a portrait position, the terminal displays the application interface (after interface adaptation) in the second screen area.

[0085] like Figure 7As shown in Figure 8, the foldable screen terminal detects that the first screen area 601 is in a flat position and the second screen area 602 is in a portrait position, thereby controlling the second screen area 602 to display the video playback interface and controlling the first screen area 601 to stop displaying the video playback interface.

[0086] In one possible scenario, a user might flip the foldable screen terminal while it is in a hovering state, causing a change in the posture of the first and second screen areas. Accordingly, the foldable screen terminal needs to dynamically switch the display state of the screen areas based on the change in the posture of the screen areas. Optionally, the method may also include the following steps:

[0087] 1. When the first screen area is switched to portrait mode and the second screen area is switched to flat mode, the application interface of the application is displayed in the first screen area, and the second screen area is set to touch mapping mode.

[0088] After flipping the foldable screen terminal, if the first screen area, which was originally in a flat position, becomes a portrait position, and the second screen area, which was originally in a portrait position, becomes a flat position, the foldable screen terminal switches the display states of the first screen area and the second screen area. That is, the application interface is displayed on the first screen area, and the application interface is stopped from being displayed on the second screen area, and the touch mapping mode is entered.

[0089] Indicative, such as Figure 9 As shown, when the first screen area 901 switches from a flat position to a portrait position, and the corresponding portrait position of the second screen area 902 switches to a flat position, the foldable screen terminal can adjust the display of the application interface, with the first screen area 901 displaying the application interface and the second screen area 902 stopping the display of the application interface.

[0090] 2. Upon receiving a touch operation on the second screen area, control the application based on the touch operation.

[0091] When the display state of a screen area changes, the way the application is controlled also changes accordingly. In addition to being able to directly touch the application through the first screen area, you can also touch the application through the second screen area.

[0092] In one possible implementation, the foldable screen terminal receives touch operations through a second screen area and maps the received touch operations to a first screen area, thereby enabling the control of applications in the first screen area through touch operations in the second screen area.

[0093] Please refer to Figure 10 The diagram illustrates a flowchart of an application control method according to another embodiment of this application.

[0094] Step 1001: In the hover state, the application interface of the application is displayed in the second screen area. In the hover state, the angle between the first screen area and the second screen area is less than the first angle threshold and greater than the second angle threshold.

[0095] This step is the same as step 501 above, and will not be repeated here in the embodiments of this application.

[0096] Step 1002: Upon receiving a touch operation on the first screen area, generate a first touch event based on the touch operation.

[0097] In one possible implementation, when a touch operation is received in the first screen area, the foldable screen terminal generates a first touch event based on the received touch operation, and this event acts on the first screen area. The first touch event includes the touch coordinates of the touch operation.

[0098] Optionally, the first touch event may also include information such as the operation type, the number of touch points, and the touch time of the touch operation; this embodiment does not limit this.

[0099] Step 1003: Based on the mapping relationship between the first screen area and the second screen area, convert the first touch event into a second touch event.

[0100] In one possible implementation, the first screen area and the second screen area of ​​the foldable screen terminal have a certain mapping relationship. By establishing a mapping coordinate system between the first screen area and the second screen area, a first touch event can be converted, and a second touch event can be determined based on the converted touch coordinates. The second touch event is a touch event acting on the second screen area. Specifically, when converting the first touch event, the touch coordinates corresponding to the first touch event are also converted according to the mapping relationship to obtain the touch coordinates corresponding to the second touch event, and the obtained touch coordinates are located in the second screen area.

[0101] Optionally, the touch type of the touch operation in the first touch event and the second touch event is the same.

[0102] Indicative, such as Figure 11As shown, the first screen area 1101 and the second screen area 1102 are two display areas of the display screen 1100. When a user wants to control the video being played on the second screen area 1102 through the first screen area 1101, the foldable screen terminal can map the touch coordinates in the first touch event to the touch coordinates within the second screen area 1102 based on the mapping coordinate system between the first screen area 1101 and the second screen area 1102, thereby obtaining the second touch event. For example, the coordinates of the touch operation applied to the first screen area 1101 are (x, y). When the dimensions of the first screen area 1101 and the second screen area 1102 are the same (i.e., the height of the first screen area 1101 is equal to the height of the second screen area 1102, and the width of the first screen area 1101 is equal to the width of the second screen area), according to the mapping relationship, the coordinates of the mapping point of the touch operation (x1, y1) can be obtained in the second screen area 1102. That is, the touch coordinates corresponding to the second touch event are (x1, y1), where x1 = x, y1 = yh, and h is the height of the first screen area 1101 or the second screen area 1102.

[0103] It should be noted that when the heights of the first screen area and the second screen area are different, for example, the height of the first screen area is h1 and the height of the second screen area is h2, if the coordinates of the touch operation applied to the first screen area are (x, y), then the coordinates of the mapped point in the second screen area are (x2, y2), where x2 = x1 and y2 = h2(y-h2) / h1.

[0104] Step 1004: Control the application based on the second touch event.

[0105] In one possible implementation, the foldable screen terminal simulates touch operations in the first screen area within the second screen area based on a second touch event, thereby enabling control of the application.

[0106] To illustrate, when the application is a video playback application, if the operation type indicated by the second touch event is swiping up and the touch coordinates are located in the left display area of ​​the second screen area, the foldable screen terminal increases the video brightness based on the second touch event; if the operation type indicated by the second touch event is swiping up and the touch coordinates are located in the right display area of ​​the second screen area, the foldable screen terminal increases the video volume based on the second touch event.

[0107] Accidental touches may occur when using a foldable screen terminal in a hovering state, such as accidentally touching the screen area when clearing obstructions or picking up or putting down the foldable screen terminal. Therefore, to avoid accidental touches, this application embodiment introduces an anti-accidental touch mechanism. When a touch operation is received on the first screen area, the foldable screen terminal will further determine whether the touch operation is an accidental touch. If the touch operation is an accidental touch, it will not respond to the touch operation; if the touch operation is not an accidental touch, it will control the application displayed on the second screen area according to the touch operation.

[0108] In one possible implementation, when a touch operation is received on the first screen area and the touch operation is outside the anti-accidental touch area, the foldable screen terminal controls the application based on the touch operation, the anti-accidental touch area being located at the edge of the first screen area.

[0109] Since accidental touches on the screen typically occur at the screen edges, in this embodiment, the edge area of ​​the first screen region is designated as an anti-accidental touch area. For example, this anti-accidental touch area can be a rectangular area of ​​a preset width. This application does not limit the shape, position, or size of the anti-accidental touch area.

[0110] Optionally, the anti-accidental touch area can be set by default on the foldable screen terminal, or it can be set based on user habits. This application embodiment does not limit this.

[0111] Optionally, when a touch operation is received on the first screen and the touch operation is located within the anti-mistouch area, the foldable screen terminal will block the touch operation, that is, it will not respond to the touch operation.

[0112] In some embodiments, when the touch operation is outside the anti-mistouch area, the foldable screen terminal generates a first touch event based on the touch operation, so that a second touch event can be generated subsequently based on the first touch event; when the touch operation is within the anti-mistouch area, the foldable screen terminal will not generate a first touch event based on the touch operation.

[0113] Regarding the specific method for determining whether a touch operation is located within the anti-mistouch zone, in one possible implementation, in response to a touch operation on the first screen area, the foldable screen terminal obtains the touch coordinates of the touch operation and detects whether the touch coordinates are within the anti-mistouch coordinate range corresponding to the anti-mistouch zone.

[0114] For different types of touch operations, foldable screen terminals use different methods to identify accidental touches based on touch coordinates. In one possible implementation, when the touch operation is a click-type touch operation, if the touch coordinates of the touch operation are outside the anti-accidental touch area, then the touch operation is determined not to be an accidental touch operation; if the touch coordinates of the touch operation are within the anti-accidental touch area, then the touch operation is determined to be an accidental touch operation.

[0115] When the touch operation is a swipe-type touch operation, if the coordinates of the touch start point of the touch operation are outside the anti-mistouch area, the touch operation is determined not to be an accidental touch operation; if the coordinates of the touch start point of the touch operation are within the anti-mistouch area, the touch operation is determined to be an accidental touch operation.

[0116] Of course, in other possible implementations, if the touch coordinates of the touch operation intersect with the anti-accidental touch area, the foldable screen terminal will determine that the touch operation is an accidental touch operation. This embodiment does not limit this.

[0117] Indicative, such as Figure 12 As shown, the rectangular area located at the edge of the first screen area 1201 is the anti-mistouch area 1202. If the touch position of a click operation is located in the anti-mistouch area 1202, the foldable screen terminal will determine the click operation as a mis-touch operation and will not generate a touch event; if the touch starting point of a swipe operation is located in the anti-mistouch area 1202, the foldable screen terminal will determine the swipe operation as a mis-touch operation and will not generate a touch event.

[0118] Since users typically perform specific types of touch operations in specific areas, such as swiping their fingers on the left side of the screen to control the volume, or tapping the center of the screen to control video playback or pause, in order to further reduce the probability of accidental touches, in one possible implementation, the area outside the anti-accidental touch area in the first screen area is further subdivided into several sub-areas, and each sub-area only supports responding to specific types of touch operations.

[0119] In one possible implementation, when a touch operation is received on the first screen area and the touch operation is outside the anti-accidental touch area, the foldable screen terminal determines the target operation type corresponding to the operation area where the touch operation is performed. The target operation type is an operation type that supports the response within the operation area.

[0120] When the touch operation type is the target operation type, the foldable screen terminal controls the application based on the touch operation; when the touch operation type is not the target operation type, the foldable screen terminal blocks the touch operation.

[0121] Optionally, after determining that the touch operation is not a mis-touch operation based on the touch coordinates, the foldable screen terminal needs to further determine whether the area affected by the touch operation supports responding to the touch operation. In some embodiments, the foldable screen terminal determines the target area affected by the touch operation based on the touch coordinates, and determines the target operation type supported by the target area based on the correspondence between the area and the operation type. The correspondence between the area and the operation type can be a default setting of the terminal, or it can be customized by the user according to their own needs, or it can be set based on the application's own touch operation support; this embodiment does not limit this.

[0122] Optionally, when the operation type of the touch operation belongs to the target operation type, the foldable screen terminal generates a first touch event based on the touch operation, so that a second touch event can be generated based on the first touch event in the future; when the operation type of the touch operation does not belong to the target operation type, the foldable screen terminal will not generate a first touch event based on the touch operation.

[0123] Indicative, such as Figure 13 As shown, the first screen area 1301 is divided into an anti-mistouch area 1302, a swipe response area 1303, and a global response area 1304. The swipe response area 1303 only supports swipe operations, while the global response area 1304 supports all types of touch operations (including swipe operations, click operations, long press operations, etc.).

[0124] When a user taps the sliding response area 1303, no tap touch event is generated because the sliding response area 1303 does not support tapping. When a user swipes in the sliding response area 1303, a swipe touch event is generated because the sliding response area 1303 supports swipes. When a user taps or swipes in the global response area 1304, the corresponding tap or swipe touch event is generated because the global response area 1304 supports various types of touch operations.

[0125] It should be noted that the above embodiments are only illustrative of the area division method and the touch operations supported by the area, but do not constitute a limitation.

[0126] Optionally, when the foldable screen terminal cannot control the application based on touch operations within the first screen area, a prompt message (accidental touch or unsupported touch operation performed within the touch area) can be displayed within the first screen area to guide the user on how to correctly perform touch operations within the first screen area.

[0127] In this embodiment, by setting an anti-accidental touch area at the edge of the first screen area and shielding touch operations within the anti-accidental touch area, the impact of user accidental touches on the application is avoided, thereby improving the accuracy of human-computer interaction.

[0128] Furthermore, by dividing the first screen area into regions and setting the corresponding response operation types for each region, the system can respond to specific operations within the touch area, thereby reducing the probability of user misoperation and improving the accuracy of application control.

[0129] Since the application interface is not displayed in the first screen area, only simple gesture operations can be performed in the first screen area, and precise operations on the content displayed in the second screen area (such as clicking on specific controls displayed in the second screen area) cannot be performed. In order to avoid accidental operation, foldable screen terminals need to further disable specific operations in the first screen area.

[0130] In one possible implementation, upon receiving a touch operation on the first screen area, and if the touch operation is located outside the anti-mistouch area and the event shielding area, the foldable screen terminal controls the application based on the touch operation. The event shielding area corresponds to the display area of ​​controls in the second screen area. If the touch operation is located within the event screen area, the foldable screen terminal does not respond to the touch operation.

[0131] Optionally, the event shielding area can be a fixed static area or a non-fixed dynamic area, and this application embodiment does not limit this.

[0132] When the event shielding area is a dynamic area, the foldable screen terminal needs to determine the corresponding touch area mapped to the first screen area based on the touch area corresponding to the control in the second screen area, and then determine the event shielding area based on the mapped touch area.

[0133] Optionally, when the application is a video playback application, the control can be a selection control, a like control, a tipping control, etc.; when the application is a music playback application, the control can be a next track control, a download control, a loop playback control, etc. The embodiments of this application do not limit the specific type of the control.

[0134] For example, when a jump control (clicking it will jump to the next episode) is displayed in the second screen area, the foldable screen device determines the display area of ​​the jump control within the second screen area and designates the corresponding area of ​​this display area in the first screen area as an event masking area, and sets it to block touch operations (such as click operations) within this event masking area. Subsequently, if the user performs a click operation within this event masking area, the foldable screen device will not generate a touch event (the user may simply want to stop playback; if a touch event is generated, the application's response to the touch event will cause the jump to the next episode).

[0135] In one possible implementation, the first screen area has a touch mapping mode, in which touch operations on the first screen area are mapped to the second screen area to enable application control based on touch operations within the first screen area. Furthermore, this touch mapping mode has an active state and a dormant state; in the hover state, the foldable screen terminal sets the touch mapping mode of the first screen area to the active state.

[0136] Optionally, when the touch mapping mode is active, the touch function of the first screen area is enabled and the display function of the first screen area is disabled, i.e., the first screen area is off. Alternatively, the touch and display functions of the second screen area are both enabled, and the content displayed in the first screen area is different from the application interface displayed in the second screen area.

[0137] In this embodiment, under touch mapping mode, the foldable screen terminal receives touch operations through the first screen area, and the touch operations in the first screen area are mapped to the second screen area. Simply put, the touch functionality of the second screen area is transferred to the first screen area (the touch functionality of the second screen area remains effective), and when a user performs a touch operation on the first screen area, it is equivalent to performing a touch operation on the second screen area.

[0138] After setting the touch mapping mode of the first screen area to active, the user may not control applications through the first screen area for an extended period. To reduce power consumption and prevent accidental touches in the foldable device, the touch mapping mode of the first screen area can be switched to sleep mode, and the user can reactivate it through an activation operation, as follows:

[0139] First, if no touch operation is received on the first screen area within a preset time, the touch mapping mode will be switched from active to sleep mode.

[0140] In one possible implementation, when the touch mapping mode of the first screen area is set to active and no touch operation is received within a preset time, in order to reduce power consumption, the foldable screen terminal switches the touch mapping mode of the first screen area from active to sleep.

[0141] Optionally, when the touch mapping mode is in sleep mode, the touch function of the first screen area is turned off and cannot respond to any touch operation in the first screen area (at this time, the activation operation to activate the touch mapping mode is a non-touch operation); or, the touch function of the first screen is turned on, but can only respond to specific touch operations in the first screen area (such as the activation operation of a specific touch gesture).

[0142] As an illustration, when the first screen area is in touch mapping mode and no touch operation is received within one minute after it is activated, the touch mapping mode switches from the active state to the sleep state.

[0143] Optionally, the preset duration can be set by the system or by the user according to their own habits; this application embodiment does not limit this.

[0144] Second, upon receiving an activation operation for the first screen area, the touch mapping mode is switched from sleep mode to active mode.

[0145] In one possible implementation, in sleep mode, the user cannot control the second screen area by touching the first screen area. When the user wants to control the application displayed on the second screen area by touching the first screen area, the first screen area needs to be activated first, switching the touch mapping mode of the first screen area from sleep mode to active mode.

[0146] Optionally, when the first screen area switches from a dormant state to an active state, a switching screen can be displayed to indicate to the user that the first screen area has been activated; when the first screen area switches from a dormant state to an active state, the first screen area can be displayed as a touchpad background to indicate to the user that the first screen area can be used as a touchpad in this state.

[0147] Optionally, the activation operation for the first screen area is a preset touch gesture within the first screen area, such as double-tap or three-finger swipe. Alternatively, the user can activate the touch mapping mode of the first screen area via voice or a physical button; this embodiment does not limit this approach.

[0148] Optionally, the switching screen and touchpad background can be the default settings of the foldable screen terminal, or they can be set by the user according to their own preferences. This application embodiment does not limit this.

[0149] This is illustrative; please refer to it. Figure 14 When hovering, the second screen area 1402 displays the application interface, while the first screen area 1401 is in sleep mode (screen off). When the user wants to control the application interface through the first screen area 1401, they can double-tap with two fingers to activate it. The activated first screen area 1401 displays touch operation prompts (indicating touch functions for different areas). If the first screen area 1401 does not receive any touch operation within one minute of activation, it will switch back to sleep mode.

[0150] In one possible implementation, the foldable screen terminal displays the application interface in full screen (including landscape and portrait modes) when unfolded, while in the hovered state, the foldable screen terminal only uses the first or second screen area to display the application interface. There is a difference between the two display methods, and the display ratio of the application interface also differs. Therefore, the application interface needs to be processed to adapt to the display requirements in the hovered state. The specific steps are as follows:

[0151] First, obtain the application interface in landscape mode.

[0152] Second, adapt the application interface in landscape mode based on the size of the second screen area to obtain the adapted application interface.

[0153] In one possible implementation, before adapting the application interface in the hover state, the foldable screen terminal obtains the size of the application interface in full-screen display (including landscape and portrait modes), and then adapts the application interface, that is, it scales the application interface proportionally according to the size of the second screen area to obtain an application interface adapted to the second screen area in the hover state, and then displays the adapted application interface in the second screen area.

[0154] In some embodiments, when adapting the application interface, the second screen area of ​​the foldable screen terminal will display an adaptation prompt to remind the user that the foldable screen terminal is switching from the unfolded state to the hovered state and the application interface is undergoing adaptive adjustments.

[0155] Third, the adapted application interface is displayed in the second screen area.

[0156] In one possible implementation, during the hover state, the adapted application interface is displayed in the second screen area, while the application interface is no longer displayed in the first screen area. The foldable screen terminal can control the first screen area to be in a screen-off state or control the first screen area to display a target interface (different from the application's interface). Controlling the first screen area to be in a screen-off state can reduce the power consumption of the foldable screen terminal.

[0157] Optionally, the target interface displayed in the first screen area may include an interface with a preset pattern or a solid color interface; this embodiment of the application does not limit this.

[0158] Indicative, such as Figure 15 As shown, when a user folds a foldable screen terminal in its portrait unfolded state and hovers it, the foldable screen terminal obtains the display size of the application in landscape mode. Then, based on the size of the second screen area 1502, it proportionally scales the application interface in landscape mode to fit the area size of the second screen area 1502. During the adaptation process, the second screen area 1502 displays a prompt screen, indicating to the user that the terminal is adapting the application interface to the hover mode. Once the application interface adaptation is complete, the second screen area 1502 displays the adapted application interface, while the first screen area 1501 remains in a screen-off state.

[0159] Please refer to Figure 16 This diagram illustrates a structural block diagram of an application control device according to an embodiment of this application. The device is used in a foldable screen terminal, where the foldable screen includes a first screen area and a second screen area. The device includes:

[0160] Display module 1601 is used to display the application interface of an application in the second screen area in a hover state, wherein in the hover state, the angle between the first screen area and the second screen area is less than a first angle threshold and greater than a second angle threshold.

[0161] The control module 1602 is used to control the application based on the touch operation when a touch operation is received on the first screen area.

[0162] Optionally, the control module 1602 is used for:

[0163] When a touch operation is received on the first screen area, and the touch operation is located outside the anti-accidental touch area, the application is controlled based on the touch operation. The anti-accidental touch area is located at the edge of the first screen area.

[0164] Optionally, the device further includes:

[0165] A shielding module is used to shield the touch operation when a touch operation is received on the first screen and the touch operation is located within the anti-accidental touch area.

[0166] Optionally, the control module 1602 is further configured to:

[0167] When a touch operation is received on the first screen area and the touch operation is outside the anti-accidental touch area, the target operation type corresponding to the operation area affected by the touch operation is determined. The target operation type is the operation type that supports the response within the operation area.

[0168] If the operation type of the touch operation belongs to the target operation type, the application is controlled based on the touch operation.

[0169] Optionally, the device further includes:

[0170] A shielding module is used to shield the touch operation when the operation type of the touch operation does not belong to the target operation type.

[0171] Optionally, the control module 1602 is further configured to:

[0172] When a touch operation is received on the first screen area, and the touch operation is located outside the anti-accidental touch area and the event shielding area, the application is controlled based on the touch operation. The event shielding area corresponds to the display area of ​​the control in the second screen area.

[0173] Optionally, the device includes:

[0174] A full-screen display module is used to display the application interface of the application in the first screen area and the second screen area in the unfolded state, wherein the angle between the first screen area and the second screen area is greater than the first angle threshold in the unfolded state.

[0175] The display module 1601 is also used for:

[0176] When switching from the expanded state to the hovered state, the application interface of the application is displayed in the second screen area, and the first screen area is controlled to stop displaying the application interface of the application.

[0177] Optionally, the foldable screen terminal further includes an auxiliary display screen, which is independent of the foldable screen;

[0178] The device further includes:

[0179] A foldable display module is used to display the application interface of the application on the auxiliary display screen in a folded state. In the folded state, the auxiliary display screen is exposed, and the angle between the first screen area and the second screen is less than the second angle threshold.

[0180] The display module 1601 is also used for:

[0181] When switching from the folded state to the hovered state, the application interface of the application is displayed in the second screen area, and the auxiliary display screen is controlled to stop displaying the application interface of the application.

[0182] Optionally, the control module 1602 includes:

[0183] The generation unit is used to generate a first touch event based on the touch operation;

[0184] The conversion unit is used to convert the first touch event into a second touch event based on the mapping relationship between the first screen area and the second screen area;

[0185] A control unit for controlling the application based on the second touch event.

[0186] Optionally, the first touch event includes the touch coordinates of the touch operation;

[0187] The conversion unit is used for:

[0188] Based on the mapping relationship between the first screen area and the second screen area, the touch coordinates in the first touch event are transformed, and the second touch event is determined according to the transformed touch coordinates, wherein the transformed touch coordinates are located in the second screen area.

[0189] Optionally, the first screen area has a touch mapping mode, in which touch operations of the first screen area are mapped to the second screen area to realize control of the application based on touch operations of the first screen area; the device further includes:

[0190] The setting module is used to set the touch mapping mode of the first screen area to an active state in the hover state.

[0191] Optionally, the device further includes:

[0192] The first switching module is used to switch the touch mapping mode from active state to sleep state if no touch operation is received on the first screen area within a preset time period.

[0193] Optionally, the device further includes:

[0194] The second switching module is used to switch the touch mapping mode from a dormant state to an active state when an activation operation is received for the first screen area.

[0195] Optionally, the display module 1601 is used for:

[0196] Obtain the application interface in landscape mode;

[0197] Based on the size of the second screen area, the application interface in landscape mode is adapted to obtain the adapted application interface.

[0198] The adapted application interface is displayed in the second screen area.

[0199] Optionally, in the hover state, the first screen area is in a screen-off state; or, a target interface is displayed, which is different from the application interface.

[0200] Optionally, the first screen area is the screen area in a flat position during the hovering state, and the second screen area is the screen area in a portrait position during the hovering state.

[0201] Optionally, the display module 1601 is further configured to:

[0202] When the first screen area is switched to portrait mode and the second screen area is switched to flat mode, the application interface of the application is displayed in the first screen area.

[0203] The control module 1602 is further configured to control the application based on the touch operation when a touch operation on the second screen area is received.

[0204] Optionally, the application is a multimedia application;

[0205] The control module 1602 includes:

[0206] A first control unit is configured to, upon receiving a horizontal swipe operation on the first screen area, control the multimedia playback progress of the multimedia application based on the swipe direction and swipe distance of the horizontal swipe operation; or,

[0207] The second control unit is configured to, upon receiving a vertical swipe operation on the first screen area, control the multimedia playback parameters of the multimedia application based on the swipe direction and swipe distance of the vertical swipe operation, wherein the multimedia playback parameters include at least one of playback volume or display brightness; or,

[0208] A third control unit is configured to, upon receiving a click operation on the first screen area, control the multimedia state based on the click operation, wherein the multimedia state includes a playback state and a pause state; or...

[0209] The fourth control unit is used to control the multimedia playback speed based on the long press operation when a long press operation is received on the first screen area.

[0210] In summary, in this embodiment, when the foldable screen terminal is in a hovering state, the application interface of the terminal control application is only displayed in the second screen area, and receives touch operations applied to the first screen area, thereby controlling the application displayed in the second screen area based on the touch operation. Using the solution provided in this embodiment, users do not need to perform touch operations on the screen area displaying the application interface to achieve application control, improving the flexibility of application control. Furthermore, compared to directly performing touch operations in the second screen area, performing touch operations in the first screen area helps improve the stability of the foldable screen terminal in the hovering state and reduces the probability of the foldable screen terminal tipping over during touch operations.

[0211] This application also provides a computer-readable medium storing at least one instruction, which is loaded and executed by a processor to implement the application control method described in the above embodiments.

[0212] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the application control method provided above.

[0213] Those skilled in the art will recognize that the functions described in the embodiments of this application in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0214] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. An application control method, characterized in that, The method is used in a foldable screen terminal, wherein the foldable screen of the foldable screen terminal includes a first screen area and a second screen area, and the method includes: In the hover state, the application interface of the application is displayed in the second screen area. In the hover state, the angle between the first screen area and the second screen area is less than a first angle threshold and greater than a second angle threshold, and the application interface is not displayed in the first screen area. When a touch operation is received on the first screen area, and the touch operation is located outside the anti-accidental touch area and the event shielding area, the application is controlled based on the touch operation. The event shielding area is a dynamic area, and the event shielding area is mapped from the touch area corresponding to the control in the second screen area. Touch operations within the event shielding area are shielded.

2. The method according to claim 1, characterized in that, The method further includes: When a touch operation is received on the first screen area, and the touch operation is located outside the anti-accidental touch area, the application is controlled based on the touch operation. The anti-accidental touch area is located at the edge of the first screen area.

3. The method according to claim 2, characterized in that, The method further includes: If a touch operation is received on the first screen and the touch operation is located within the anti-accidental touch area, the touch operation is blocked.

4. The method according to claim 2, characterized in that, The step of controlling the application based on the touch operation when a touch operation is received on the first screen area and the touch operation is outside the anti-mistouch area includes: When a touch operation is received on the first screen area and the touch operation is outside the anti-accidental touch area, the target operation type corresponding to the operation area affected by the touch operation is determined. The target operation type is the operation type that supports the response within the operation area. If the operation type of the touch operation belongs to the target operation type, the application is controlled based on the touch operation.

5. The method according to claim 4, characterized in that, The method further includes: If the operation type of the touch operation does not belong to the target operation type, the touch operation is blocked.

6. The method according to any one of claims 1 to 5, characterized in that, The method includes: In the expanded state, the application interface of the application is displayed in the first screen area and the second screen area, and in the expanded state, the angle between the first screen area and the second screen area is greater than the first angle threshold. In the hover state, the application interface is displayed in the second screen area, including: When switching from the expanded state to the hovered state, the application interface of the application is displayed in the second screen area, and the first screen area is controlled to stop displaying the application interface of the application.

7. The method according to any one of claims 1 to 5, characterized in that, The foldable screen terminal also includes an auxiliary display screen, which is independent of the foldable screen; The method includes: In the folded state, the application interface of the application is displayed on the secondary display screen. In the folded state, the secondary display screen is exposed, and the angle between the first screen area and the second screen is less than the second angle threshold. In the hover state, the application interface is displayed in the second screen area, including: When switching from the folded state to the hovered state, the application interface of the application is displayed in the second screen area, and the auxiliary display screen is controlled to stop displaying the application interface of the application.

8. The method according to any one of claims 1 to 5, characterized in that, The control of the application based on the touch operation includes: A first touch event is generated based on the touch operation; Based on the mapping relationship between the first screen area and the second screen area, the first touch event is converted into a second touch event; The application is controlled based on the second touch event.

9. The method according to claim 8, characterized in that, The first touch event includes the touch coordinates of the touch operation; The step of converting the first touch event into a second touch event based on the mapping relationship between the first screen area and the second screen area includes: Based on the mapping relationship between the first screen area and the second screen area, the touch coordinates in the first touch event are transformed, and the second touch event is determined according to the transformed touch coordinates, wherein the transformed touch coordinates are located in the second screen area.

10. The method according to any one of claims 1 to 5, characterized in that, The first screen area has a touch mapping mode, in which touch operations of the first screen area are mapped to the second screen area to realize control of the application based on touch operations of the first screen area; the method further includes: In the hover state, the touch mapping mode of the first screen area is set to active.

11. The method according to claim 10, characterized in that, After setting the touch mapping mode of the first screen area to an active state, the method further includes: If no touch operation is received on the first screen area within a preset time period, the touch mapping mode is switched from active state to sleep state.

12. The method according to claim 11, characterized in that, After switching the touch mapping mode from active to sleep state, the method further includes: Upon receiving an activation operation for the first screen area, the touch mapping mode is switched from sleep mode to active mode.

13. The method according to any one of claims 1 to 5, characterized in that, Displaying the application interface in the second screen area includes: Obtain the application interface in landscape mode; Based on the size of the second screen area, the application interface in landscape mode is adapted to obtain the adapted application interface. The adapted application interface is displayed in the second screen area.

14. The method according to any one of claims 1 to 5, characterized in that, In the hover state, the first screen area is in a screen-off state; or, a target interface is displayed, which is different from the application interface.

15. The method according to any one of claims 1 to 5, characterized in that, The first screen area is the screen area in a flat position during the hovering state, and the second screen area is the screen area in a portrait position during the hovering state.

16. The method according to claim 15, characterized in that, The method further includes: When the first screen area is switched to portrait mode and the second screen area is switched to flat mode, the application interface of the application is displayed in the first screen area. Upon receiving a touch operation on the second screen area, the application is controlled based on the touch operation.

17. The method according to any one of claims 1 to 5, characterized in that, The application is a multimedia application; The control of the application based on the touch operation includes: Upon receiving a horizontal swipe operation on the first screen area, the multimedia playback progress of the multimedia application is controlled based on the swipe direction and swipe distance; or, Upon receiving a vertical swipe operation on the first screen area, the multimedia playback parameters of the multimedia application are controlled based on the swipe direction and swipe distance of the vertical swipe operation. These multimedia playback parameters include at least one of playback volume or display brightness; or... Upon receiving a click operation on the first screen area, the multimedia state is controlled based on the click operation, the multimedia state including a playback state and a pause state; or... Upon receiving a long press operation on the first screen area, the multimedia playback speed is controlled based on the long press operation.

18. An application control device, characterized in that, The device is used in a foldable screen terminal, wherein the foldable screen of the foldable screen terminal includes a first screen area and a second screen area, and the device includes: The display module is used to display the application interface of the application in the second screen area in the hover state, wherein in the hover state, the angle between the first screen area and the second screen area is less than a first angle threshold and greater than a second angle threshold, and the application interface is not displayed in the first screen area. The control module is used to control the application based on the touch operation when it receives a touch operation on the first screen area, and the touch operation is located outside the anti-accidental touch area and the event shielding area. The event shielding area is a dynamic area and is mapped by the touch area corresponding to the control in the second screen area. Touch operations within the event shielding area are shielded.

19. A terminal, characterized in that, The terminal includes a processor and a memory; the memory stores at least one instruction, which is executed by the processor to implement the application control method as described in any one of claims 1 to 17.

20. A computer-readable storage medium, characterized in that, The storage medium stores at least one instruction, which is executed by a processor to implement the application control method as described in any one of claims 1 to 17.

21. A computer program product, characterized in that, The computer program product includes computer instructions stored in a computer-readable storage medium; a processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions to cause the computer device to implement the application control method as described in any one of claims 1 to 17.

Citation Information

Patent Citations

  • Electronic device touch control interaction method

    CN108459790A

  • Display method of flexible screen and electronic equipment

    CN110389802A