Interaction method and electronic equipment
By setting a sensing area on the side bezel of electronic devices to recognize swipe gestures, it enables convenient switching between various display modes and functions, solving the problem of inconvenient operation on large-size displays and improving the user experience.
Patent Information
- Application Number
- CN202410608777.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-15
- Publication Date
- 2025-11-18
AI Technical Summary
Existing electronic devices lack ease of use, especially on large-screen displays, making it difficult for users to efficiently switch interfaces and operate functions.
By setting a sensing area on the side bezel of the electronic device, the system can recognize the user's swipe gestures, adjust the size and mode of the display interface, support switching between multiple display modes, including full screen, floating window, floating card and floating ball modes, and support screenshot, scrolling, zooming and quick menu operations.
It enhances the ease of user operation, enabling interface mode switching, application switching, screenshotting, and function triggering through simple gesture operations, thus meeting diverse user needs.
Smart Images

Figure CN120973279A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to an interaction method and electronic device. Background Technology
[0002] With the continuous development of terminal technology, portable terminals such as mobile phones and tablets have become indispensable electronic devices in people's daily lives and work.
[0003] Today, electronic devices offer increasingly sophisticated functions, and people use them in more and more scenarios. Consequently, people desire more convenient and efficient interaction with these devices. Therefore, improving the ease of use for users is a pressing technical challenge. Summary of the Invention
[0004] In view of this, this application provides an interaction method and an electronic device to improve the convenience of user operation.
[0005] To achieve the above objectives, in a first aspect, embodiments of this application provide an interaction method applied to an electronic device, wherein a sensing area is provided on the side frame of the electronic device, and the method includes:
[0006] Display the first display interface;
[0007] In response to a sliding operation applied to the sensing area, the size of the first display interface is adjusted.
[0008] The first display interface can be any interface displayed on an electronic device, such as various application interfaces.
[0009] The interaction method provided in this application embodiment allows electronic devices to recognize user swiping gestures through a sensing area on the side bezel, adjust the size of the display interface, and enable users to conveniently use some functions through the touch sensing area, thereby improving the ease of user operation.
[0010] In one possible implementation of the first aspect, adjusting the interface size of the first display interface in response to a sliding operation acting on the sensing area includes:
[0011] In response to a first sliding operation applied to the sensing area, the first application interface is switched from a first display mode to a second display mode; the window size of the second display mode is smaller than that of the first display mode, and the second display mode is a floating display mode.
[0012] Through the above implementation method, users can conveniently switch the display mode of the application interface by inputting a swipe operation in the sensing area, thereby improving the convenience of user operation.
[0013] In one possible implementation of the first aspect, the method further includes:
[0014] In response to a second sliding operation applied to the sensing area, the first application interface is switched from the second display mode to the first display mode; the second sliding operation is in the opposite direction to the first sliding operation.
[0015] Through the above implementation method, users can easily restore the display mode of the application interface after switching the display mode by inputting a swipe operation in the sensing area, thereby further improving the convenience of user operation.
[0016] In one possible implementation of the first aspect, the method further includes:
[0017] In response to a third sliding operation applied to the sensing area, if there is no application interface in the floating display mode, the displayed second application interface will be switched to the third application interface; the third application interface is the application interface of the recently running task, and the sliding direction of the third sliding operation is opposite to that of the first sliding operation.
[0018] In response to the fourth sliding operation applied to the sensing area, if there is no application interface whose window size can be reduced, the display interface will be switched to the fourth application interface; the fourth application interface is the application interface of the recently running task, and the sliding direction of the fourth sliding operation is the same as that of the first sliding operation.
[0019] Through the above implementation method, users can switch the application interface display mode and the application interface by inputting a sliding operation in the sensing area, thereby further improving the convenience of user operation.
[0020] In one possible implementation of the first aspect, the floating display mode includes multiple modes, and the window sizes of the various floating display modes are different from each other; the first display mode is either a full-screen display mode or a floating display mode.
[0021] Through the above implementation method, users can switch between more display modes by inputting a sliding operation in the sensing area, thereby further improving the convenience of user operation.
[0022] In one possible implementation of the first aspect, the first application interface gradually switches to a second display mode among multiple floating display modes, wherein the window size of the first application interface decreases as the sliding distance of the first sliding operation increases.
[0023] Through the above implementation method, users can switch between multiple display modes continuously with a single swipe, thereby further improving the convenience of user operation.
[0024] In one possible implementation of the first aspect, the floating display mode includes any one or more of the following: floating window mode, floating card mode, and floating ball mode.
[0025] In one possible implementation of the first aspect, the first sliding operation slides along the thickness direction of the side frame. This is more in line with user habits and thus more convenient for users to use.
[0026] In one possible implementation of the first aspect, the method further includes:
[0027] In response to the fifth swipe operation applied to the sensing area, the content of the fifth application interface in the screenshot state is scrolled to perform a scrolling screenshot of the fifth application interface.
[0028] Through the above implementation method, users can conveniently trigger the scrolling screenshot function by inputting a swipe operation in the sensing area, thereby improving the convenience of user operation.
[0029] In one possible implementation of the first aspect, the fifth swipe operation slides along the length of the side border, and the screenshot distance of the fifth application interface is related to the swipe distance of the fifth swipe operation.
[0030] In the above embodiments, the fifth swipe operation slides along the length of the side border, which better conforms to user habits and makes it more convenient for users to use. The scroll distance of the fifth application interface is related to the swipe distance of the fifth swipe operation, allowing users to easily control the scroll distance of the application interface.
[0031] In one possible implementation of the first aspect, the method further includes:
[0032] In response to the sixth swipe operation applied to the sensing area, adjust the selection range of the screenshot box in the screenshot application interface.
[0033] Through the above implementation method, users can conveniently adjust the selection range of the screenshot application interface by inputting a sliding operation in the sensing area, thereby improving the convenience of user operation.
[0034] In one possible implementation of the first aspect, the method further includes:
[0035] In response to the seventh sliding operation applied to the sensing area, the interface content in the sixth application interface is zoomed in or zoomed out.
[0036] Through the above implementation method, users can easily zoom in and out of the screenshot application interface by inputting a swipe operation in the sensing area, thereby improving the convenience of user operation.
[0037] In one possible implementation of the first aspect, the method further includes:
[0038] In response to the eighth sliding operation applied to the sensing area, the viewing angle of the screen displayed in the seventh application interface is adjusted.
[0039] Through the above implementation method, users can conveniently adjust the screen angle of the application interface by inputting a sliding operation in the sensing area, thereby improving the convenience of user operation.
[0040] In one possible implementation of the first aspect, the method further includes:
[0041] In response to the ninth swipe operation applied to the sensing area, the size and content of the display areas of the eighth and ninth application interfaces in the split-screen display are adjusted.
[0042] Through the above implementation method, users can conveniently adjust the size of the application interface by inputting a sliding operation in the sensing area, thereby improving the convenience of user operation.
[0043] In one possible implementation of the first aspect, the method further includes:
[0044] In response to a first touch operation applied to the sensing area, a target control operation is executed; the target control operation includes launching a target application or a target function.
[0045] Through the above implementation method, users can quickly launch applications or functions by inputting touch operations in the sensing area, thereby further improving the convenience of user operation.
[0046] In one possible implementation of the first aspect, the method further includes:
[0047] In response to the setting operation, the mapping relationship between the first touch operation and the target control operation is set.
[0048] The above implementation methods allow users to set up applications or functions that can be launched quickly, thus improving the flexibility of user experience.
[0049] In one possible implementation of the first aspect, the first touch operation is a double-touch operation.
[0050] In one possible implementation of the first aspect, the method further includes:
[0051] In response to a second touch operation applied to the sensing area, a shortcut menu interface is displayed; the shortcut menu interface includes any one or more of the following controls: at least one application icon corresponding to an application, and at least one function icon corresponding to a function.
[0052] In response to the tenth swipe operation applied to the sensing area, switch the target control selected in the shortcut menu interface;
[0053] In response to a third touch operation applied to the sensing area, the control operation corresponding to the target control is executed.
[0054] Through the above implementation method, users can conveniently open some commonly used applications or functions by inputting touch operations in the sensing area, thereby further improving the convenience of user operation.
[0055] In one possible implementation of the first aspect, the shortcut menu interface further includes any one or more of the following controls:
[0056] The close control is used to close the shortcut menu interface;
[0057] The edit control is used to trigger the shortcut menu interface to enter the editable state. In the editable state, the shortcut menu interface can respond to any one or more of the following operations: adding an application icon or function icon, moving an application icon or function icon, or deleting an application icon or function icon.
[0058] The above implementation methods can improve the flexibility and convenience of user operation.
[0059] In one possible implementation of the first aspect, the second touch operation is a long press operation, and the third touch operation is a single click operation.
[0060] In one possible implementation of the first aspect, the sensing area is a fingerprint sensing area. This can reduce the structural complexity of the electronic device and save costs.
[0061] Secondly, embodiments of this application provide an interactive device applied to an electronic device, wherein a sensing area is provided on the side frame of the electronic device, and the device includes: an input module, a processing module, and a display module;
[0062] The input module is used to receive operations applied to the sensing area;
[0063] The processing module is used to control the interface content of the application interface displayed by the display module in response to the sliding operation applied to the sensing area.
[0064] In one possible implementation of the second aspect, the processing module is specifically used for:
[0065] In response to a first sliding operation applied to the sensing area, the display module is controlled to switch the first application interface from a first display mode to a second display mode; the window size of the second display mode is smaller than the window size of the first display mode, and the second display mode is a floating display mode.
[0066] In one possible implementation of the second aspect, the processing module is further configured to:
[0067] In response to a second sliding operation applied to the sensing area, the display module is controlled to switch the first application interface from the second display mode to the first display mode; the second sliding operation is in the opposite direction to the first sliding operation.
[0068] In one possible implementation of the second aspect, the processing module is further configured to:
[0069] In response to a third sliding operation applied to the sensing area, if there is no application interface in the floating display mode, the display module is controlled to switch the displayed second application interface to a third application interface; the third application interface is the application interface of the recently running task, and the sliding direction of the third sliding operation is opposite to that of the first sliding operation.
[0070] In response to a fourth sliding operation applied to the sensing area, if there is no application interface with a shrinkable window size, the display module is controlled to switch the display interface to a fourth application interface; the fourth application interface is the application interface of the recently running task, and the fourth sliding operation has the same sliding direction as the first sliding operation.
[0071] In one possible implementation of the second aspect, the floating display mode includes multiple modes, and the window sizes of the various floating display modes are different; the first display mode is a full-screen display mode or a floating display mode.
[0072] In one possible implementation of the second aspect, the first application interface gradually switches to the second display mode among multiple floating display modes, wherein the window size of the first application interface decreases as the sliding distance of the first sliding operation increases.
[0073] In one possible implementation of the second aspect, the floating display mode includes any one or more of the following: floating window mode, floating card mode, and floating ball mode.
[0074] In one possible implementation of the second aspect, the first sliding operation slides along the thickness direction of the side frame.
[0075] In one possible implementation of the second aspect, the processing module is further configured to:
[0076] In response to a fifth sliding operation applied to the sensing area, the display module is controlled to scroll the content of the fifth application interface in the screenshot state, and a scrolling screenshot of the fifth application interface is performed.
[0077] In one possible implementation of the second aspect, the fifth swipe operation slides along the length direction of the side frame, and the screenshot distance of the fifth application interface is related to the swipe distance of the fifth swipe operation.
[0078] In one possible implementation of the second aspect, the processing module is further configured to:
[0079] In response to a sixth sliding operation applied to the sensing area, the display module is controlled to adjust the selection range of the screenshot box in the screenshot application interface.
[0080] In one possible implementation of the second aspect, the processing module is further configured to:
[0081] In response to a seventh sliding operation applied to the sensing area, the display module is controlled to zoom in or out on the interface content of the sixth application interface.
[0082] In one possible implementation of the second aspect, the processing module is further configured to:
[0083] In response to an eighth sliding operation applied to the sensing area, the display module is controlled to adjust the viewing angle of the screen displayed in the seventh application interface.
[0084] In one possible implementation of the second aspect, the processing module is further configured to:
[0085] In response to a ninth sliding operation applied to the sensing area, the display module is controlled to adjust the size and content of the display areas of the eighth and ninth application interfaces displayed in the split screen.
[0086] In one possible implementation of the second aspect, the processing module is further configured to:
[0087] In response to a first touch operation applied to the sensing area, a target control operation is performed; the target control operation includes launching a target application or a target function.
[0088] In one possible implementation of the second aspect, the processing module is further configured to:
[0089] In response to the setting operation, the correspondence between the first touch operation and the target control operation is set.
[0090] In one possible implementation of the second aspect, the first touch operation is a double-click operation.
[0091] In one possible implementation of the second aspect, the processing module is further configured to:
[0092] In response to a second touch operation applied to the sensing area, the display module is controlled to display a shortcut menu interface; the shortcut menu interface includes any one or more of the following controls: at least one application icon corresponding to an application, and at least one function icon corresponding to a function.
[0093] In response to a tenth sliding operation applied to the sensing area, the display module is controlled to switch to the target control selected in the shortcut menu interface;
[0094] In response to a third touch operation applied to the sensing area, the control operation corresponding to the target control is executed.
[0095] In one possible implementation of the second aspect, the shortcut menu interface further includes any one or more of the following controls:
[0096] The close control is used to close the shortcut menu interface;
[0097] An editing control is used to trigger the shortcut menu interface to enter an editable state. In the editable state, the shortcut menu interface can respond to any one or more of the following operations: adding an application icon or function icon, moving an application icon or function icon, or deleting an application icon or function icon.
[0098] In one possible implementation of the second aspect, the second touch operation is a long press operation, and the third touch operation is a single click operation.
[0099] In one possible implementation of the second aspect, the sensing area is a fingerprint sensing area.
[0100] Thirdly, embodiments of this application provide an electronic device, including: a memory and a processor, wherein the memory is used to store a computer program; and the processor is used to execute the method described in the first aspect or any embodiment of the first aspect when the computer program is invoked.
[0101] Fourthly, embodiments of this application provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described in the first aspect or any embodiment of the first aspect.
[0102] Fifthly, embodiments of this application provide a computer program product that, when run on an electronic device, causes the electronic device to perform the method described in the first aspect or any embodiment of the first aspect.
[0103] Sixthly, embodiments of this application provide a chip system including a processor coupled to a memory. The processor executes a computer program stored in the memory to implement the method described in the first aspect or any embodiment thereof. The chip system may be a single chip or a chip module composed of multiple chips.
[0104] It is understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description
[0105] Figure 1 and Figure 2 Some structural schematic diagrams of the electronic device provided in the embodiments of this application;
[0106] Figure 3 A flowchart illustrating the interaction method provided in an embodiment of this application;
[0107] Figures 4-20 Some user interface diagrams provided for embodiments of this application;
[0108] Figure 21 This is a schematic diagram of the structure of the interactive device provided in the embodiments of this application;
[0109] Figure 22 A schematic diagram of the system architecture of the electronic device provided in the embodiments of this application;
[0110] Figure 23 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation
[0111] The embodiments of this application are described below with reference to the accompanying drawings. The terminology used in the implementation section of this application is only for explaining specific embodiments and is not intended to limit the application. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.
[0112] As electronic devices become increasingly feature-rich, people are using them in more and more scenarios, and consequently, they hope that their interactions with these devices can be more convenient and efficient.
[0113] Currently, the displays of portable electronic devices such as mobile phones are gradually moving towards larger screens. While larger screen sizes can provide users with a better visual experience, they can also negatively impact the ease of operation.
[0114] Based on this, this application provides an interaction scheme in which the electronic device can recognize the user's gesture operation through the sensing area on the side frame and trigger the corresponding application function, so that the user can conveniently use some application functions through the touch sensing area, thereby improving the convenience of user operation.
[0115] The aforementioned electronic devices may be mobile phones, tablets, or smart wearable devices, etc. This application does not specifically limit the type of terminal device. For ease of explanation, this application will use a mobile phone as an example for illustrative purposes.
[0116] Figure 1 An exemplary schematic diagram of the structure of the electronic device provided in an embodiment of this application is shown, such as... Figure 1 As shown, the electronic device includes: a display screen 01, a back cover 02, and a side frame 03, wherein the display screen 01 is disposed on one side of the side frame 03, and the back cover 02 is disposed on the other side of the side frame 03.
[0117] The electronic device may also include a middle plate (not shown) located in the receiving space enclosed by the side frame 03, the display screen 01 and the back cover 02. Circuit boards and batteries may be installed on the middle plate. Various components such as processors, memory, cameras, speakers, receivers, microphones, indicators and sensors may be installed on the circuit boards.
[0118] The display screen 01 is used to realize the display function of the terminal device. It can be a curved screen or a non-curved screen. The back cover 02 and the side frame 03 can be an integrated structure or a separate structure.
[0119] The side border 03 may include a left border and a right border that are set opposite to each other, as well as a top border and a bottom border that connect the left border and the right border; the borders are connected to each other to form a square structure, and a certain curvature or chamfer may be formed at the connection point.
[0120] A sensing area 04 can be set on the side frame 03. The electronic device can collect the user's touch information and recognize the user's gesture operations through the sensing area 04. Specifically, the electronic device can recognize the user's gesture operations based on the characteristics such as the position, duration, and number of touches of the continuously collected touch information. Among them, gesture operations can include: click operations (also known as short touch operations), long press operations (also known as long touch operations), and swipe operations; click operations can include single click operations and multi-click operations.
[0121] In some embodiments, the sensing area 04 may specifically be the fingerprint sensing area of the electronic device, that is, the fingerprint sensing area can be reused, which can reduce the structural complexity of the electronic device and save costs.
[0122] In some scenarios, electronic devices can collect a user's fingerprint information through the fingerprint sensor area for fingerprint verification or gesture recognition. For example, when the screen is locked, a user can touch the fingerprint sensor area, and the electronic device can compare the collected fingerprint information with the user's registered fingerprint information to verify the user's identity and unlock the device.
[0123] In some scenarios, after a user touches the fingerprint sensor area, the electronic device can recognize the user's gesture based on features such as the location, duration, and number of touches of the continuously collected fingerprint information. Examples include click, long press, and swipe gestures, as mentioned above.
[0124] Among them, the sensing area 04 can be located in the upper middle part of the right frame, for reference. Figure 2 The image shows a right view of the electronic device, as shown below. Figure 2 As shown, the sensing area 04 can be elongated, and users can input fingerprint information or perform the above gesture operations on the sensing area 04.
[0125] It should be noted that, Figure 2 The image mainly shows the sensing area 04. Other structures, such as the power button and volume buttons, may also be included on the right side frame of the electronic device.
[0126] Specifically, the swiping operations input by the user in the sensing area can include: up-and-down swiping operations and forward-and-backward swiping operations. The up-and-down swiping operation slides along the length of the side frame 03, specifically including an up swipe (i.e., swiping upwards) and a down swipe (i.e., swiping downwards). The forward-and-backward swiping operation slides along the thickness of the side frame 03, specifically including a forward swipe and a backward swipe. It is understood that the up-and-down swiping operation described here is based on user operation in portrait mode on an electronic device. When the electronic device is in landscape mode, the swiping operation along the length of the side frame 03 is the left-and-right swiping operation. For ease of explanation, this embodiment mainly uses the up-and-down swiping operation as an example. Those skilled in the art will understand that when the electronic device is in landscape mode, the up-and-down swiping operation described herein can be replaced with the left-and-right swiping operation.
[0127] The sensing area 04 can be located on the power button or independently of it; the sensing area 04 can be located on a physical button or formed on a virtual button. The above description uses the example of the sensing area 04 being located on the right frame. It is understood that in some embodiments, the sensing area 04 can also be located on other frames. For ease of explanation, the embodiments of this application use the example of the sensing area 04 being located on the right frame for illustrative purposes.
[0128] In this embodiment, the user can input gestures through the sensing area 04 to trigger the electronic device to perform corresponding control operations. The interaction scheme is described in detail below.
[0129] Figure 3 A flowchart illustrating the interaction method provided in the embodiments of this application is shown below. Figure 3 As shown, the interaction method provided in this application embodiment may include the following steps:
[0130] S110, responding to a sliding operation applied to the sensing area, controls the content of the displayed application interface.
[0131] Specifically, when an electronic device is displaying an application interface, the user can input up / down or forward / backward swipes on the sensing area to trigger the electronic device to control the content of the currently displayed application interface. The following sections illustrate some possible implementation methods for electronic devices to control application interfaces, using various application scenarios as examples.
[0132] Scenario 1.1: Switching the display mode of the application interface
[0133] In some embodiments, when an electronic device displays an application interface, it can switch the display mode of the application interface in response to a swipe operation input by the user in the sensing area.
[0134] The application interface can be displayed in two modes: full-screen mode and floating mode. The floating mode can include one or more of the following: floating window mode, floating card mode, and floating ball mode.
[0135] In full-screen mode, the application interface is maximized to fill the entire desktop.
[0136] In floating window mode, the application interface is displayed in a floating window, and the size of the floating window is smaller than the size of the window containing the application interface in full-screen mode.
[0137] In floating card mode, the application interface is displayed in a floating card, which can be smaller than the floating window containing the application interface in floating window mode. In some implementations, the floating card can display a thumbnail of the application interface; in others, it can display key information extracted from the application interface.
[0138] In floating ball mode, the application interface is hidden and displayed as a floating ball, which is smaller than the floating card. The floating ball can display the application icon, the application name, or both the application icon and name, etc.
[0139] In some embodiments, the electronic device may switch the first application interface to a second display mode in response to a first swipe operation input by the user in the sensing area.
[0140] In some embodiments, the electronic device may also respond to a second swipe operation input by the user in the sensing area to switch the first application interface from the second display mode back to the first display mode.
[0141] In this display mode, the window size is smaller than that of the first display mode, and the second sliding operation is in the opposite direction to the first sliding operation. The first application interface can be any application interface that supports floating display mode.
[0142] The first and second swipe operations can be vertical swipes or horizontal swipes, which are more in line with user habits and thus more convenient for users. The horizontal swipe operation can be either a forward swipe or a backward swipe operation; the following explanation will use an example where the first swipe operation is a backward swipe and the second swipe operation is a forward swipe operation.
[0143] As an optional implementation, the electronic device can respond to a user's swipe gesture in the sensing area, switching the first application interface between a full-screen display mode and a certain floating display mode. That is, the first display mode is a full-screen display mode, and the second display mode is a floating display mode.
[0144] The floating display mode can be any of the following: floating window mode, floating card mode, and floating ball mode.
[0145] For example, such as Figure 4 As shown in (a), the memo application interface 11 is displayed in full screen on the electronic device. After the user inputs a backward swipe operation in the sensing area, as shown in (a), Figure 4 As shown in (b), the electronic device can respond to this operation by retracting the Notes application interface 11 into the floating ball 12, that is, switching the Notes application interface 11 into floating ball mode. The floating ball 12 can display the icon of the Notes application to indicate the retracted application interface.
[0146] After the electronic device retracts the Notes app interface 11 into the floating ball 12, when the user wants to reopen the Notes app interface 11, they can input a forward swipe operation in the sensing area, such as... Figure 4 As shown in (c), the electronic device can respond to this operation by restoring the collapsed memo application interface 11 to full-screen display mode.
[0147] As an alternative implementation, the electronic device can respond to a user's swipe gesture in the sensing area, switching the first application interface between full-screen display mode and various floating display modes. That is, the first display mode can be full-screen display mode, and the second display mode can be floating display mode; or both the first and second display modes can be floating display modes.
[0148] The floating display mode can include several of the floating window mode, floating card mode, and floating ball mode mentioned above.
[0149] Taking the floating display mode, which includes floating window mode and floating ball mode, as an example, the electronic device can respond to the user's swiping operation input in the sensing area and switch the first application interface from one of the display modes of full-screen display mode, floating window mode and floating ball mode to another display mode.
[0150] In some embodiments, the display modes are sorted according to the window size, and the electronic device can respond to the above-described sliding operation to switch the first application interface between two adjacent display modes.
[0151] For example, such as Figure 5 As shown in (a), the memo application interface 11 is displayed in full screen on the electronic device. After the user inputs a backward swipe operation in the sensing area, as shown in (a), Figure 5 As shown in (b), the electronic device can respond to this operation by shrinking the memo application interface 11 into a floating window 13 for display, that is, switching the memo application interface 11 to floating window mode. After the user inputs a backward swipe operation again in the sensing area, as shown in (b), the electronic device can respond to this operation by shrinking the memo application interface 11 into a floating window 13 for display, that is, switching the memo application interface 11 into floating window mode. Figure 5 As shown in (c), the electronic device can respond to this operation by retracting the memo application interface 11 into the floating ball 12.
[0152] After the electronic device retracts the Notes app interface 11 into the floating ball 12, when the user wants to reopen the Notes app interface 11, they can input a forward swipe operation in the sensing area, such as... Figure 5 As shown in (d), the electronic device can respond to this operation by displaying the collapsed memo application interface 11 in the floating window 13. If the user wants to expand the memo application interface 11 again, they can input a forward swipe operation again in the sensing area, such as... Figure 5 As shown in (e), the electronic device can respond to this operation by displaying the memo application interface 11 in full screen.
[0153] In some embodiments, the electronic device may also switch display modes based on the sliding distance of the user's sliding operation input in the sensing area, allowing the user to switch continuously between multiple display modes with a single sliding operation.
[0154] That is, during the process of switching the first application interface from the first display mode to the second display mode, the first application interface can gradually switch to the second display mode in multiple floating display modes. As the sliding distance of the first swipe operation increases, the window size of the first application interface becomes smaller.
[0155] Similarly, during the process of switching the first application interface from the second display mode to the first display mode, the first application interface can gradually switch to the first display mode from multiple floating display modes. As the sliding distance of the second sliding operation increases, the window size of the first application interface becomes larger.
[0156] In some examples, the window size of the application interface 11 can change with the sliding distance of the swipe operation. For example, when a user's finger performs a swipe operation (e.g., a backward swipe) on the sensing area, the larger the user's swipe distance, the smaller the window size of the application interface 11 becomes. For example, as shown in the example... Figure 6 As shown in (a), the memo application interface 11 is displayed in full screen on the electronic device. When the user slides backward in the sensing area, the effect increases with the distance the user slides, such as... Figure 6 As shown in (b), the smaller the window size of the application interface 11, the more the application interface 11 shrinks to a floating window, such as Figure 6 As shown in (c), the memo application interface 11 can be displayed via a floating window 13, at which point the memo application interface 11 can be switched to floating window mode. When the user continues to slide their finger backward on the sensing area, as shown in (c), the memo application interface 11 can be displayed via a floating window 13. Figure 6 As shown in (d), as the user's swipe distance increases, the electronic device can continue to shrink the floating window 13, that is, continue to shrink the memo application interface 11; when the application interface 11 shrinks to the floating ball, as shown in (d), the floating window 13 continues to shrink, i.e., the memo application interface 11 continues to shrink. Figure 6 As shown in (e), the memo application interface 11 can be tucked into the floating ball 12.
[0157] When a user slides their finger across the sensing area (e.g., swiping forward), the larger the swipe distance, the larger the window size of the application interface 11 becomes. For example, as shown... Figure 6 As shown in (e), when the memo application interface 11 retracts to the floating ball 12, and the user slides their finger forward over the sensing area, the larger the sliding distance, the larger the window size of the application interface 11. When the application interface 11 is enlarged to the size of a floating window, as shown in (e), the window size increases. Figure 6 As shown in (f), the Notes application interface 11 can be displayed via a floating window 13, at which point the Notes application interface 11 can be switched to floating window mode. When the user's finger continues to slide backward and forward on the sensing area, as shown in (f), Figure 6As shown in (g), the electronic device can continue to zoom in on the floating window 13 as the user's swipe distance increases, that is, continue to zoom in on the memo application interface 11; when the memo application interface 11 is zoomed in to full screen, as shown in (g), the floating window 13 can be zoomed in further. Figure 6 As shown in (h), the memo application interface 11 can be displayed in full screen.
[0158] Among them, such as Figure 6 As shown in (b), if the user releases their finger and ends the swipe operation when the Notes application interface 11 is not switched to floating window mode, the electronic device can restore the Notes application interface 11 to full-screen display mode.
[0159] In some embodiments, the electronic device may not display the window change process from full-screen display mode to floating window mode. That is, when the sliding distance of the above-mentioned backward sliding operation does not reach the first distance, the full-screen display of the memo application interface 11 is maintained. In some embodiments, the electronic device may also keep the size of the floating window 13 unchanged after switching the memo application interface 11 to floating window mode, when the sliding distance of the above-mentioned backward sliding operation or forward sliding operation does not reach the second distance.
[0160] Understandably, users can flexibly choose the display mode they want to switch to by controlling the swipe distance. For example, users can also release their fingers after the swipe distance reaches the first distance to end the swipe operation and keep the memo application interface 11 in the current display mode.
[0161] The size of the first distance and the second distance can be designed according to actual needs, and this embodiment does not impose any special limitations on them.
[0162] Scenario 1.2: Switching application interfaces
[0163] In some embodiments, the electronic device may switch the displayed second application interface to the third application interface in response to a third swipe operation input by the user in the sensing area.
[0164] The third application interface is the application interface of the recently running tasks, and the third swipe operation can be a forward or backward swipe operation.
[0165] For example, such as Figure 7 As shown in (a), the electronic device displays the memo application interface 11 in full screen. After the user inputs a forward swipe operation in the sensing area, as shown in (a), the electronic device displays the memo application interface 11 in full screen. Figure 7 As shown in (b), the electronic device can respond to the operation by switching the background gallery application interface 14 to the foreground display, that is, switching the memo application interface 11 to the gallery application interface 14.
[0166] After the electronic device switches the Notes app interface 11 to the Gallery app interface 14, in some examples, the user can also input a backward swipe operation in the sensing area to trigger the electronic device to switch the Gallery app interface 14 back to the Notes app interface 11.
[0167] In some embodiments, scenarios 1.1 and 1.2 can be combined to trigger the electronic device to switch the display mode of the application interface or switch the application interface after the user inputs a swipe operation.
[0168] Optionally, after the user inputs a third swipe operation in the sensing area, the electronic device can respond to the third swipe operation and, if no application interface is currently in floating display mode, switch the displayed second application interface to the third application interface. The third swipe operation is in the opposite direction to the first swipe operation.
[0169] Optionally, after the user inputs a fourth swipe operation in the sensing area, the electronic device can respond to the fourth swipe operation and, if there is no application interface with a shrinkable window, switch the display interface to the fourth application interface. The fourth application interface is the application interface of the most recently running task, and the fourth swipe operation has the same swiping direction as the first swipe operation.
[0170] For example, such as Figure 6 As shown in (f) to (h), after the user restores the memo application interface 11 to full-screen mode by swiping forward, as... Figure 7 As shown in (a), if a forward swipe operation is input again in the sensing area, the electronic device can then... Figure 7 As shown in (b), the Memos application interface 11 is switched to the Gallery application interface 14.
[0171] For example, such as Figure 6 As shown in (c) to (e), after the user slides the memo application interface 11 back into the floating ball 12, as shown in (c) to (e), Figure 8 As shown in (a), if a backward sliding operation is input again in the sensing area, the electronic device can then... Figure 8 As shown in (b), the currently displayed desktop is switched to the Gallery application interface 14.
[0172] Taking the first to fourth sliding operations as examples of forward and backward sliding operations, the control principle of the electronic device can be as follows: Figure 9 As shown, after receiving a sliding operation input by the user in the sensing area, the electronic device determines the sliding direction of the sliding operation.
[0173] If the swipe is backward, check if there is an application interface whose window size can be reduced; if so, collapse the application interface and switch its display mode to a smaller window size display mode, as described above. Figure 6 As shown in (a) to (c), the memo application interface 11 is switched from full-screen display mode to floating window mode, or as described above. Figure 6 As shown in (c) to (e), the memo application interface 11 is switched from floating window mode to floating ball mode; if there is no application interface with a resizable window size, the application interface is switched according to the most recently running task, such as the one described above. Figure 8 As shown, the currently displayed desktop is switched to the gallery application interface 14.
[0174] If the user swipes forward, the system checks if any application is in floating mode. If so, it expands the application and switches its display mode to a larger window, as described above. Figure 6 As shown in (e) and (f), the memo application interface 11 is switched from floating ball mode to floating window mode, or as described above. Figure 6 As shown in (f) to (h), the memo application interface 11 is switched from floating window mode to full-screen display mode; if no application interface is in floating display mode, the application interface is switched according to the most recently running task, as described above. Figure 7 As shown, the Notes application interface 11 is switched to the Gallery application interface 14.
[0175] Scenario 2.1: Perform a scrolling screenshot of the application interface while it is in screenshot mode.
[0176] In some embodiments, the electronic device may respond to a fifth swipe operation input by the user in the sensing area, scroll the content of the fifth application interface in the screenshot state, and take a long screenshot of the fifth application interface.
[0177] The fifth swipe action can be a vertical swipe, which better suits user habits and makes it more convenient to use. The fifth application interface can be the interface of any application.
[0178] For example, such as Figure 10As shown in (a), the electronic device displays the interface content 1-1 of the fifth application interface. When the user triggers the screenshot operation, the fifth application interface can be screenshotted. At this time, a screenshot preview window 151 can be displayed floating on the fifth application interface, and a screenshot thumbnail can be displayed in the screenshot preview window 151. Functional controls, such as a share control and a scrolling screenshot control, can also be displayed floating on the fifth application interface. The user can share the screenshot image by clicking the share control, and trigger the electronic device to perform a scrolling screenshot by clicking the scrolling screenshot control.
[0179] like Figure 10 As shown in (a), the display position of the scrolling screenshot control may not be convenient for user operation. In this case, the user can also input an upward or downward swipe operation in the sensing area; such as Figure 10 As shown in (b), the electronic device can respond to this operation by triggering a scrolling screenshot function, scrolling the content of the fifth application interface. For example, when the user inputs an upward swipe operation, the fifth application interface scrolls upward accordingly, and the scrolled fifth application interface includes part of the interface content 1-1 and the newly displayed interface content 1-2. It can be understood that the user can also input a downward swipe operation to trigger the fifth application interface to scroll downward.
[0180] In some examples, after the user lifts their finger to end the fifth swipe operation, the device can continue scrolling the fifth application interface. That is, after the user inputs an up or down swipe operation on the sensing area, the electronic device automatically scrolls the fifth application interface. Specifically, when the user inputs an up swipe operation on the sensing area, the electronic device automatically scrolls the fifth application interface upwards; when the user inputs a down swipe operation on the sensing area, the electronic device automatically scrolls the fifth application interface downwards. When the user wants to end the scrolling screenshot, such as... Figure 10 As shown in (b), the user can click on the scrolling area to trigger the electronic device to end the scrolling screenshot; the electronic device can then generate a long screenshot corresponding to the scrolling screenshot for the user to view and edit, for example, as shown in (b). Figure 10 As shown in (c), the electronic device can display a screenshot editing interface 152 that includes a long screenshot (including interface content 1-1 and interface content 1-2). Users can adjust the size of the long screenshot and draw on it in the screenshot editing interface 152.
[0181] In some examples, when a user triggers a screenshot operation, in response to the user's fifth swipe input in the sensing area, the electronic device can also adjust the size of the screenshot. The electronic device can adjust the screenshot distance of the fifth application interface according to the swipe distance of the fifth swipe operation. That is, the screenshot distance of the fifth application interface can be related to the swipe distance of the fifth swipe operation. For example, the electronic device can shrink the size of the screenshot according to the swipe distance of the fifth swipe operation, and the shrunk size of the screenshot of the fifth application interface can be related to the swipe distance of the fifth swipe operation. The electronic device can also increase the size of the screenshot according to the swipe distance of the fifth swipe operation. For example, the electronic device can perform a scrolling screenshot (or a long screenshot), and the increased size of the screenshot of the fifth application interface is related to the swipe distance of the fifth swipe operation.
[0182] For example, taking the fifth swipe operation as an upward swipe operation, such as... Figure 11 As shown in (a), after the user inputs an upward swipe operation in the sensing area, as... Figure 11 As shown in (b), the electronic device can respond to this operation by triggering a scrolling screenshot function, and gradually scrolling the content of the fifth application interface upwards as the swipe distance increases. For example, the scrolled fifth application interface may include a portion of the interface content 1-1 and newly displayed interface content 1-2. When the user's finger continues to swipe upwards in the sensing area, as... Figure 11 As shown in (c), the electronic device can continue to scroll up the content of the fifth application interface. For example, the scrolled fifth application interface may include part of the interface content 1-1, interface content 1-2 and newly displayed interface content 1-3.
[0183] When the user lifts their finger to end the fifth swipe, the electronic device can generate a long screenshot corresponding to the scrolling screenshot for the user to view and edit, such as... Figure 11 As shown in (d), the electronic device can display a screenshot editing interface 152 that includes long screenshots (including interface content 1-1, interface content 1-2 and interface content 1-3).
[0184] In some examples, when a user triggers a screenshot operation, in response to the user's fifth swipe input in the sensing area, the electronic device can also adjust the size of the screenshot. The electronic device can determine the scrolling screenshot distance of the fifth application interface based on the swipe distance of the fifth swipe operation; that is, the scrolling screenshot distance of the fifth application interface is related to the swipe distance of the fifth swipe operation.
[0185] The methods for triggering the screenshot state can include various approaches. For example, it can be achieved by inputting a specific gesture, clicking a function control in the control center interface, or triggering a specific shortcut key (such as pressing the power button and volume button simultaneously) to enable the electronic device to activate the screenshot function and enter the screenshot state. This application does not specifically limit the method for triggering the electronic device to enter the screenshot state.
[0186] Scenario 2.2: Adjusting the selection box in the screenshot application interface
[0187] In some embodiments, the electronic device may respond to a sixth swipe operation input by the user in the sensing area to adjust the selection range of the screenshot application interface.
[0188] The sixth sliding operation can be a vertical sliding operation or a forward or backward sliding operation.
[0189] The screenshot application interface can be the partial screenshot application interface displayed on the electronic device after the user triggers the partial screenshot function; it can also be the screenshot editing interface displayed after the electronic device performs a scrolling screenshot. The way the user triggers the partial screenshot function is similar to the way the short screenshot function is triggered described above, and will not be repeated here.
[0190] For example, such as Figure 12 As shown in (a), the electronic device displays a screenshot application interface 16. The screenshot application interface 16 includes a screenshot 181 obtained by capturing the interface before the screenshot function is triggered. A selection box 162 covers the screenshot 181. The area of the screenshot 181 selected by the selection box 162 can be completely transparent, while the area not selected by the selection box 162 can be semi-transparent for easy distinction by the user. The screenshot application interface 16 may also include a toolbar 163, which may include various shape controls, such as freeform shapes, rectangles, ellipses, and hearts. Users can adjust the shape of the selection box 162 by selecting these shape controls. The toolbar 163 may also include a sharing control for users to share the image captured by the selection box 162. The screenshot application interface 16 may also include other controls, such as an edit control and a save control located in the upper right corner. Users can edit the image captured by the selection box 162 using the edit control and save the image using the save control.
[0191] Users can adjust the selection area of the selection box 162 by dragging it on the screen. Users can also input a swipe operation in the sensing area to trigger the electronic device to adjust the selection area of the selection box 162. For example, as... Figure 12 As shown in (a), the user inputs an upward swipe operation in the sensing area, such as Figure 12As shown in (b), in response to the operation, the electronic device moves the upper border of the selection box 162 upward. The distance the upper border moves is related to the sliding distance of the user's swipe operation input in the sensing area.
[0192] In some implementations, for any swipe operation input by the user in the sensing area, the electronic device increases the selection range of the selection box 162. For example, if the user inputs an upward swipe operation, the electronic device moves the top border of the selection box 162 upward; if the user inputs a downward swipe operation, the electronic device moves the bottom border of the selection box 162 downward; if the user inputs a forward swipe operation, the electronic device moves the left border of the selection box 162 to the left; and if the user inputs a backward swipe operation, the electronic device moves the right border of the selection box 162 to the right.
[0193] In some implementations, for any swipe operation input by the user in the sensing area, the electronic device reduces the selection range of the selection box 162. For example, if the user inputs an upward swipe operation, the electronic device moves the bottom border of the selection box 162 upward; if the user inputs a downward swipe operation, the electronic device moves the top border of the selection box 162 downward; if the user inputs a forward swipe operation, the electronic device moves the right border of the selection box 162 to the left; and if the user inputs a backward swipe operation, the electronic device moves the left border of the selection box 162 to the right.
[0194] In some implementations, for vertical swipe operations input by the user in the sensing area, the electronic device moves one of the top or bottom borders of the selection box 162; for horizontal swipe operations input by the user in the sensing area, the electronic device moves one of the left or right borders of the selection box 162. When the user holds the electronic device with one hand, the top and right borders of the selection box 162 are closer to the user's thumb, allowing for convenient dragging control on the screen; the bottom and left borders of the selection box 162 are farther from the user's thumb, making operation less convenient. Considering this, in some embodiments, for vertical swipe operations input by the user in the sensing area, the electronic device controls the movement of the bottom border of the selection box 162; for horizontal swipe operations input by the user in the sensing area, the electronic device controls the movement of the left border of the selection box 162.
[0195] like Figure 13 As shown in (a), after the user inputs an upward swipe operation in the sensing area, as... Figure 13 As shown in (b), in response to this operation, the electronic device moves the lower border of the selection box 162 upwards; after the user inputs a swipe-down operation in the sensing area, as shown in (b), the electronic device moves the lower border of the selection box 162 upwards; Figure 13 As shown in (c), in response to this operation, the electronic device moves the lower border of the selection box 162 downwards. After the user inputs a forward swipe operation in the sensing area, as... Figure 13As shown in (d), in response to this operation, the electronic device moves the left border of the selection box 162 to the left; after the user inputs a backward swipe operation in the sensing area, as shown in (d), the electronic device moves the left border of the selection box 162 to the left. Figure 13 As shown in (e), in response to the operation, the electronic device moves the left border of the selection box 162 to the right.
[0196] In some implementations, the sensing area can be divided into two sub-regions in both the length and thickness directions of the side border. The electronic device can move the border of the selection box 162 corresponding to the sub-region affected by the user's input swipe operation. For example, in the length direction of the side border, the sensing area is divided into an upper half and a lower half; in the length direction of the side border, the sensing area is divided into a front half and a rear half. When the user inputs an up or down swipe operation in the upper half, the electronic device moves the upper border of the selection box 162 up or down accordingly; when the user inputs an up or down swipe operation in the lower half, the electronic device moves the lower border of the selection box 162 up or down accordingly; when the user inputs a forward or backward swipe operation in the front half, the electronic device moves the left border of the selection box 162 left or right accordingly; when the user inputs a forward or backward swipe operation in the rear half, the electronic device moves the right border of the selection box 162 left or right accordingly.
[0197] Scenario 3: Scaling the application interface content
[0198] In some embodiments, the electronic device may respond to a seventh swipe operation input by the user in the sensing area to zoom in or out on the interface content displayed in the sixth application interface.
[0199] Alternatively, the seventh swipe operation can be an up-and-down swipe operation, which is more in line with user habits and thus more convenient for users to use.
[0200] The sixth application interface can be any application interface that includes scalable elements, such as a camera application interface, a map application interface, etc.
[0201] In some examples, when an electronic device displays a map application interface, the user can input an up or down swipe gesture in the sensing area to trigger the electronic device to zoom in or out on the map displayed in the map application interface.
[0202] In some embodiments, the electronic device can adjust application-related parameters in a sixth application interface in response to a user's swipe gesture input in the sensing area. For example, such as... Figure 14 As shown in (a), the electronic device displays the camera application interface 17. After the user inputs an upward swipe operation in the sensing area, as shown... Figure 14 As shown in (b), the electronic device can respond to this operation by increasing the focal length and magnifying the image displayed in the preview window.
[0203] In some examples, users can also input a downward swipe action in the sensing area, and the electronic device can respond to this action by reducing the focal length and shrinking the image displayed in the preview window.
[0204] Scenario 4: Adjusting the view of the application interface
[0205] In some embodiments, the electronic device may adjust the viewing angle of the screen displayed in the seventh application interface in response to an eighth swipe operation input by the user in the sensing area.
[0206] The eighth sliding operation can slide along the length of the side border or along the thickness of the side border.
[0207] The seventh application interface can be any interface with adjustable viewing angle, such as a game application interface, a media playback application interface, a video surveillance application interface, etc.
[0208] For example, such as Figure 15 As shown in (a), the electronic device displays the game application interface 18 in landscape mode, and the game application interface 18 displays interface content 2-1; after the user inputs a left swipe operation in the sensing area, as shown in (a), the game application interface 18 displays interface content 2-1. Figure 15 As shown in (b), the electronic device can respond to the operation by moving the viewpoint of the screen displayed in the game application interface 18 to the left, and the game application interface 18 displays new interface content 2-2.
[0209] In some examples, the user can also input a rightward swipe operation on the sensing area, and the electronic device can respond to this operation by moving the view of the screen displayed in the game application interface 18 to the right. In cases where the vertical view of the screen displayed in the game application interface 18 can be adjusted, in some examples, the user can also input a forward swipe operation on the sensing area, triggering the electronic device to move the view of the screen displayed in the game application interface 18 downwards; or, the user can input a backward swipe operation on the sensing area, triggering the electronic device to move the view of the screen displayed in the game application interface 18 upwards.
[0210] In some examples, when playing multi-view videos on a media playback application interface displayed on an electronic device, users can input a swipe gesture in the sensing area to trigger the electronic device to switch the viewpoint of the video screen in the media playback application interface.
[0211] Scenario 5: Adjusting the display area of the application interface in split-screen mode
[0212] In some embodiments, the electronic device may respond to a ninth swipe operation input by the user in the sensing area, adjusting the size and content of the display areas of the split-screen eighth and ninth application interfaces.
[0213] Alternatively, the ninth swipe operation can be a vertical swipe, which is more in line with user habits and thus more convenient for users to use.
[0214] The eighth and ninth application interfaces can be any application interface that supports split-screen display. They can be interfaces from different applications or interfaces from the same application.
[0215] For example, such as Figure 16 As shown in (a), the electronic device displays a split-screen Memos application interface 11 and a Gallery application interface 19. After the user inputs an upward swipe operation in the sensing area, as shown in (a), the screen displays a Memos application interface 11 and a Gallery application interface 19. Figure 16 As shown in (b), the electronic device can respond to this operation by moving the split screen divider line upwards. Correspondingly, the display area of the Memo application interface 11 becomes smaller, and the display area of the Gallery application interface 19 becomes larger, thus adapting the interface content of the two application interfaces.
[0216] Considering that some functions on electronic devices are cumbersome to find, in some embodiments of this application, the electronic device can also perform the following step S120, so that the user can quickly open a predefined application or function by inputting a touch operation in the sensing area.
[0217] S120, in response to a first touch operation applied to the sensing area, launch the target application or target function.
[0218] The first touch operation can be a multi-click operation or a long press operation. In some implementations, the first touch operation is a double-click operation, which is easier for users to remember and thus more convenient for users to use. For ease of explanation, the double-click operation will be used as an example below.
[0219] The target control operation performed by the electronic device in response to the first touch operation can be launching a target application or launching a target function. The target function can be an application function provided by an application or a system function.
[0220] In some implementations, the target control operation can be preset by the system.
[0221] In some implementations, the target control operation can be pre-set by the user; that is, the electronic device can respond to the user's input settings and establish a correspondence between the first touch operation and the target control operation. This can improve the flexibility and convenience of user operation.
[0222] For example, such as Figure 17As shown in (a), the electronic device can provide a quick launch settings interface 21, which may include options for setting the interface opened by the first touch operation, i.e., option 211 for double-clicking the sensing area; wherein option 211 may also indicate the corresponding target control operation, for example, option 211 indicating the camera, indicating that the camera application will be launched. Interface 21 may also include other options, such as option 212, for setting the function of waking up smart voice by long-pressing the power button, so as to turn the function on or off.
[0223] After the user clicks option 211, as follows Figure 17 As shown in (b), the electronic device can respond to the operation by displaying the double-click sensor area settings interface 22, which can display a control list that can indicate various applications and functions that support quick launch, such as: recorder application, camera application, flashlight function, mute function, calculator application, memo application, payment code function, calendar application, etc.
[0224] For example, here the user selects the camera application in interface 22, meaning the user's target control action is to launch the camera application. After setting this, the user can quickly open the camera application by double-clicking the sensor area. For example, as... Figure 18 As shown in (a), the electronic device displays the desktop. After the user inputs a double-click operation in the sensing area, as shown in (a), the screen appears to be blank. Figure 18 As shown in (b), the electronic device can respond to this operation by launching the camera application and displaying the camera application interface 17.
[0225] Understandably, for applications that support the aforementioned swipe operation on the sensing area, the electronic device can respond to the user's swipe operation on the sensing area and execute the corresponding application function when displaying the application interface of such applications; for applications that do not support the aforementioned swipe operation on the sensing area, the electronic device may not respond to the user's swipe operation on the sensing area when displaying the application interface of such applications.
[0226] In some embodiments of this application, the electronic device may also perform the following steps S130 to S150, so that the user can open the shortcut menu through the touch sensing area and quickly start the function corresponding to any control in the shortcut menu.
[0227] S130, in response to a second touch operation applied to the sensing area, a shortcut menu interface is displayed. The shortcut menu interface includes one or more controls.
[0228] S140, In response to the tenth sliding operation applied to the sensing area, switch the target control selected in the shortcut menu interface.
[0229] S150, in response to a third touch operation applied to the sensing area, execute the control operation corresponding to the target control.
[0230] The second touch operation can be a multi-tap or a long press to reduce accidental triggering. The tenth swipe operation can be a vertical swipe or a forward / backward swipe. The third touch operation can be a tap, such as a single tap.
[0231] The quick menu interface can be displayed in a floating manner; it can include one or more of the following controls: at least one application icon corresponding to an application, and at least one function icon corresponding to a function. The application icons and function icons included in the quick menu interface can be predefined, user-defined, or system-recommended.
[0232] In some embodiments, the quick menu interface may further include one or more of the following controls: a close control, a settings control, and an edit control. The close control is used to close the quick menu interface; the edit control is used to trigger the quick menu interface to enter an editable state, in which the quick menu interface can respond to any one or more of the following operations: adding an application icon or function icon, moving an application icon or function icon, or deleting an application icon or function icon.
[0233] For example, such as Figure 19 As shown in (a), the electronic device displays the desktop. After the user performs a long press operation on the sensing area, as shown in (a), the screen appears to be blank. Figure 19 As shown in (b), the electronic device can respond to this operation by displaying a shortcut menu interface 31. The shortcut menu interface 31 can display a list of icons corresponding to frequently used services. For example, the icon list bar 311 includes icons for the payment code function, transit code function, QR code scanning function, flashlight function, calendar application, memo application, and calculator application. The shortcut menu interface 31 also includes a close control 312 and an edit control 313.
[0234] Users can select a target icon in the shortcut menu interface 31 by inputting a swipe operation (such as a vertical swipe or a forward / backward swipe) in the sensing area. The shortcut menu interface 31 can indicate the selected state of the icon. For example, a selection box 32 can indicate the currently selected icon. Of course, other methods can also be used to indicate the selected state of the icon, such as displaying a background pattern under the selected icon.
[0235] In some embodiments, some or all of the controls in the close control 312 and the edit control 313 can also be selected through the above-described sliding operation. For example, the close control 312 is displayed as a large icon in the icon list bar 311, and the edit control 313 is displayed as a small icon outside the icon list bar 311. For the close control 312, the user can select it by inputting a sliding operation in the sensing area; for the edit control 313, the user can select it by clicking the control on the screen. Optionally, the edit control 313 can be displayed in the upper right corner of the shortcut menu interface 31 for easy user operation; the close control 312 can be displayed in the middle of the icon list for easy user selection.
[0236] In some examples, certain functions can also be displayed as small icons outside the icon list bar 311, for example... Figure 19 As shown in (a), it is used to trigger Figure 17 The settings control 314 of the quick launch settings interface 21 shown can be displayed as a small icon in the upper right corner of the quick menu interface 31. Users can click on the control to trigger the electronic device to quickly open the quick launch settings interface 21.
[0237] For example, such as Figure 19 As shown in (b), in the initial state, the close control 312 can be selected; after the user inputs an upward swipe operation in the sensing area, as shown in (b), Figure 19 As shown in (c), in response to this operation, the electronic device moves the selection box 32 to the icon corresponding to the ride code function (i.e., the ride code icon), indicating that the ride code icon is selected. Then, the user inputs a click operation in the sensing area or performs an operation to stop touching the sensing area, such as... Figure 19 As shown in (d), in response to the operation, the electronic device opens the function interface 33 corresponding to the ride code icon, which can display the corresponding ride code.
[0238] In some examples, users can perform multiple swipes in the sensing area to select an icon in the shortcut menu interface 31.
[0239] In some examples, after the user enters a double-click operation in the sensing area to open the shortcut menu interface 31, the close control 312 is selected. The user can also directly enter a single-click operation in the sensing area to close the shortcut menu interface 31.
[0240] In some examples, such as Figure 20 As shown in (a), the user can click the edit control 313, such as Figure 20As shown in (b), the electronic device can respond to this operation by controlling the shortcut menu interface 31 to enter an editable state. Exemplarily, in the editable state, a delete control can be displayed in the upper right corner of each application icon and function icon in the icon list bar 311 of the shortcut menu interface 31. For any application icon or function icon in the icon list bar 311, the user can trigger the electronic device to delete the icon in the shortcut menu interface by clicking the delete control in its upper right corner. In some examples, in the editable state, the user can move the icons in the icon list bar 311 by dragging them.
[0241] In some examples, after the shortcut menu interface 31 enters the editable state, it can display the add control 315. Users can click the add control 315 to trigger the electronic device to open the interface for adding application icons or function icons. This interface can display a list of icons of various applications and functions that can be added to the shortcut menu interface 31. Users can select the relevant icons from the list and add them to the shortcut menu interface 31.
[0242] Understandably, for any control displayed in the shortcut menu interface 31, the user can also trigger the electronic device to perform the corresponding control operation by clicking the control on the display screen.
[0243] Furthermore, the naming conventions for user input operations in this application embodiment are merely examples and should not be construed as limiting the scope of this application embodiment. In some embodiments, the same operation may also use other names, such as first operation, second operation, etc. Similarly, the naming conventions for various functions, interfaces, and interface elements in this application embodiment are also merely examples and are not intended to limit this application. In other embodiments, other names may also be used.
[0244] Furthermore, the user interface shown in the embodiments of this application is only an example and is not intended to limit this application. In some embodiments, the user interface displayed by the electronic device may include more or fewer interface elements than shown in the figure to achieve more or fewer functions; the position of each interface element may be adjusted as needed; each function may also be implemented using other interface elements, or may also be implemented in other user interfaces. This embodiment does not make any special limitations on this.
[0245] It should also be understood that any of the above examples or any of the diagrams can be considered an independent solution, or any combination of the above examples or any combination of diagrams can also be considered an independent solution. This application does not impose any special restrictions on this.
[0246] Those skilled in the art will understand that the above embodiments are exemplary and not intended to limit this application. Where possible, the execution order of one or more of the above steps can be adjusted; for example, the order of steps S110, S120, and S130 can be arbitrarily adjusted. One or more of the above steps can also be selectively combined to obtain one or more other embodiments. Those skilled in the art can arbitrarily select and combine the above steps as needed, and all combinations that do not depart from the essence of this application fall within the protection scope of this application.
[0247] Based on the same concept, as an implementation of the above method, this application provides an interactive device. This device embodiment corresponds to the aforementioned method embodiment. For ease of reading, this device embodiment will not repeat the details of the aforementioned method embodiment one by one, but it should be clear that the device in this embodiment can implement all the contents of the aforementioned method embodiment.
[0248] Figure 21 This is a schematic diagram of the structure of the interactive device provided in the embodiments of this application, such as... Figure 21 As shown, the apparatus provided in this embodiment includes:
[0249] Display module 210, input module 220, processing module 230 and communication module 240.
[0250] The display module 210 is used to support the electronic device in performing the interface display operations in the above embodiments and / or other processes used in the technology described herein. The display module may be a touch screen or other hardware or a combination of hardware and software.
[0251] The input module 220 is used to receive user input on the electronic device, such as touch input, voice input, gesture input, etc. The input module is used to support the electronic device in performing the steps of receiving user operations in the above embodiments and / or other processes used in the technology described herein. The input module may be a touch screen or other hardware or a combination of hardware and software.
[0252] The processing module 230 is used to support the electronic device in performing the processing operations in the method steps of the above embodiments and / or other processes used in the technology described herein.
[0253] The communication module 240 is used to support the electronic device in performing operations related to communication processes with other electronic devices as described in the above embodiments and / or other processes for the techniques described herein.
[0254] The device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, so it will not be described again here.
[0255] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0256] Based on the same concept, as an implementation of the above method, this application also provides an electronic device. Figure 22 A schematic diagram of the system architecture of the electronic device provided in the embodiments of this application.
[0257] Electronic devices may include hardware systems and software systems, wherein the hardware system may include fingerprint sensors, cameras, displays, and memory, and Figure 22 Other components not shown.
[0258] The software system of electronic devices can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. The software system of electronic devices can be... system, system, system, System or Systems, etc.
[0259] This application uses the layered architecture of the Android system as an example to illustrate the software structure of an electronic device. For example... Figure 22 As shown, the software system of an electronic device can be divided into several layers, which communicate with each other through software interfaces. In some embodiments, the Android system can be divided into the application layer, application framework layer, Android runtime and system libraries, and kernel layer from top to bottom.
[0260] The application layer can include a series of applications. For example... Figure 22 As shown, applications can include camera, gallery, calendar, call, WLAN, Bluetooth, music, memo, SMS, fingerprint key, browser, and other applications.
[0261] The application framework layer provides an Application Programming Interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0262] like Figure 22 As shown, the application framework layer may include a window manager, content provider, view system, resource manager, notification manager, and input manager, etc.
[0263] The window manager provides a window management service (WMS), which can be used for window management, window animation management, surface management, and as an intermediary for the input system. The window manager can obtain the screen size, determine if a status bar is present, lock the screen, and capture the screen, among other things.
[0264] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0265] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0266] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, etc.
[0267] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen.
[0268] The input manager service (IMS) can be used to manage system inputs, such as touchscreen input, keypad input, and sensor input. IMS retrieves events from input device nodes and passes the events generated by user input operations to the corresponding applications.
[0269] The Android Runtime consists of the core libraries and the virtual machine. The Android Runtime is responsible for the scheduling and management of the Android system. The core libraries consist of two parts: one part contains the functionalities that the Java language needs to call, and the other part contains the core Android libraries.
[0270] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0271] System libraries can include multiple functional modules. For example: Surface Manager, Media Libraries, 3D graphics processing libraries (e.g., OpenGL ES), and 2D graphics engines (e.g., SGL).
[0272] The Surface Manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The Media Library supports playback and recording of various common audio and video formats, as well as still image files. The Media Library supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG. The 3D Graphics Processing Library implements 3D graphics drawing, image rendering, compositing, and layer processing. The 2D Graphics Engine is the drawing engine for 2D graphics.
[0273] The kernel layer is the layer between hardware and software, providing core system services to the Android kernel, such as security services, network services, memory management services, detection management services, and driver models. The kernel layer can include display drivers, camera drivers, audio drivers, and sensor drivers, among others.
[0274] Taking the aforementioned sensing area as a fingerprint sensing area as an example, in this embodiment of the application, after the user inputs a touch operation in the sensing area, the fingerprint sensor in the hardware device can generate a corresponding hardware interrupt and send it to the kernel layer. The kernel layer can encapsulate the touch operation into a touch event and report the touch event to the upper-level fingerprint key application through the input manager of the application framework layer.
[0275] When a user inputs a touch operation in the sensing area, a series of touch events are generated. Upon receiving these touch events, the fingerprint sensor application can determine the touch duration, number of touches, and touch location (specifically, the touch location of the characteristic fingerprint) based on these events, and thus recognize the gesture operation. After recognizing the gesture operation, the fingerprint sensor application can report it to the relevant application, causing the application to respond to the gesture operation and execute the corresponding control action.
[0276] Understandably, if the fingerprint sensor area is not reused, gesture recognition and corresponding control operations can be achieved through other touch sensors and the corresponding touch keys of that sensor area.
[0277] The structure of the electronic device is described below.
[0278] Please see Figure 23 , Figure 23 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application.
[0279] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0280] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0281] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0282] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0283] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0284] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0285] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). The I2S interface can be used for audio communication. The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. The UART interface is a universal serial data bus used for asynchronous communication; this bus can be a bidirectional communication bus, converting the data to be transmitted between serial and parallel communication. The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and camera 193; MIPI interfaces include camera serial interface (CSI) and display serial interface (DSI). The GPIO interface can be configured via software; it can be configured as a control signal or a data signal. The USB interface 130 is a USB standard compliant interface, specifically a Mini USB interface, MicroUSB interface, or USB Type-C interface. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used for data transfer between the electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0286] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0287] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.
[0288] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.
[0289] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0290] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0291] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0292] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.
[0293] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0294] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division-Synchronous Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GNSS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0295] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint information to perform fingerprint verification, such as fingerprint unlocking, accessing application locks, taking photos with fingerprints, and answering calls with fingerprints; it can also use the collected fingerprint information to recognize fingerprint gesture operations to execute corresponding control operations.
[0296] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0297] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a Micro LED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.
[0298] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0299] The ISP is used to process data fed back from camera 193. Camera 193 is used to capture still images or video. The digital signal processor is used to process digital signals; in addition to digital image signals, it can also process other digital signals. The video codec is used to compress or decompress digital video.
[0300] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0301] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a function (such as sound playback, image playback, etc.). The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0302] The external storage interface 120 can be used to connect external storage devices, such as Micro SD cards, to expand the storage capacity of the electronic device 100. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.
[0303] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0304] Audio module 170 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. Audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, audio module 170 can be located in processor 110, or some functional modules of audio module 170 can be located in processor 110. Speaker 170A, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. Receiver 170B, also called a "handpiece," is used to convert audio electrical signals into sound signals. Microphone 170C, also called a "microphone" or "microphone," is used to convert sound signals into electrical signals. Headphone jack 170D is used to connect wired headphones. Headphone jack 170D can be a USB interface 130, or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, or a Cellular Telecommunications Industry Association of the USA (CTIA) standard interface.
[0305] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with electronic device 100. Electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.
[0306] The electronic device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, so they will not be described again here.
[0307] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the methods described in the above-described method embodiments.
[0308] This application also provides a computer program product that, when run on an electronic device, causes the electronic device to implement the method described in the above-described method embodiments.
[0309] This application also provides a chip system including a processor coupled to a memory. The processor executes a computer program stored in the memory to implement the method described in the above-described method embodiments. The chip system may be a single chip or a chip module composed of multiple chips.
[0310] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, or magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).
[0311] Those skilled in the art will understand that implementing all or part of the processes in the above embodiments can be accomplished by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium can include various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0312] The naming or numbering of steps in this application does not mean that the steps in the method flow must be executed in the time / logical order indicated by the naming or numbering. The execution order of the named or numbered process steps can be changed according to the technical purpose to be achieved, as long as the same or similar technical effect can be achieved.
[0313] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0314] In the embodiments provided in this application, it should be understood that the disclosed apparatus / devices and methods can be implemented in other ways. For example, the apparatus / device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0315] It should be understood that in the description of this application and the appended claims, the terms "comprising," "including," "having," and any variations thereof are intended to cover a non-exclusive inclusion and mean "including but not limited to," unless otherwise specifically emphasized. For example, a process, method, system, product, or apparatus that includes a series of steps or modules is not necessarily limited to those steps or modules that are explicitly listed, but may include other steps or modules that are not explicitly listed or that are inherent to such process, method, product, or apparatus.
[0316] In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can mean A or B. "And / or" in this application is used to describe the relationship between the related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. A and B can be singular or plural.
[0317] Furthermore, in the description of this application, unless otherwise stated, "multiple" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
[0318] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."
[0319] Furthermore, in the description of this application and the appended claims, the terms "first," "second," etc., are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence, nor should they be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than that illustrated or described herein; features defined as "first" or "second" may explicitly or implicitly include at least one of those features.
[0320] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.
[0321] In this specification, references to "one embodiment" or "some embodiments" mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in still other embodiments" appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application and are not intended to limit it; although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. An interaction method, characterized in that, Applied to an electronic device, wherein a sensing area is provided on the side frame of the electronic device, the method includes: Display the first display interface; In response to a sliding operation applied to the sensing area, the interface size of the first display interface is adjusted.
2. The method according to claim 1, characterized in that, The adjustment of the interface size of the first display interface in response to a sliding operation applied to the sensing area includes: In response to a first sliding operation applied to the sensing area, the first application interface is switched from a first display mode to a second display mode; the window size of the second display mode is smaller than the window size of the first display mode, and the second display mode is a floating display mode.
3. The method according to claim 2, characterized in that, The method further includes: In response to a second sliding operation applied to the sensing area, the first application interface is switched from the second display mode to the first display mode; the second sliding operation is in the opposite direction to the first sliding operation.
4. The method according to claim 3, characterized in that, The method further includes: In response to a third sliding operation applied to the sensing area, if there is no application interface in the floating display mode, the displayed second application interface will be switched to the third application interface; the third application interface is the application interface of the recently running task, and the sliding direction of the third sliding operation is opposite to that of the first sliding operation. In response to a fourth sliding operation applied to the sensing area, if there is no application interface with a shrinkable window size, the display interface will be switched to a fourth application interface; the fourth application interface is the application interface of the recently running task, and the fourth sliding operation has the same sliding direction as the first sliding operation.
5. The method according to any one of claims 2-4, characterized in that, The floating display modes include multiple modes, and the window sizes of each floating display mode are different; the first display mode is either a full-screen display mode or a floating display mode.
6. The method according to claim 5, characterized in that, The first application interface gradually switches to the second display mode among multiple floating display modes, wherein the window size of the first application interface decreases as the sliding distance of the first sliding operation increases.
7. The method according to any one of claims 2-6, characterized in that, The floating display mode includes any one or more of the following: floating window mode, floating card mode, and floating ball mode.
8. The method according to any one of claims 2-7, characterized in that, The first sliding operation slides along the thickness direction of the side frame.
9. The method according to any one of claims 1-8, characterized in that, The method further includes: In response to a fifth swipe operation applied to the sensing area, the interface content of the fifth application interface in the screenshot state is scrolled to perform a scrolling screenshot of the fifth application interface.
10. The method according to claim 9, characterized in that, The fifth swipe operation slides along the length of the side frame, and the screenshot distance of the fifth application interface is related to the swipe distance of the fifth swipe operation.
11. The method according to any one of claims 1-10, characterized in that, The method further includes: In response to a sixth sliding operation applied to the sensing area, the selection range of the screenshot box in the screenshot application interface is adjusted.
12. The method according to any one of claims 1-11, characterized in that, The method further includes: In response to a seventh sliding operation applied to the sensing area, the interface content in the sixth application interface is zoomed in or zoomed out.
13. The method according to any one of claims 1-12, characterized in that, The method further includes: In response to an eighth sliding operation applied to the sensing area, the viewing angle of the screen displayed in the seventh application interface is adjusted.
14. The method according to any one of claims 1-13, characterized in that, The method further includes: In response to a ninth sliding operation applied to the sensing area, the size and content of the display areas of the eighth and ninth application interfaces in the split-screen display are adjusted.
15. The method according to any one of claims 1-14, characterized in that, The method further includes: In response to a first touch operation applied to the sensing area, a target control operation is performed; the target control operation includes launching a target application or a target function.
16. The method according to claim 15, characterized in that, The method further includes: In response to the setting operation, the correspondence between the first touch operation and the target control operation is set.
17. The method according to claim 15 or 16, characterized in that, The first touch operation is a double-touch operation.
18. The method according to any one of claims 1-17, characterized in that, The method further includes: In response to a second touch operation applied to the sensing area, a shortcut menu interface is displayed; the shortcut menu interface includes any one or more of the following controls: at least one application icon corresponding to an application, and at least one function icon corresponding to a function. In response to a tenth sliding operation applied to the sensing area, the target control selected in the shortcut menu interface is switched; In response to a third touch operation applied to the sensing area, the control operation corresponding to the target control is executed.
19. The method according to claim 18, characterized in that, The shortcut menu interface also includes any one or more of the following controls: The close control is used to close the shortcut menu interface; An editing control is used to trigger the shortcut menu interface to enter an editable state. In the editable state, the shortcut menu interface can respond to any one or more of the following operations: adding an application icon or function icon, moving an application icon or function icon, or deleting an application icon or function icon.
20. The method according to claim 18 or 19, characterized in that, The second touch operation is a long press, and the third touch operation is a single click.
21. The method according to any one of claims 1-20, characterized in that, The sensing area is a fingerprint sensing area.
22. An electronic device, characterized in that, include: A memory and a processor, the memory being used to store a computer program; the processor being used to execute the method as described in any one of claims 1-21 when the computer program is invoked.
23. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1-21.
24. A computer program product, characterized in that, When the computer program product is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1-21.
25. A chip system, characterized in that, The chip system includes a processor coupled to a memory, the processor executing a computer program stored in the memory to implement the method as described in any one of claims 1-21.